Skip to content

Index host catalog paths for bounded substring search - #181

Merged
Yehonal merged 2 commits into
mainfrom
pr/catalog-trigram-v2
Nov 4, 2026
Merged

Yehonal merged 2 commits into
mainfrom
pr/catalog-trigram-v2

Conversation

@Yehonal

@Yehonal Yehonal commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

Substring searches over large host catalogs scan every path twice and can block the admin API. Add a resumable, transactional trigram path index so supported queries can use indexed candidates while preserving exact totals, ordering, domain filtering, and content-search semantics.

The index is built explicitly in bounded batches. Until it is complete, and for queries outside the proven tokenizer compatibility range, searches retain the previous exact behavior. Existing service owners must release the exclusive database lock before running the installed backfill CLI; plan disk space and downtime before activation.

Validation: full suite (1,222 passed, 9 skipped), independent search-parity and installer review, crash/restart and installed-release smoke tests, synthetic benchmark. Real-catalog backfill cost has not been measured.

@Yehonal
Yehonal merged commit a6df49a into main Nov 4, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant