Skip to content

docs/search: explain indexed vs unindexed trigram difference - #2084

Merged
keegancsmith merged 1 commit into
mainfrom
k/doc-trigram-skipped-files
Oct 9, 2026
Merged

keegancsmith merged 1 commit into
mainfrom
k/doc-trigram-skipped-files

Conversation

@keegancsmith

Copy link
Copy Markdown
Member

Zoekt skips the content of files with more than 20,000 unique trigrams (mostly minified JS, source maps and lockfiles), but unindexed search (searcher) has no such check, so the same query can return more results with index:no than indexed. Rather than adding a trigram check to searcher, we agreed to document the difference and the workarounds: index:no or search.largeFiles.

Discussion: https://sourcegraph.slack.com/archives/C022SPMNR0W/p1791537536129499

Zoekt skips the content of files with more than 20,000 unique trigrams,
but searcher has no such check, so the same query can return more
results with index:no than with indexed search. Rather than adding a
trigram check to searcher, we agreed to document the difference and the
workarounds (index:no or search.largeFiles).

Discussion: https://sourcegraph.slack.com/archives/C022SPMNR0W/p1791537536129499
Amp-Thread-ID: https://ampcode.com/threads/T-01a12086-a7de-72df-95e1-32459134836e
Co-authored-by: Amp <amp@ampcode.com>
@keegancsmith
keegancsmith requested a review from eseliger October 9, 2026 12:02
@vercel

vercel Bot commented Oct 9, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
sourcegraph-docs Ready Ready Preview Oct 9, 2026 12:04pm UTC

Request Review

@github-actions

github-actions Bot commented Oct 9, 2026 •

Copy link
Copy Markdown
Contributor

Direct preview links to pages changed in this PR:

@github-actions

github-actions Bot commented Oct 9, 2026 •

Copy link
Copy Markdown
Contributor

@keegancsmith
keegancsmith merged commit 8682e52 into main Oct 9, 2026
8 checks passed
@keegancsmith
keegancsmith deleted the k/doc-trigram-skipped-files branch October 9, 2026 13:15

This branch was successfully deployed

1 active deployment
Preview — dfd3d190 Deployed Oct 9, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants