feat(search): native hybrid search with score fusion (fuse + hybrid) - #9738

Open

shaunpatterson wants to merge 54 commits into

dgraph-io:mainfrom

shaunpatterson:sp/hybrid-search

Commits on Jul 14, 2026

feat(search): add BM25 ranked text search

shaunpatterson
and
claude
committed
888d6a8
fix(bm25): store TF/doclen in facets and fix query pipeline integration

shaunpatterson
and
claude
committed
1f0ae5d
perf(bm25): replace facet storage with compact direct Badger KV encoding

shaunpatterson
and
claude
committed
e80eaa3
test(bm25): add 15 integration tests for mutation scenarios and edge cases

shaunpatterson
and
claude
committed
6a7c1e6
test(bm25): add exact score verification, BM15 variant, and single-doc tests

shaunpatterson
and
claude
committed
83f232f
feat(bm25): add block storage infrastructure for segmented column stores

shaunpatterson
and
claude
committed
bb1434a
feat(bm25): segmented block writes and WAND/Block-Max WAND query path

shaunpatterson
and
claude
committed
fff931b
feat(bm25): add legacy format fallback for migration and WAND unit tests

shaunpatterson
and
claude
committed
fbd0f9d
fix(bm25): address GPT-5 code review findings in WAND implementation

shaunpatterson
and
claude
committed
35826d9
fix(bm25): prevent stats double-counting on updates and fix BMW otherUB underestimate

shaunpatterson
and
claude
committed
96e4213
fix(bm25): clamp startPos in skipTo to prevent negative sort.Search length

shaunpatterson
and
claude
committed
a9f03af
fix(bm25): address Gemini/GPT-5 code review findings

shaunpatterson
and
claude
committed
caae624
feat(bm25): rework BM25 onto standard posting lists

shaunpatterson
and
claude
committed
8f4c0d8
fix(bm25): accumulate corpus stats across transactions

shaunpatterson
and
claude
committed
d7d0e71
fix(bm25): reject @index(bm25) on list predicates

shaunpatterson
and
claude
committed
6865f71
chore(bm25): drop working design notes

shaunpatterson
and
claude
committed
217d242
feat(search): native hybrid search with score fusion (fuse + hybrid)

shaunpatterson
and
claude
committed
e5b98b9
fix(review): resolve consensus findings from deep review

shaunpatterson
and
claude
committed
3791e44
fix(hybrid): register fuse in isValidFuncName; snapshot ranker scores
shaunpatterson
committed
98ae433
style(hybrid): fix Trunk lint (tagged switch, prettier, markdownlint)

shaunpatterson
and
claude
committed
8bde1e7
refactor(query): remove dead valToTaskValue

shaunpatterson
and
claude
committed
b0877b3
feat(search): add BM25 ranked text search

shaunpatterson
and
claude
committed
65cf423
fix(bm25): store TF/doclen in facets and fix query pipeline integration

shaunpatterson
and
claude
committed
f32557c
perf(bm25): replace facet storage with compact direct Badger KV encoding

shaunpatterson
and
claude
committed
88b2b3e
test(bm25): add 15 integration tests for mutation scenarios and edge cases

shaunpatterson
and
claude
committed
d08bd8d
test(bm25): add exact score verification, BM15 variant, and single-doc tests

shaunpatterson
and
claude
committed
f304180
feat(bm25): add block storage infrastructure for segmented column stores

shaunpatterson
and
claude
committed
d5450e3
feat(bm25): segmented block writes and WAND/Block-Max WAND query path

shaunpatterson
and
claude
committed
cd2f35a
feat(bm25): add legacy format fallback for migration and WAND unit tests

shaunpatterson
and
claude
committed
98db3c6
fix(bm25): address GPT-5 code review findings in WAND implementation

shaunpatterson
and
claude
committed
3e8dab7
fix(bm25): prevent stats double-counting on updates and fix BMW otherUB underestimate

shaunpatterson
and
claude
committed
2628738
fix(bm25): clamp startPos in skipTo to prevent negative sort.Search length

shaunpatterson
and
claude
committed
0121ea2
fix(bm25): address Gemini/GPT-5 code review findings

shaunpatterson
and
claude
committed
01da860
feat(bm25): rework BM25 onto standard posting lists

shaunpatterson
and
claude
committed
8779de6
fix(bm25): accumulate corpus stats across transactions

shaunpatterson
and
claude
committed
1a6f3ff
fix(bm25): reject @index(bm25) on list predicates

shaunpatterson
and
claude
committed
59f2676
chore(bm25): drop working design notes

shaunpatterson
and
claude
committed
9bdf757
fix(bm25): use tagged switch on err (staticcheck QF1002)

shaunpatterson
and
claude
committed
2b66331
fix(bm25): clear corpus stats on index drop/rebuild

shaunpatterson
and
claude
committed
66f0e40
fix(bm25): aggregate corpus stats during index rebuild

shaunpatterson
and
claude
committed
b6210b2
fix(bm25): bound query memory on the offset/filter paths with WAND top-k

shaunpatterson
and
claude
committed
c99e06f
fix(bm25): build a correct BM25 index in the bulk loader

shaunpatterson
and
claude
committed
91342f4
fix(bm25): bind score var from uid-keyed snapshot; drop dead helper
shaunpatterson
committed
250b79b
fix(bm25): deterministic UID tie-break in WAND top-k heap eviction

shaunpatterson
and
claude
committed
bf91ca2
feat(bm25): reject @noconflict on bm25 predicates; add tie-break e2e test

shaunpatterson
and
claude
committed
e8806a3

Commits on Jul 18, 2026

Merge remote-tracking branch 'origin/sp/bm25' into sp/hybrid-search
shaunpatterson
committed
af4224b
fix(hybrid): guard topk, preserve $var text arg, reject dropped modifiers

shaunpatterson
and
claude
committed
dc12fbb
fix(hybrid): clamp negative similarities in linear fusion

shaunpatterson
and
claude
committed
1ab735e

Commits on Jul 19, 2026

test(hybrid): wave-1 correctness battery + fixes for 6 confirmed bugs

shaunpatterson
and
claude
committed
0b80623
docs(hybrid): testing deep-dive report with wave-1 outcomes

shaunpatterson
and
claude
committed
c384f7f
test(bm25): wave-2 lifecycle/distributed suite; fix intra-proposal stats race

shaunpatterson
and
claude
committed
53caacf
bench(hybrid): wave-3 performance attack (WAND, fusion, stats floor)

shaunpatterson
and
claude
committed
874a50a
fix(bm25): exact bulk-loader stats via reducer fold; 3.5x faster fusion

shaunpatterson
and
claude
committed
594d447
fix(bm25): enforce list-predicate rejection at parse level; fuse cleanups

shaunpatterson
and
claude
committed
7802cc6