You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 275e89a
Browse filesBrowse the repository at this point in the historyBrowse files
feat: Owner-Computes dedup via routing_mask bitmask
Eliminate cross-subtask and IQ bidirectional duplicate matches inside
JoinOperator, reducing Sink dedup pressure to zero.
- Add routing_mask_ (uint64_t bitmask) to VectorRecord
- Set routing_mask in ResultPartition::emit() for broadcast/multicast/unicast
- Owner-Computes rule in JoinOperator emit: only lowest-indexed subtask
in intersection(query_mask, cand_mask) emits a match
- Propagate candidate routing_mask through JoinFunction result
- Add combinedMatchId() for fallback dedup path
- Add owner_dedup_count metric
Results (ClusteredJoin p=8, k=8):
Before: total_emits=3,091,648 sink_dedup=2,705,192
After: total_emits=386,456 sink_dedup=0
Recall=1.0000 Precision=1.0000
0 commit comments