Skip to content

feat: wire RDF bloom typed payloads - #2

Draft
discord9 wants to merge 3 commits into
omos/rdf-bloom-lookup-encoderfrom
omos/rdf-bloom-wiring
Draft

feat: wire RDF bloom typed payloads#2
discord9 wants to merge 3 commits into
omos/rdf-bloom-lookup-encoderfrom
omos/rdf-bloom-wiring

Conversation

@discord9

@discord9 discord9 commented Jun 24, 2026

Copy link
Copy Markdown
Owner

I hereby agree to the terms of the GreptimeDB CLA.

Refer to a related PR or issue link (optional)

Fork-only stack PR. Stacked on PR1c: #6

Earlier stack:

Depends on:

Part of original umbrella draft PR: GreptimeTeam#8342

What's changed and what's your intention?

This is PR 2 of the RDF Bloom stack. It wires typed RDF Bloom remote dynamic filter payloads through FE fanout, initial snapshots, and DN handling:

  • carries input schema through remote dynamic filter capture/registry paths
  • encodes typed JoinHashBloom payloads while retaining legacy payload fallback
  • lets DN prefer typed_payload and fall back to legacy payload
  • attaches Bloom initial snapshots from DataFusion hash lookup expressions
  • preserves producer-side initial snapshot completion with DynamicFilterPhysicalExpr::is_complete()

Validation run locally:

  • cargo fmt --all -- --check
  • git diff --check
  • CARGO_PROFILE_DEV_DEBUG=0 CARGO_PROFILE_TEST_DEBUG=0 cargo test -p common-query request --lib
  • CARGO_PROFILE_DEV_DEBUG=0 CARGO_PROFILE_TEST_DEBUG=0 cargo test -p query remote_dyn_filter --lib
  • CARGO_PROFILE_DEV_DEBUG=0 CARGO_PROFILE_TEST_DEBUG=0 cargo test -p datanode remote_dyn_filter --lib

PR Checklist

Please convert it to a draft if some of the following conditions are not met.

  • I have written the necessary rustdoc comments.
  • I have added the necessary unit tests and integration tests.
  • This PR requires documentation updates.
  • API changes are backward compatible.
  • Schema or data changes are backward compatible.

@discord9
discord9 force-pushed the omos/rdf-bloom-wiring branch 2 times, most recently from 775a077 to c5a8c74 Compare June 25, 2026 09:16
@discord9
discord9 force-pushed the omos/rdf-bloom-common-query branch from 7768ea3 to 7b323f3 Compare June 25, 2026 09:16
@discord9
discord9 changed the base branch from omos/rdf-bloom-common-query to omos/rdf-bloom-lookup-encoder June 25, 2026 09:19
@discord9
discord9 force-pushed the omos/rdf-bloom-wiring branch from c5a8c74 to e6375bc Compare June 25, 2026 10:24
@discord9
discord9 force-pushed the omos/rdf-bloom-lookup-encoder branch from e11ba18 to 4ac6cbb Compare June 25, 2026 10:24
@discord9
discord9 force-pushed the omos/rdf-bloom-wiring branch from e6375bc to b19e1ec Compare June 25, 2026 12:59
@discord9
discord9 force-pushed the omos/rdf-bloom-lookup-encoder branch 2 times, most recently from 5dfb2e7 to d709602 Compare June 30, 2026 04:01
@discord9
discord9 force-pushed the omos/rdf-bloom-wiring branch from b19e1ec to c4e8c34 Compare June 30, 2026 04:01
discord9 added 3 commits July 6, 2026 16:46
Signed-off-by: discord9 <discord9@163.com>
Signed-off-by: discord9 <discord9@163.com>
Signed-off-by: discord9 <discord9@163.com>
@discord9
discord9 force-pushed the omos/rdf-bloom-lookup-encoder branch from d709602 to e36383d Compare July 6, 2026 09:46
@discord9
discord9 force-pushed the omos/rdf-bloom-wiring branch from c4e8c34 to 6f5e273 Compare July 6, 2026 09:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant