Add ExpressionAnalyzer for pluggable expression-level statistics estimation - #21122

Draft

asolimando wants to merge 16 commits into

apache:mainfrom

asolimando:asolimando/ndv-expression-analyzer

Commits on Apr 20, 2026

Add ExpressionAnalyzer for pluggable expression-level statistics
asolimando
committed
Fix CI: update config docs, sqllogictest, and doc links
asolimando
committed
Fix doc placement, import path, extract helper, defer selectivity computation
asolimando
committed
Snapshot column stats for analyzer to avoid ordering dependency
asolimando
committed
Use registry NDV for equality/inequality selectivity on expressions
asolimando
committed
Narrow injective arithmetic to addition and subtraction only
asolimando
committed
Make resolve_ndv symmetric: use max NDV across both operands
asolimando
committed
Clarify enable_expression_analyzer scope in config and doc comments
asolimando
committed
Inject ExpressionAnalyzerRegistry into exec nodes and re-inject via optimizer loop
asolimando
committed
test(filter): verify ExpressionAnalyzer inclusion-exclusion selectivity for OR predicates
asolimando
committed
refactor(expression_analyzer): delegate when no NDV statistics are available
asolimando
committed
test(expression_analyzer): add StatisticsTable and end-to-end SLT for OR selectivity
asolimando
committed
fix: replace as_any().downcast_ref with downcast_ref after upstream as_any removal (#21573)
asolimando
committed
fix: inject ExpressionAnalyzer registry before optimizer loop to close no-op rules gap
asolimando
committed
fix: align JoinStatisticsProvider with config gate, fall back to direct column stats when no ExpressionAnalyzer
asolimando
committed
fix: remove stale comment about NDV pinning in statistics_helper
asolimando
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add ExpressionAnalyzer for pluggable expression-level statistics estimation - #21122

Add ExpressionAnalyzer for pluggable expression-level statistics estimation#21122
asolimando wants to merge 16 commits into
apache:mainfrom
asolimando:asolimando/ndv-expression-analyzer

Commits on Apr 20, 2026

Add ExpressionAnalyzer for pluggable expression-level statistics

Fix CI: update config docs, sqllogictest, and doc links

Fix doc placement, import path, extract helper, defer selectivity computation

Snapshot column stats for analyzer to avoid ordering dependency

Use registry NDV for equality/inequality selectivity on expressions

Narrow injective arithmetic to addition and subtraction only

Make resolve_ndv symmetric: use max NDV across both operands

Clarify enable_expression_analyzer scope in config and doc comments

Inject ExpressionAnalyzerRegistry into exec nodes and re-inject via optimizer loop

test(filter): verify ExpressionAnalyzer inclusion-exclusion selectivity for OR predicates

refactor(expression_analyzer): delegate when no NDV statistics are available

test(expression_analyzer): add StatisticsTable and end-to-end SLT for OR selectivity

fix: replace as_any().downcast_ref with downcast_ref after upstream as_any removal (#21573)

fix: inject ExpressionAnalyzer registry before optimizer loop to close no-op rules gap

fix: align JoinStatisticsProvider with config gate, fall back to direct column stats when no ExpressionAnalyzer

fix: remove stale comment about NDV pinning in statistics_helper