feat: split Parquet files into row-group-sized morsels - #59

Closed

adriangb wants to merge 12 commits into

mainfrom

row-group-morsel-split

Commits on Apr 21, 2026

chore: backport version from `branch-53`, update some dependencies (#21708)
comphead
authored
fix: array_concat widens container variant for mixed List/LargeList inputs (#21704)
hcrosse
authored
feat: Expose used `MemoryPool` details in `ResourcesExhausted` error messages (#20387)
erenavsarogullari
authored
perf: Reduce `Box` and `Arc` allocation churn during tree rewriting (#21749)
neilconway
authored
feat: estimate cardinality for semi and anti-joins using distinct counts (#20904)

buraksenn
and
asolimando
authored
chore(deps): bump astral-sh/setup-uv from 8.0.0 to 8.1.0 (#21759)
dependabot[bot]
authored
fix: Fix local `datafusion-cli` test failure (#21761)
2010YOUY01
authored
chore(deps): bump aws-config from 1.8.15 to 1.8.16 in the all-other-cargo-deps group (#21760)
dependabot[bot]
authored
chore(deps): bump github/codeql-action from 4.35.1 to 4.35.2 (#21758)
dependabot[bot]
authored
chore(deps): bump taiki-e/install-action from 2.75.10 to 2.75.18 (#21757)
dependabot[bot]
authored
feat: split Parquet files into row-group-sized morsels

adriangb
and
claude
committed
refactor: defer morsel decoder build to Morsel::into_stream

adriangb
and
claude
committed