Skip to content

[WIP] Slice and dice scans and arrow export differently - #9073

Draft
AdamGS wants to merge 2 commits into
developfrom
adamg/do-ideas
Draft

[WIP] Slice and dice scans and arrow export differently#9073
AdamGS wants to merge 2 commits into
developfrom
adamg/do-ideas

Conversation

@AdamGS

@AdamGS AdamGS commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Rationale for this change

  • Closes: #000

What changes are included in this PR?

What APIs are changed? Are there any user-facing changes?

@AdamGS
lets try this one
81d2f42 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the experimental Experimental change; requires broader validation label Jul 29, 2026
@AdamGS
fix
8401ad8 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 29, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 29, 2026
@github-actions

github-actions Bot commented Jul 29, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 8401ad8 statpopgen 1 Explore Profiling Data
🟢 Done 8401ad8 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 8401ad8 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 8401ad8 polarsignals 1 Explore Profiling Data
🟢 Done 8401ad8 tpch-nvme 1 Explore Profiling Data
🟢 Done 8401ad8 tpcds-nvme 1 Explore Profiling Data
🟢 Done 8401ad8 fineweb 1 Explore Profiling Data
🟢 Done 8401ad8 fineweb-s3 1 Explore Profiling Data
🟢 Done 8401ad8 tpch-s3 1 Explore Profiling Data
🟢 Done 8401ad8 clickbench-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (+1.2%, low confidence) · DuckDB No clear signal (-2.5%, low confidence)
Vortex (geomean): 1.025x ➖
Parquet (geomean): 1.031x ➖
Shifts: Parquet (control) +3.1% · Median polish +3.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.058x ➖, 0↑ 1↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5651807 5392094 1.05
fineweb_q01/datafusion:vortex-file-compressed 🚨 34887987 31387875 1.11
fineweb_q02/datafusion:vortex-file-compressed 39361347 37351674 1.05
fineweb_q03/datafusion:vortex-file-compressed 61641746 59804116 1.03
fineweb_q04/datafusion:vortex-file-compressed 261003202 255436320 1.02
fineweb_q05/datafusion:vortex-file-compressed 213874879 194733370 1.10
fineweb_q06/datafusion:vortex-file-compressed 52916037 52593280 1.01
fineweb_q07/datafusion:vortex-file-compressed 60539416 55110459 1.10
fineweb_q08/datafusion:vortex-file-compressed 22998069 21747166 1.06
datafusion / parquet (1.045x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7192239 6947275 1.04
fineweb_q01/datafusion:parquet 320523276 309685641 1.03
fineweb_q02/datafusion:parquet 327529773 311132263 1.05
fineweb_q03/datafusion:parquet 326259703 300124041 1.09
fineweb_q04/datafusion:parquet 337823162 325215220 1.04
fineweb_q05/datafusion:parquet 332316018 322820093 1.03
fineweb_q06/datafusion:parquet 317593608 303779711 1.05
fineweb_q07/datafusion:parquet 307592560 301769156 1.02
fineweb_q08/datafusion:parquet 312290185 292632118 1.07
duckdb / vortex-file-compressed (0.992x ➖, 1↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3393100 3867898 0.88
fineweb_q01/duckdb:vortex-file-compressed 33893292 35431511 0.96
fineweb_q02/duckdb:vortex-file-compressed 41186976 39196095 1.05
fineweb_q03/duckdb:vortex-file-compressed 112546339 102687066 1.10
fineweb_q04/duckdb:vortex-file-compressed 275436228 257859275 1.07
fineweb_q05/duckdb:vortex-file-compressed 205120981 194029524 1.06
fineweb_q06/duckdb:vortex-file-compressed 53695287 57988109 0.93
fineweb_q07/duckdb:vortex-file-compressed 56107495 56938496 0.99
fineweb_q08/duckdb:vortex-file-compressed 23275991 24816495 0.94
duckdb / parquet (1.018x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36660387 34752600 1.05
fineweb_q01/duckdb:parquet 95065977 95087649 1.00
fineweb_q02/duckdb:parquet 95074824 93555225 1.02
fineweb_q03/duckdb:parquet 336562538 328167501 1.03
fineweb_q04/duckdb:parquet 460689401 455067227 1.01
fineweb_q05/duckdb:parquet 433483960 427337232 1.01
fineweb_q06/duckdb:parquet 215755320 213893357 1.01
fineweb_q07/duckdb:parquet 228069170 224816842 1.01
fineweb_q08/duckdb:parquet 42339452 41769877 1.01
File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
sample.vortex 1.0 vortex-compact 1.23 GB 0 B 1.23 GB -100.0%

Totals:

  • vortex-compact: 1.23 GB → 0 B (-100.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 0.982x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.982x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 121010645 124120157 0.97
polarsignals_q01/datafusion:vortex-file-compressed 268199511 274731629 0.98
polarsignals_q02/datafusion:vortex-file-compressed 20801864 22485840 0.93
polarsignals_q03/datafusion:vortex-file-compressed 270728557 289243877 0.94
polarsignals_q04/datafusion:vortex-file-compressed 9328774 9350876 1.00
polarsignals_q05/datafusion:vortex-file-compressed 14591247 15043476 0.97
polarsignals_q06/datafusion:vortex-file-compressed 20677770 20138731 1.03
polarsignals_q07/datafusion:vortex-file-compressed 13601411 13704690 0.99
polarsignals_q08/datafusion:vortex-file-compressed 415882689 416930743 1.00
polarsignals_q09/datafusion:vortex-file-compressed 10006095 9746675 1.03

No file size changes detected.

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.7%
Engines: DataFusion No clear signal (+6.1%, environment too noisy confidence) · DuckDB No clear signal (+1.3%, low confidence)
Vortex (geomean): 1.083x ➖
Parquet (geomean): 1.045x ➖
Shifts: Parquet (control) +4.5% · Median polish +5.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.105x ❌, 0↑ 56↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 25733329 23050811 1.12
tpcds_q02/datafusion:vortex-file-compressed 🚨 48240223 42810028 1.13
tpcds_q03/datafusion:vortex-file-compressed 15342256 15225341 1.01
tpcds_q04/datafusion:vortex-file-compressed 🚨 259777842 232256334 1.12
tpcds_q05/datafusion:vortex-file-compressed 47424122 47630760 1.00
tpcds_q06/datafusion:vortex-file-compressed 24562216 23186265 1.06
tpcds_q07/datafusion:vortex-file-compressed 🚨 47224314 42433624 1.11
tpcds_q08/datafusion:vortex-file-compressed 32766423 30677609 1.07
tpcds_q09/datafusion:vortex-file-compressed 33882899 31553278 1.07
tpcds_q10/datafusion:vortex-file-compressed 41474902 38412585 1.08
tpcds_q11/datafusion:vortex-file-compressed 142290531 132048718 1.08
tpcds_q12/datafusion:vortex-file-compressed 19532186 17937007 1.09
tpcds_q13/datafusion:vortex-file-compressed 47464860 43944483 1.08
tpcds_q14/datafusion:vortex-file-compressed 177243108 163271291 1.09
tpcds_q15/datafusion:vortex-file-compressed 28326049 25784113 1.10
tpcds_q16/datafusion:vortex-file-compressed 25108410 23381967 1.07
tpcds_q17/datafusion:vortex-file-compressed 🚨 67239608 58606826 1.15
tpcds_q18/datafusion:vortex-file-compressed 🚨 67535487 58079641 1.16
tpcds_q19/datafusion:vortex-file-compressed 23746490 22242444 1.07
tpcds_q20/datafusion:vortex-file-compressed 🚨 21158823 19076384 1.11
tpcds_q21/datafusion:vortex-file-compressed 🚨 41665348 36926787 1.13
tpcds_q22/datafusion:vortex-file-compressed 🚨 141818479 126444787 1.12
tpcds_q23/datafusion:vortex-file-compressed 🚨 176701149 152217147 1.16
tpcds_q24/datafusion:vortex-file-compressed 89066342 81949552 1.09
tpcds_q25/datafusion:vortex-file-compressed 🚨 69462097 61801715 1.12
tpcds_q26/datafusion:vortex-file-compressed 🚨 33277175 29253880 1.14
tpcds_q27/datafusion:vortex-file-compressed 🚨 106079837 92596970 1.15
tpcds_q28/datafusion:vortex-file-compressed 33782995 32571494 1.04
tpcds_q29/datafusion:vortex-file-compressed 64246851 59201445 1.09
tpcds_q30/datafusion:vortex-file-compressed 🚨 27052139 24373012 1.11
tpcds_q31/datafusion:vortex-file-compressed 🚨 78744643 69465649 1.13
tpcds_q32/datafusion:vortex-file-compressed 19164555 17742326 1.08
tpcds_q33/datafusion:vortex-file-compressed 31063426 29620364 1.05
tpcds_q34/datafusion:vortex-file-compressed 26309684 25551719 1.03
tpcds_q35/datafusion:vortex-file-compressed 45940244 44237370 1.04
tpcds_q36/datafusion:vortex-file-compressed 57858837 59293266 0.98
tpcds_q37/datafusion:vortex-file-compressed 18663261 17875666 1.04
tpcds_q38/datafusion:vortex-file-compressed 39011957 40951428 0.95
tpcds_q39/datafusion:vortex-file-compressed 115921131 110324780 1.05
tpcds_q40/datafusion:vortex-file-compressed 32419506 29853823 1.09
tpcds_q41/datafusion:vortex-file-compressed 🚨 23304032 20131760 1.16
tpcds_q42/datafusion:vortex-file-compressed 🚨 14950907 13425115 1.11
tpcds_q43/datafusion:vortex-file-compressed 🚨 20257912 18348945 1.10
tpcds_q44/datafusion:vortex-file-compressed 33179152 30297578 1.10
tpcds_q45/datafusion:vortex-file-compressed 🚨 29321133 25156270 1.17
tpcds_q46/datafusion:vortex-file-compressed 38285834 35513686 1.08
tpcds_q47/datafusion:vortex-file-compressed 146842806 136677581 1.07
tpcds_q48/datafusion:vortex-file-compressed 39156182 35830079 1.09
tpcds_q49/datafusion:vortex-file-compressed 🚨 64963777 58393061 1.11
tpcds_q50/datafusion:vortex-file-compressed 41514041 38162227 1.09
tpcds_q51/datafusion:vortex-file-compressed 🚨 98570443 89023611 1.11
tpcds_q52/datafusion:vortex-file-compressed 🚨 15568334 13323358 1.17
tpcds_q53/datafusion:vortex-file-compressed 🚨 24399910 21378855 1.14
tpcds_q54/datafusion:vortex-file-compressed 36504175 33365871 1.09
tpcds_q55/datafusion:vortex-file-compressed 🚨 14483621 12895941 1.12
tpcds_q56/datafusion:vortex-file-compressed 🚨 33935070 30571257 1.11
tpcds_q57/datafusion:vortex-file-compressed 🚨 105401807 90992800 1.16
tpcds_q58/datafusion:vortex-file-compressed 🚨 58954065 52885324 1.11
tpcds_q59/datafusion:vortex-file-compressed 62678422 57712456 1.09
tpcds_q60/datafusion:vortex-file-compressed 🚨 33203222 29533564 1.12
tpcds_q61/datafusion:vortex-file-compressed 🚨 44394991 38763476 1.15
tpcds_q62/datafusion:vortex-file-compressed 🚨 23410564 20689834 1.13
tpcds_q63/datafusion:vortex-file-compressed 🚨 24164604 21676864 1.11
tpcds_q64/datafusion:vortex-file-compressed 🚨 439334055 394670242 1.11
tpcds_q65/datafusion:vortex-file-compressed 🚨 56025422 50841809 1.10
tpcds_q66/datafusion:vortex-file-compressed 🚨 80639060 70368126 1.15
tpcds_q67/datafusion:vortex-file-compressed 🚨 176742984 155653426 1.14
tpcds_q68/datafusion:vortex-file-compressed 🚨 37558952 32309230 1.16
tpcds_q69/datafusion:vortex-file-compressed 🚨 39424518 33682654 1.17
tpcds_q70/datafusion:vortex-file-compressed 🚨 106765039 95425466 1.12
tpcds_q71/datafusion:vortex-file-compressed 24972414 23000927 1.09
tpcds_q72/datafusion:vortex-file-compressed 🚨 2395693714 2097572833 1.14
tpcds_q73/datafusion:vortex-file-compressed 🚨 27407165 23478294 1.17
tpcds_q74/datafusion:vortex-file-compressed 84396942 78889330 1.07
tpcds_q75/datafusion:vortex-file-compressed 🚨 117996640 106330555 1.11
tpcds_q76/datafusion:vortex-file-compressed 31046043 28438914 1.09
tpcds_q77/datafusion:vortex-file-compressed 38816143 35698621 1.09
tpcds_q78/datafusion:vortex-file-compressed 🚨 120568743 107564350 1.12
tpcds_q79/datafusion:vortex-file-compressed 29949680 28749763 1.04
tpcds_q80/datafusion:vortex-file-compressed 94188957 88417603 1.07
tpcds_q81/datafusion:vortex-file-compressed 🚨 27984500 24670117 1.13
tpcds_q82/datafusion:vortex-file-compressed 🚨 22867123 19887918 1.15
tpcds_q83/datafusion:vortex-file-compressed 🚨 39875707 35241607 1.13
tpcds_q84/datafusion:vortex-file-compressed 🚨 14582793 12153079 1.20
tpcds_q85/datafusion:vortex-file-compressed 93340413 86819717 1.08
tpcds_q86/datafusion:vortex-file-compressed 🚨 17262544 14926224 1.16
tpcds_q87/datafusion:vortex-file-compressed 🚨 43891576 38261679 1.15
tpcds_q88/datafusion:vortex-file-compressed 58528491 53682617 1.09
tpcds_q89/datafusion:vortex-file-compressed 27312636 25017598 1.09
tpcds_q90/datafusion:vortex-file-compressed 🚨 14662425 12747355 1.15
tpcds_q91/datafusion:vortex-file-compressed 🚨 22913762 18352163 1.25
tpcds_q92/datafusion:vortex-file-compressed 🚨 18033973 15617284 1.15
tpcds_q93/datafusion:vortex-file-compressed 34204705 32153316 1.06
tpcds_q94/datafusion:vortex-file-compressed 🚨 22870038 19828640 1.15
tpcds_q95/datafusion:vortex-file-compressed 🚨 61227803 53750228 1.14
tpcds_q96/datafusion:vortex-file-compressed 13471846 12589195 1.07
tpcds_q97/datafusion:vortex-file-compressed 🚨 30635532 27784768 1.10
tpcds_q98/datafusion:vortex-file-compressed 🚨 26598642 23028752 1.16
tpcds_q99/datafusion:vortex-file-compressed 🚨 27499990 24540861 1.12
datafusion / parquet (1.042x ➖, 0↑ 10↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 24871898 25638617 0.97
tpcds_q02/datafusion:parquet 41477041 44664634 0.93
tpcds_q03/datafusion:parquet 14086976 14757560 0.95
tpcds_q04/datafusion:parquet 334683286 332618350 1.01
tpcds_q05/datafusion:parquet 49288509 50917309 0.97
tpcds_q06/datafusion:parquet 25636127 25815821 0.99
tpcds_q07/datafusion:parquet 87699603 82713806 1.06
tpcds_q08/datafusion:parquet 33773495 31528657 1.07
tpcds_q09/datafusion:parquet 45148140 41255514 1.09
tpcds_q10/datafusion:parquet 🚨 84238374 76296210 1.10
tpcds_q11/datafusion:parquet 🚨 178227736 161367879 1.10
tpcds_q12/datafusion:parquet 🚨 20524355 17473919 1.17
tpcds_q13/datafusion:parquet 84906990 80149250 1.06
tpcds_q14/datafusion:parquet 182379564 171088296 1.07
tpcds_q15/datafusion:parquet 23284347 22560318 1.03
tpcds_q16/datafusion:parquet 31756405 31824632 1.00
tpcds_q17/datafusion:parquet 66431568 64816893 1.02
tpcds_q18/datafusion:parquet 121297929 114971681 1.06
tpcds_q19/datafusion:parquet 25148432 25238827 1.00
tpcds_q20/datafusion:parquet 19903854 19424925 1.02
tpcds_q21/datafusion:parquet 22606596 20660857 1.09
tpcds_q22/datafusion:parquet 184318697 171206774 1.08
tpcds_q23/datafusion:parquet 169512222 172399476 0.98
tpcds_q24/datafusion:parquet 98567671 97196373 1.01
tpcds_q25/datafusion:parquet 71276535 70517290 1.01
tpcds_q26/datafusion:parquet 72044631 72169087 1.00
tpcds_q27/datafusion:parquet 151869929 157462286 0.96
tpcds_q28/datafusion:parquet 🚨 51557339 46423757 1.11
tpcds_q29/datafusion:parquet 70231088 69862887 1.01
tpcds_q30/datafusion:parquet 37605537 37813337 0.99
tpcds_q31/datafusion:parquet 73748727 70831680 1.04
tpcds_q32/datafusion:parquet 19597883 18075970 1.08
tpcds_q33/datafusion:parquet 31124050 29556932 1.05
tpcds_q34/datafusion:parquet 25300385 23771922 1.06
tpcds_q35/datafusion:parquet 83083467 83139156 1.00
tpcds_q36/datafusion:parquet 64601038 61076696 1.06
tpcds_q37/datafusion:parquet 21302804 21808285 0.98
tpcds_q38/datafusion:parquet 47478055 43822665 1.08
tpcds_q39/datafusion:parquet 🚨 105994546 86545569 1.22
tpcds_q40/datafusion:parquet 🚨 28979924 24262243 1.19
tpcds_q41/datafusion:parquet 17569616 17304537 1.02
tpcds_q42/datafusion:parquet 🚨 14563578 13057510 1.12
tpcds_q43/datafusion:parquet 19141939 18494227 1.04
tpcds_q44/datafusion:parquet 37232515 35886690 1.04
tpcds_q45/datafusion:parquet 33147733 30458528 1.09
tpcds_q46/datafusion:parquet 36183904 33969106 1.07
tpcds_q47/datafusion:parquet 144174530 141700679 1.02
tpcds_q48/datafusion:parquet 79276137 74229469 1.07
tpcds_q49/datafusion:parquet 64584475 60737629 1.06
tpcds_q50/datafusion:parquet 46127349 43419715 1.06
tpcds_q51/datafusion:parquet 100526244 93101537 1.08
tpcds_q52/datafusion:parquet 🚨 13842909 12414428 1.12
tpcds_q53/datafusion:parquet 20289981 18870363 1.08
tpcds_q54/datafusion:parquet 37149171 34706433 1.07
tpcds_q55/datafusion:parquet 12675396 12101760 1.05
tpcds_q56/datafusion:parquet 32215665 29644243 1.09
tpcds_q57/datafusion:parquet 110444743 103592019 1.07
tpcds_q58/datafusion:parquet 62949228 58395222 1.08
tpcds_q59/datafusion:parquet 67399610 64604053 1.04
tpcds_q60/datafusion:parquet 31123239 29108520 1.07
tpcds_q61/datafusion:parquet 46562550 46319474 1.01
tpcds_q62/datafusion:parquet 29109470 26870019 1.08
tpcds_q63/datafusion:parquet 🚨 22315126 18853965 1.18
tpcds_q64/datafusion:parquet 333898219 347160904 0.96
tpcds_q65/datafusion:parquet 38939855 40824349 0.95
tpcds_q66/datafusion:parquet 70910785 76282666 0.93
tpcds_q67/datafusion:parquet 160762580 168863947 0.95
tpcds_q68/datafusion:parquet 34189839 34921300 0.98
tpcds_q69/datafusion:parquet 73807064 72563447 1.02
tpcds_q70/datafusion:parquet 36462517 37129913 0.98
tpcds_q71/datafusion:parquet 25911084 24490446 1.06
tpcds_q72/datafusion:parquet 647949150 643437856 1.01
tpcds_q73/datafusion:parquet 23514066 23096286 1.02
tpcds_q74/datafusion:parquet 91353567 91101698 1.00
tpcds_q75/datafusion:parquet 🚨 124617763 112774332 1.11
tpcds_q76/datafusion:parquet 34338729 33307181 1.03
tpcds_q77/datafusion:parquet 43957916 42198956 1.04
tpcds_q78/datafusion:parquet 124558751 115862500 1.08
tpcds_q79/datafusion:parquet 30506282 30125494 1.01
tpcds_q80/datafusion:parquet 92212249 88054091 1.05
tpcds_q81/datafusion:parquet 33163470 32578542 1.02
tpcds_q82/datafusion:parquet 21656251 21504823 1.01
tpcds_q83/datafusion:parquet 47433051 45320427 1.05
tpcds_q84/datafusion:parquet 46635704 44745849 1.04
tpcds_q85/datafusion:parquet 159868905 153747945 1.04
tpcds_q86/datafusion:parquet 18829395 17780377 1.06
tpcds_q87/datafusion:parquet 51751012 47451071 1.09
tpcds_q88/datafusion:parquet 65214269 62988988 1.04
tpcds_q89/datafusion:parquet 25623615 24019682 1.07
tpcds_q90/datafusion:parquet 16875077 15823042 1.07
tpcds_q91/datafusion:parquet 66636536 62251518 1.07
tpcds_q92/datafusion:parquet 19714725 19723356 1.00
tpcds_q93/datafusion:parquet 35156068 34063663 1.03
tpcds_q94/datafusion:parquet 24365481 22342594 1.09
tpcds_q95/datafusion:parquet 65642414 61410183 1.07
tpcds_q96/datafusion:parquet 13789685 14193150 0.97
tpcds_q97/datafusion:parquet 35294137 32198305 1.10
tpcds_q98/datafusion:parquet 23386784 23281998 1.00
tpcds_q99/datafusion:parquet 28662619 28494229 1.01
duckdb / vortex-file-compressed (1.062x ➖, 1↑ 28↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24371102 24445663 1.00
tpcds_q02/duckdb:vortex-file-compressed 23858278 24763112 0.96
tpcds_q03/duckdb:vortex-file-compressed 20699923 21879857 0.95
tpcds_q04/duckdb:vortex-file-compressed 106053869 105905164 1.00
tpcds_q05/duckdb:vortex-file-compressed 38470783 36578777 1.05
tpcds_q06/duckdb:vortex-file-compressed 38904212 36878159 1.05
tpcds_q07/duckdb:vortex-file-compressed 31654780 32048343 0.99
tpcds_q08/duckdb:vortex-file-compressed 30554090 31792344 0.96
tpcds_q09/duckdb:vortex-file-compressed 18005534 16992262 1.06
tpcds_q10/duckdb:vortex-file-compressed 43786418 42881554 1.02
tpcds_q11/duckdb:vortex-file-compressed 75550541 77110265 0.98
tpcds_q12/duckdb:vortex-file-compressed 15676451 15630854 1.00
tpcds_q13/duckdb:vortex-file-compressed 37149131 35278793 1.05
tpcds_q14/duckdb:vortex-file-compressed 110183279 102850658 1.07
tpcds_q15/duckdb:vortex-file-compressed 30603175 29289186 1.04
tpcds_q16/duckdb:vortex-file-compressed 🚨 26159539 23148938 1.13
tpcds_q17/duckdb:vortex-file-compressed 🚨 55574693 48808038 1.14
tpcds_q18/duckdb:vortex-file-compressed 44723723 41841225 1.07
tpcds_q19/duckdb:vortex-file-compressed 37706593 38138567 0.99
tpcds_q20/duckdb:vortex-file-compressed 16561563 15543535 1.07
tpcds_q21/duckdb:vortex-file-compressed 17985511 17192528 1.05
tpcds_q22/duckdb:vortex-file-compressed 81625644 75912995 1.08
tpcds_q23/duckdb:vortex-file-compressed 92541290 90864868 1.02
tpcds_q24/duckdb:vortex-file-compressed 48167672 47541899 1.01
tpcds_q25/duckdb:vortex-file-compressed 39750972 38877634 1.02
tpcds_q26/duckdb:vortex-file-compressed 🚨 24450429 20012666 1.22
tpcds_q27/duckdb:vortex-file-compressed 32370657 29917280 1.08
tpcds_q28/duckdb:vortex-file-compressed 13275539 13066584 1.02
tpcds_q29/duckdb:vortex-file-compressed 49554736 50306625 0.99
tpcds_q30/duckdb:vortex-file-compressed 🚨 30540353 26562502 1.15
tpcds_q31/duckdb:vortex-file-compressed 34076792 32236189 1.06
tpcds_q32/duckdb:vortex-file-compressed 15080416 14832019 1.02
tpcds_q33/duckdb:vortex-file-compressed 28320910 27766545 1.02
tpcds_q34/duckdb:vortex-file-compressed 30093079 30099073 1.00
tpcds_q35/duckdb:vortex-file-compressed 71326830 70649054 1.01
tpcds_q36/duckdb:vortex-file-compressed 27106314 27548535 0.98
tpcds_q37/duckdb:vortex-file-compressed 21972340 20131575 1.09
tpcds_q38/duckdb:vortex-file-compressed 40094838 40832338 0.98
tpcds_q39/duckdb:vortex-file-compressed 🚨 34342631 28823393 1.19
tpcds_q40/duckdb:vortex-file-compressed 20395985 20188820 1.01
tpcds_q41/duckdb:vortex-file-compressed 13752292 12953290 1.06
tpcds_q42/duckdb:vortex-file-compressed 17666940 16836039 1.05
tpcds_q43/duckdb:vortex-file-compressed 19425099 18608810 1.04
tpcds_q44/duckdb:vortex-file-compressed 23553226 22279897 1.06
tpcds_q45/duckdb:vortex-file-compressed 34064316 32391565 1.05
tpcds_q46/duckdb:vortex-file-compressed 🚀 33274076 38819287 0.86
tpcds_q47/duckdb:vortex-file-compressed 57454198 55541766 1.03
tpcds_q48/duckdb:vortex-file-compressed 33270057 33999866 0.98
tpcds_q49/duckdb:vortex-file-compressed 36568364 38156318 0.96
tpcds_q50/duckdb:vortex-file-compressed 28489808 28759645 0.99
tpcds_q51/duckdb:vortex-file-compressed 105630480 105363467 1.00
tpcds_q52/duckdb:vortex-file-compressed 15694459 15732230 1.00
tpcds_q53/duckdb:vortex-file-compressed 24534776 24823199 0.99
tpcds_q54/duckdb:vortex-file-compressed 29070616 30237995 0.96
tpcds_q55/duckdb:vortex-file-compressed 15390833 15169171 1.01
tpcds_q56/duckdb:vortex-file-compressed 30228152 30202702 1.00
tpcds_q57/duckdb:vortex-file-compressed 🚨 42260274 36652831 1.15
tpcds_q58/duckdb:vortex-file-compressed 🚨 34396711 30370923 1.13
tpcds_q59/duckdb:vortex-file-compressed 🚨 41143615 36154611 1.14
tpcds_q60/duckdb:vortex-file-compressed 🚨 30381543 27207707 1.12
tpcds_q61/duckdb:vortex-file-compressed 34261001 32390309 1.06
tpcds_q62/duckdb:vortex-file-compressed 🚨 16824262 14895306 1.13
tpcds_q63/duckdb:vortex-file-compressed 22761354 21847440 1.04
tpcds_q64/duckdb:vortex-file-compressed 103474033 98266315 1.05
tpcds_q65/duckdb:vortex-file-compressed 23957796 23155125 1.03
tpcds_q66/duckdb:vortex-file-compressed 31992022 29233109 1.09
tpcds_q67/duckdb:vortex-file-compressed 155683421 142296424 1.09
tpcds_q68/duckdb:vortex-file-compressed 🚨 42358046 37721139 1.12
tpcds_q69/duckdb:vortex-file-compressed 47218892 44719106 1.06
tpcds_q70/duckdb:vortex-file-compressed 33868654 32960682 1.03
tpcds_q71/duckdb:vortex-file-compressed 24511827 23450793 1.05
tpcds_q72/duckdb:vortex-file-compressed 167712953 157239287 1.07
tpcds_q73/duckdb:vortex-file-compressed 🚨 33795066 28457472 1.19
tpcds_q74/duckdb:vortex-file-compressed 50616195 46450834 1.09
tpcds_q75/duckdb:vortex-file-compressed 🚨 55337640 48704446 1.14
tpcds_q76/duckdb:vortex-file-compressed 🚨 29362573 21949485 1.34
tpcds_q77/duckdb:vortex-file-compressed 26678522 24430637 1.09
tpcds_q78/duckdb:vortex-file-compressed 🚨 73082747 66257012 1.10
tpcds_q79/duckdb:vortex-file-compressed 🚨 31594821 27383035 1.15
tpcds_q80/duckdb:vortex-file-compressed 🚨 53317128 46702577 1.14
tpcds_q81/duckdb:vortex-file-compressed 🚨 33104449 29443561 1.12
tpcds_q82/duckdb:vortex-file-compressed 50622340 46227361 1.10
tpcds_q83/duckdb:vortex-file-compressed 🚨 31429451 27559496 1.14
tpcds_q84/duckdb:vortex-file-compressed 🚨 19055558 16386711 1.16
tpcds_q85/duckdb:vortex-file-compressed 🚨 49577373 43600621 1.14
tpcds_q86/duckdb:vortex-file-compressed 🚨 18626584 16585862 1.12
tpcds_q87/duckdb:vortex-file-compressed 46350491 42943328 1.08
tpcds_q88/duckdb:vortex-file-compressed 🚨 61390914 55756309 1.10
tpcds_q89/duckdb:vortex-file-compressed 🚨 26012558 23360844 1.11
tpcds_q90/duckdb:vortex-file-compressed 🚨 12884112 11284611 1.14
tpcds_q91/duckdb:vortex-file-compressed 🚨 25921045 21998162 1.18
tpcds_q92/duckdb:vortex-file-compressed 19768468 18473989 1.07
tpcds_q93/duckdb:vortex-file-compressed 🚨 31110135 28195746 1.10
tpcds_q94/duckdb:vortex-file-compressed 🚨 26858625 21412347 1.25
tpcds_q95/duckdb:vortex-file-compressed 129727151 122591409 1.06
tpcds_q96/duckdb:vortex-file-compressed 14518969 13316546 1.09
tpcds_q97/duckdb:vortex-file-compressed 40326901 38403941 1.05
tpcds_q98/duckdb:vortex-file-compressed 20766371 19570909 1.06
tpcds_q99/duckdb:vortex-file-compressed 19624916 18528879 1.06
duckdb / parquet (1.049x ➖, 0↑ 11↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 31882067 29596718 1.08
tpcds_q02/duckdb:parquet 25284716 24644626 1.03
tpcds_q03/duckdb:parquet 13599369 13654460 1.00
tpcds_q04/duckdb:parquet 179656605 174295062 1.03
tpcds_q05/duckdb:parquet 35240264 33248881 1.06
tpcds_q06/duckdb:parquet 37075781 35142903 1.06
tpcds_q07/duckdb:parquet 26268439 24595679 1.07
tpcds_q08/duckdb:parquet 31860107 30167160 1.06
tpcds_q09/duckdb:parquet 46976397 45178048 1.04
tpcds_q10/duckdb:parquet 40935300 39497470 1.04
tpcds_q11/duckdb:parquet 93780365 95818726 0.98
tpcds_q12/duckdb:parquet 17411567 16673737 1.04
tpcds_q13/duckdb:parquet 37363967 35616723 1.05
tpcds_q14/duckdb:parquet 112058190 103467229 1.08
tpcds_q15/duckdb:parquet 34530956 31920309 1.08
tpcds_q16/duckdb:parquet 24462745 23532238 1.04
tpcds_q17/duckdb:parquet 42184596 39391297 1.07
tpcds_q18/duckdb:parquet 52219863 49085527 1.06
tpcds_q19/duckdb:parquet 33926199 33158574 1.02
tpcds_q20/duckdb:parquet 17922309 17462855 1.03
tpcds_q21/duckdb:parquet 12830676 12597665 1.02
tpcds_q22/duckdb:parquet 79176778 72975714 1.08
tpcds_q23/duckdb:parquet 86132009 81474702 1.06
tpcds_q24/duckdb:parquet 50798104 48330389 1.05
tpcds_q25/duckdb:parquet 39283895 36066326 1.09
tpcds_q26/duckdb:parquet 43097513 40355321 1.07
tpcds_q27/duckdb:parquet 57964022 53494657 1.08
tpcds_q28/duckdb:parquet 45421259 43602588 1.04
tpcds_q29/duckdb:parquet 40005017 38040900 1.05
tpcds_q30/duckdb:parquet 39781664 37948096 1.05
tpcds_q31/duckdb:parquet 30301150 28927802 1.05
tpcds_q32/duckdb:parquet 🚨 14325818 12784192 1.12
tpcds_q33/duckdb:parquet 🚨 26675162 23875482 1.12
tpcds_q34/duckdb:parquet 24860806 23601797 1.05
tpcds_q35/duckdb:parquet 66799680 62146596 1.07
tpcds_q36/duckdb:parquet 23962457 22567486 1.06
tpcds_q37/duckdb:parquet 🚨 16247145 14406865 1.13
tpcds_q38/duckdb:parquet 🚨 42198095 37038705 1.14
tpcds_q39/duckdb:parquet 35407124 32471378 1.09
tpcds_q40/duckdb:parquet 🚨 21664955 19560264 1.11
tpcds_q41/duckdb:parquet 🚨 9721509 8826855 1.10
tpcds_q42/duckdb:parquet 13331533 12713952 1.05
tpcds_q43/duckdb:parquet 18693910 18569774 1.01
tpcds_q44/duckdb:parquet 27320287 26104547 1.05
tpcds_q45/duckdb:parquet 🚨 31664542 28485101 1.11
tpcds_q46/duckdb:parquet 51622277 47299146 1.09
tpcds_q47/duckdb:parquet 53578032 50479034 1.06
tpcds_q48/duckdb:parquet 33659566 32942200 1.02
tpcds_q49/duckdb:parquet 30150888 28598221 1.05
tpcds_q50/duckdb:parquet 27510722 26567241 1.04
tpcds_q51/duckdb:parquet 110800699 103021678 1.08
tpcds_q52/duckdb:parquet 14631984 13613929 1.07
tpcds_q53/duckdb:parquet 🚨 18876521 16800782 1.12
tpcds_q54/duckdb:parquet 🚨 31695593 28748476 1.10
tpcds_q55/duckdb:parquet 14667342 13503164 1.09
tpcds_q56/duckdb:parquet 25369715 24514479 1.03
tpcds_q57/duckdb:parquet 41419496 39010078 1.06
tpcds_q58/duckdb:parquet 28533836 27224362 1.05
tpcds_q59/duckdb:parquet 37822232 36825770 1.03
tpcds_q60/duckdb:parquet 27610418 25760065 1.07
tpcds_q61/duckdb:parquet 35711800 34871924 1.02
tpcds_q62/duckdb:parquet 14017869 12979071 1.08
tpcds_q63/duckdb:parquet 16604266 16366464 1.01
tpcds_q64/duckdb:parquet 🚨 86064309 75902583 1.13
tpcds_q65/duckdb:parquet 24795331 23081215 1.07
tpcds_q66/duckdb:parquet 31519742 33690386 0.94
tpcds_q67/duckdb:parquet 150417553 141139805 1.07
tpcds_q68/duckdb:parquet 41373594 39113657 1.06
tpcds_q69/duckdb:parquet 41927381 39780052 1.05
tpcds_q70/duckdb:parquet 24677732 22624174 1.09
tpcds_q71/duckdb:parquet 25286331 24313401 1.04
tpcds_q72/duckdb:parquet 174468679 166315472 1.05
tpcds_q73/duckdb:parquet 21516989 21124152 1.02
tpcds_q74/duckdb:parquet 134695110 132273681 1.02
tpcds_q75/duckdb:parquet 62621585 57761137 1.08
tpcds_q76/duckdb:parquet 23538338 22087099 1.07
tpcds_q77/duckdb:parquet 27371068 26669590 1.03
tpcds_q78/duckdb:parquet 81283023 85436229 0.95
tpcds_q79/duckdb:parquet 31456408 32237489 0.98
tpcds_q80/duckdb:parquet 45380255 49207239 0.92
tpcds_q81/duckdb:parquet 37073406 38693345 0.96
tpcds_q82/duckdb:parquet 17735882 18503413 0.96
tpcds_q83/duckdb:parquet 20079143 19762508 1.02
tpcds_q84/duckdb:parquet 23144637 21570209 1.07
tpcds_q85/duckdb:parquet 46274353 44503656 1.04
tpcds_q86/duckdb:parquet 14649029 14915515 0.98
tpcds_q87/duckdb:parquet 41902692 42661164 0.98
tpcds_q88/duckdb:parquet 55085781 53715296 1.03
tpcds_q89/duckdb:parquet 19688115 19162609 1.03
tpcds_q90/duckdb:parquet 9355863 8665356 1.08
tpcds_q91/duckdb:parquet 27276189 25641831 1.06
tpcds_q92/duckdb:parquet 14564872 14049004 1.04
tpcds_q93/duckdb:parquet 35421429 33627857 1.05
tpcds_q94/duckdb:parquet 20651624 19189542 1.08
tpcds_q95/duckdb:parquet 🚨 152859740 137358235 1.11
tpcds_q96/duckdb:parquet 11588009 11631680 1.00
tpcds_q97/duckdb:parquet 43609987 40843251 1.07
tpcds_q98/duckdb:parquet 23618131 22716366 1.04
tpcds_q99/duckdb:parquet 21517224 23852100 0.90
File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 47.64 KB 0 B 47.64 KB -100.0%
catalog_page.vortex 1.0 vortex-compact 362.64 KB 0 B 362.64 KB -100.0%
catalog_returns.vortex 1.0 vortex-compact 6.04 MB 0 B 6.04 MB -100.0%
catalog_sales.vortex 1.0 vortex-compact 59.49 MB 0 B 59.49 MB -100.0%
customer.vortex 1.0 vortex-compact 3.29 MB 0 B 3.29 MB -100.0%
customer_address.vortex 1.0 vortex-compact 639.04 KB 0 B 639.04 KB -100.0%
customer_demographics.vortex 1.0 vortex-compact 424.38 KB 0 B 424.38 KB -100.0%
date_dim.vortex 1.0 vortex-compact 140.48 KB 0 B 140.48 KB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
household_demographics.vortex 1.0 vortex-compact 10.49 KB 0 B 10.49 KB -100.0%
income_band.vortex 1.0 vortex-compact 5.77 KB 0 B 5.77 KB -100.0%
inventory.vortex 1.0 vortex-compact 16.07 MB 0 B 16.07 MB -100.0%
item.vortex 1.0 vortex-compact 1000.52 KB 0 B 1000.52 KB -100.0%
promotion.vortex 1.0 vortex-compact 50.52 KB 0 B 50.52 KB -100.0%
reason.vortex 1.0 vortex-compact 6.17 KB 0 B 6.17 KB -100.0%
ship_mode.vortex 1.0 vortex-compact 10.93 KB 0 B 10.93 KB -100.0%
store.vortex 1.0 vortex-compact 43.42 KB 0 B 43.42 KB -100.0%
store_returns.vortex 1.0 vortex-compact 9.36 MB 0 B 9.36 MB -100.0%
store_sales.vortex 1.0 vortex-compact 78.12 MB 0 B 78.12 MB -100.0%
time_dim.vortex 1.0 vortex-compact 96.80 KB 0 B 96.80 KB -100.0%
warehouse.vortex 1.0 vortex-compact 22.35 KB 0 B 22.35 KB -100.0%
web_page.vortex 1.0 vortex-compact 25.21 KB 0 B 25.21 KB -100.0%
web_returns.vortex 1.0 vortex-compact 3.00 MB 0 B 3.00 MB -100.0%
web_sales.vortex 1.0 vortex-compact 29.45 MB 0 B 29.45 MB -100.0%
web_site.vortex 1.0 vortex-compact 42.39 KB 0 B 42.39 KB -100.0%

Totals:

  • vortex-compact: 207.94 MB → 0 B (-100.0%)
  • vortex-file-compressed: 269.98 MB → 269.98 MB (0.0%)

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Clickbench Sorted on NVME (pr) failed! Check the workflow run for details.

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): 1.000x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51938544 52579065 0.99
tpch_q02/datafusion:vortex-file-compressed 21736376 22069019 0.98
tpch_q03/datafusion:vortex-file-compressed 31022217 31209147 0.99
tpch_q04/datafusion:vortex-file-compressed 19605941 19635164 1.00
tpch_q05/datafusion:vortex-file-compressed 46204634 45292779 1.02
tpch_q06/datafusion:vortex-file-compressed 10173455 10471981 0.97
tpch_q07/datafusion:vortex-file-compressed 52140530 51813680 1.01
tpch_q08/datafusion:vortex-file-compressed 38614006 38887041 0.99
tpch_q09/datafusion:vortex-file-compressed 50095783 48999549 1.02
tpch_q10/datafusion:vortex-file-compressed 32906874 32144186 1.02
tpch_q11/datafusion:vortex-file-compressed 15979932 15557809 1.03
tpch_q12/datafusion:vortex-file-compressed 23189579 23925708 0.97
tpch_q13/datafusion:vortex-file-compressed 24757518 24288887 1.02
tpch_q14/datafusion:vortex-file-compressed 14988988 14691368 1.02
tpch_q15/datafusion:vortex-file-compressed 23008070 22855733 1.01
tpch_q16/datafusion:vortex-file-compressed 19044459 18715419 1.02
tpch_q17/datafusion:vortex-file-compressed 63286359 62769146 1.01
tpch_q18/datafusion:vortex-file-compressed 73945793 73425327 1.01
tpch_q19/datafusion:vortex-file-compressed 19024109 19235982 0.99
tpch_q20/datafusion:vortex-file-compressed 29087360 29283334 0.99
tpch_q21/datafusion:vortex-file-compressed 68430628 67621536 1.01
tpch_q22/datafusion:vortex-file-compressed 11750481 11547150 1.02
datafusion / parquet (1.011x ➖, 0↑ 1↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 136923140 128106524 1.07
tpch_q02/datafusion:parquet 60080017 59059558 1.02
tpch_q03/datafusion:parquet 77202530 81160710 0.95
tpch_q04/datafusion:parquet 48330394 47451022 1.02
tpch_q05/datafusion:parquet 96966882 91159621 1.06
tpch_q06/datafusion:parquet 41377583 40313808 1.03
tpch_q07/datafusion:parquet 102167212 97978909 1.04
tpch_q08/datafusion:parquet 88715281 92371027 0.96
tpch_q09/datafusion:parquet 123827171 127888793 0.97
tpch_q10/datafusion:parquet 115419141 116095300 0.99
tpch_q11/datafusion:parquet 41065592 41421069 0.99
tpch_q12/datafusion:parquet 82557304 87392863 0.94
tpch_q13/datafusion:parquet 198454812 194932953 1.02
tpch_q14/datafusion:parquet 🚨 46713946 40913013 1.14
tpch_q15/datafusion:parquet 60325240 59251486 1.02
tpch_q16/datafusion:parquet 42444654 42291964 1.00
tpch_q17/datafusion:parquet 145930576 142714961 1.02
tpch_q18/datafusion:parquet 153105811 155976011 0.98
tpch_q19/datafusion:parquet 81913871 77891543 1.05
tpch_q20/datafusion:parquet 74601440 74807545 1.00
tpch_q21/datafusion:parquet 142323204 144059420 0.99
tpch_q22/datafusion:parquet 45186005 45107562 1.00
duckdb / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 27436510 28602512 0.96
tpch_q02/duckdb:vortex-file-compressed 24753707 24317924 1.02
tpch_q03/duckdb:vortex-file-compressed 32447626 31914832 1.02
tpch_q04/duckdb:vortex-file-compressed 27938962 27602770 1.01
tpch_q05/duckdb:vortex-file-compressed 34700945 35076636 0.99
tpch_q06/duckdb:vortex-file-compressed 8921948 8966883 0.99
tpch_q07/duckdb:vortex-file-compressed 32924087 33089046 1.00
tpch_q08/duckdb:vortex-file-compressed 38841181 39198880 0.99
tpch_q09/duckdb:vortex-file-compressed 52096607 54016995 0.96
tpch_q10/duckdb:vortex-file-compressed 40960862 41765260 0.98
tpch_q11/duckdb:vortex-file-compressed 13381952 13479592 0.99
tpch_q12/duckdb:vortex-file-compressed 22677907 22312125 1.02
tpch_q13/duckdb:vortex-file-compressed 39727000 39346041 1.01
tpch_q14/duckdb:vortex-file-compressed 19315495 19543777 0.99
tpch_q15/duckdb:vortex-file-compressed 16416746 16430457 1.00
tpch_q16/duckdb:vortex-file-compressed 27108634 26959124 1.01
tpch_q17/duckdb:vortex-file-compressed 23457052 23337613 1.01
tpch_q18/duckdb:vortex-file-compressed 49875953 50733506 0.98
tpch_q19/duckdb:vortex-file-compressed 28265469 28014683 1.01
tpch_q20/duckdb:vortex-file-compressed 31325853 31072920 1.01
tpch_q21/duckdb:vortex-file-compressed 100555946 101359735 0.99
tpch_q22/duckdb:vortex-file-compressed 16062618 16112182 1.00
duckdb / parquet (0.993x ➖, 1↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 70152995 70006224 1.00
tpch_q02/duckdb:parquet 39702221 39801775 1.00
tpch_q03/duckdb:parquet 70876329 70977635 1.00
tpch_q04/duckdb:parquet 49797443 49767307 1.00
tpch_q05/duckdb:parquet 68692878 68439408 1.00
tpch_q06/duckdb:parquet 21909267 21543927 1.02
tpch_q07/duckdb:parquet 69543450 69259545 1.00
tpch_q08/duckdb:parquet 82951769 82898863 1.00
tpch_q09/duckdb:parquet 🚀 135716609 160963678 0.84
tpch_q10/duckdb:parquet 125030436 125407266 1.00
tpch_q11/duckdb:parquet 22653032 22722557 1.00
tpch_q12/duckdb:parquet 45857777 46001074 1.00
tpch_q13/duckdb:parquet 251322280 251546410 1.00
tpch_q14/duckdb:parquet 49838808 49424866 1.01
tpch_q15/duckdb:parquet 26923557 26701177 1.01
tpch_q16/duckdb:parquet 58207707 58158593 1.00
tpch_q17/duckdb:parquet 50073617 50519874 0.99
tpch_q18/duckdb:parquet 116505931 116091955 1.00
tpch_q19/duckdb:parquet 68702339 69051406 0.99
tpch_q20/duckdb:parquet 66164600 66322631 1.00
tpch_q21/duckdb:parquet 162782401 162227299 1.00
tpch_q22/duckdb:parquet 54890169 55570475 0.99
File Size Changes (9 files changed, -43.9% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 1.0 vortex-compact 7.40 MB 0 B 7.40 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 1.0 vortex-compact 126.00 MB 0 B 126.00 MB -100.0%
nation.vortex 1.0 vortex-compact 8.01 KB 0 B 8.01 KB -100.0%
orders.vortex 1.0 vortex-compact 31.73 MB 0 B 31.73 MB -100.0%
part.vortex 1.0 vortex-compact 3.55 MB 0 B 3.55 MB -100.0%
partsupp.vortex 1.0 vortex-compact 20.29 MB 0 B 20.29 MB -100.0%
region.vortex 1.0 vortex-compact 6.04 KB 0 B 6.04 KB -100.0%
supplier.vortex 1.0 vortex-compact 496.67 KB 0 B 496.67 KB -100.0%

Totals:

  • vortex-compact: 189.73 MB → 0 B (-100.0%)
  • vortex-file-compressed: 242.85 MB → 242.85 MB (0.0%)

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +20.0%
Engines: DataFusion No clear signal (+44.7%, environment too noisy confidence) · DuckDB No clear signal (-0.6%, environment too noisy confidence)
Vortex (geomean): 1.215x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish +7.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.427x ❌, 0↑ 6↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 30520559 37998177 0.80
fineweb_q01/datafusion:vortex-file-compressed 593038454 605489585 0.98
fineweb_q02/datafusion:vortex-file-compressed 467821534 502261657 0.93
fineweb_q03/datafusion:vortex-file-compressed 🚨 3423394483 1615127183 2.12
fineweb_q04/datafusion:vortex-file-compressed 🚨 2060721796 1162495826 1.77
fineweb_q05/datafusion:vortex-file-compressed 🚨 1762530495 1134162042 1.55
fineweb_q06/datafusion:vortex-file-compressed 🚨 2503551927 1293851806 1.93
fineweb_q07/datafusion:vortex-file-compressed 🚨 1970401342 1074941380 1.83
fineweb_q08/datafusion:vortex-file-compressed 🚨 771135107 477404468 1.62
datafusion / parquet (0.986x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1089453668 1409840876 0.77
fineweb_q01/datafusion:parquet 1987851853 1783798506 1.11
fineweb_q02/datafusion:parquet 1868600651 1986633716 0.94
fineweb_q03/datafusion:parquet 2077432159 1784502521 1.16
fineweb_q04/datafusion:parquet 1953321967 1834150597 1.06
fineweb_q05/datafusion:parquet 1905496853 2676216164 0.71
fineweb_q06/datafusion:parquet 2077030016 1837599107 1.13
fineweb_q07/datafusion:parquet 1808517244 1796205828 1.01
fineweb_q08/datafusion:parquet 1873765835 1735077112 1.08
duckdb / vortex-file-compressed (1.035x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 75251152 86232455 0.87
fineweb_q01/duckdb:vortex-file-compressed 543879124 582829588 0.93
fineweb_q02/duckdb:vortex-file-compressed 580222759 489504640 1.19
fineweb_q03/duckdb:vortex-file-compressed 1225653591 1247270738 0.98
fineweb_q04/duckdb:vortex-file-compressed 1404702803 1288549240 1.09
fineweb_q05/duckdb:vortex-file-compressed 1247479876 1231047844 1.01
fineweb_q06/duckdb:vortex-file-compressed 1478490654 1395413728 1.06
fineweb_q07/duckdb:vortex-file-compressed 1449568198 1270865587 1.14
fineweb_q08/duckdb:vortex-file-compressed 663086951 615069678 1.08
duckdb / parquet (1.041x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1095313596 1074595517 1.02
fineweb_q01/duckdb:parquet 1458538080 1333043424 1.09
fineweb_q02/duckdb:parquet 1457122426 1352513084 1.08
fineweb_q03/duckdb:parquet 3693289852 3756153367 0.98
fineweb_q04/duckdb:parquet 1942848456 1928963184 1.01
fineweb_q05/duckdb:parquet 2229969673 2119440265 1.05
fineweb_q06/duckdb:parquet 4270280891 4436057791 0.96
fineweb_q07/duckdb:parquet 2868981856 2589876842 1.11
fineweb_q08/duckdb:parquet 1134204629 1051942619 1.08

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+1.5%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): 0.992x ➖
Parquet (geomean): 0.983x ➖
Shifts: Parquet (control) -1.7% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.982x ➖, 1↑ 0↓)
name PR 8401ad8 (ns) base f3d6795 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1659952 1734560 0.96
clickbench_q01/datafusion:vortex-file-compressed 18799707 17674291 1.06
clickbench_q02/datafusion:vortex-file-compressed 33622129 34509006 0.97
clickbench_q03/datafusion:vortex-file-compressed 38065269 38684031 0.98
clickbench_q04/datafusion:vortex-file-compressed 237929164 249567023 0.95
clickbench_q05/datafusion:vortex-file-compressed 307091698 326906710 0.94
clickbench_q06/datafusion:vortex-file-compressed 1615731 1746219 0.93
clickbench_q07/datafusion:vortex-file-compressed 23975398 22533976 1.06
clickbench_q08/datafusion:vortex-file-compressed 334920985 349676605 0.96
clickbench_q09/datafusion:vortex-file-compressed 451441970 460561036 0.98
clickbench_q10/datafusion:vortex-file-compressed 71852828 74163234 0.97
clickbench_q11/datafusion:vortex-file-compressed 84573394 86508126 0.98
clickbench_q12/datafusion:vortex-file-compressed 266387203 263498105 1.01
clickbench_q13/datafusion:vortex-file-compressed 414419587 437097346 0.95
clickbench_q14/datafusion:vortex-file-compressed 249619577 271858126 0.92
clickbench_q15/datafusion:vortex-file-compressed 275035807 294491894 0.93
clickbench_q16/datafusion:vortex-file-compressed 655983784 688276245 0.95
clickbench_q17/datafusion:vortex-file-compressed 651082554 676050488 0.96
clickbench_q18/datafusion:vortex-file-compressed 1355301386 1433117391 0.95
clickbench_q19/datafusion:vortex-file-compressed 28243197 25900257 1.09
clickbench_q20/datafusion:vortex-file-compressed 256529417 260505552 0.98
clickbench_q21/datafusion:vortex-file-compressed 353416815 350491595 1.01
clickbench_q22/datafusion:vortex-file-compressed 445245073 447563929 0.99
clickbench_q23/datafusion:vortex-file-compressed 🚀 491162407 563413048 0.87
clickbench_q24/datafusion:vortex-file-compressed 43525439 46174928 0.94
clickbench_q25/datafusion:vortex-file-compressed 74377544 72791930 1.02
clickbench_q26/datafusion:vortex-file-compressed 44309072 41339300 1.07
clickbench_q27/datafusion:vortex-file-compressed 374421571 381053600 0.98
clickbench_q28/datafusion:vortex-file-compressed 2328217255 2355255337 0.99
clickbench_q29/datafusion:vortex-file-compressed 53947544 49423269 1.09
clickbench_q30/datafusion:vortex-file-compressed 225902744 235727218 0.96
clickbench_q31/datafusion:vortex-file-compressed 245300224 246265766 1.00
clickbench_q32/datafusion:vortex-file-compressed 1051864405 1071069176 0.98
clickbench_q33/datafusion:vortex-file-compressed 1418269773 1395176403 1.02
clickbench_q34/datafusion:vortex-file-compressed 1382256691 1416213459 0.98
clickbench_q35/datafusion:vortex-file-compressed 242580422 243131738 1.00
clickbench_q36/datafusion:vortex-file-compressed 58056316 60050741 0.97
clickbench_q37/datafusion:vortex-file-compressed 25261783 25711394 0.98
clickbench_q38/datafusion:vortex-file-compressed 15966421 16192396 0.99
clickbench_q39/datafusion:vortex-file-compressed 127217903 128253179 0.99
clickbench_q40/datafusion:vortex-file-compressed 12802118 11845296 1.08
clickbench_q41/datafusion:vortex-file-compressed 11900538 12829864 0.93
clickbench_q42/datafusion:vortex-file-compressed 11311590 11914122 0.95
datafusion / parquet (0.968x ➖, 1↑ 1↓)
name PR 8401ad8 (ns) base f3d6795 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 1775997 1557716 1.14
clickbench_q01/datafusion:parquet 19145041 19825174 0.97
clickbench_q02/datafusion:parquet 43187399 44249677 0.98
clickbench_q03/datafusion:parquet 34088352 35174137 0.97
clickbench_q04/datafusion:parquet 270587986 291088438 0.93
clickbench_q05/datafusion:parquet 312609244 337226836 0.93
clickbench_q06/datafusion:parquet 1599028 1554232 1.03
clickbench_q07/datafusion:parquet 21595832 20771769 1.04
clickbench_q08/datafusion:parquet 341129636 339705140 1.00
clickbench_q09/datafusion:parquet 463903152 470982677 0.98
clickbench_q10/datafusion:parquet 90747499 89598845 1.01
clickbench_q11/datafusion:parquet 112535045 118046529 0.95
clickbench_q12/datafusion:parquet 306981047 304707319 1.01
clickbench_q13/datafusion:parquet 467311512 482497862 0.97
clickbench_q14/datafusion:parquet 310527574 312060161 1.00
clickbench_q15/datafusion:parquet 276620129 284651797 0.97
clickbench_q16/datafusion:parquet 656498046 664904723 0.99
clickbench_q17/datafusion:parquet 651879145 647556272 1.01
clickbench_q18/datafusion:parquet 1375005715 1449923714 0.95
clickbench_q19/datafusion:parquet 26477601 28836207 0.92
clickbench_q20/datafusion:parquet 572606443 568148859 1.01
clickbench_q21/datafusion:parquet 623422860 629780081 0.99
clickbench_q22/datafusion:parquet 906947843 912825568 0.99
clickbench_q23/datafusion:parquet 3995048283 4129821952 0.97
clickbench_q24/datafusion:parquet 53950259 54398130 0.99
clickbench_q25/datafusion:parquet 123882774 132506196 0.93
clickbench_q26/datafusion:parquet 54320525 55798275 0.97
clickbench_q27/datafusion:parquet 643528339 682924706 0.94
clickbench_q28/datafusion:parquet 2450003481 2503809181 0.98
clickbench_q29/datafusion:parquet 🚀 45859598 54599831 0.84
clickbench_q30/datafusion:parquet 312953417 330996568 0.95
clickbench_q31/datafusion:parquet 341764148 358590950 0.95
clickbench_q32/datafusion:parquet 1051622797 1119832366 0.94
clickbench_q33/datafusion:parquet 1496296551 1518703432 0.99
clickbench_q34/datafusion:parquet 1499905492 1535920519 0.98
clickbench_q35/datafusion:parquet 248965256 259928759 0.96
clickbench_q36/datafusion:parquet 104711253 114423623 0.92
clickbench_q37/datafusion:parquet 41098293 44770663 0.92
clickbench_q38/datafusion:parquet 61221319 65198957 0.94
clickbench_q39/datafusion:parquet 205748932 215005839 0.96
clickbench_q40/datafusion:parquet 23074285 23548777 0.98
clickbench_q41/datafusion:parquet 20997600 23008888 0.91
clickbench_q42/datafusion:parquet 21502027 23280117 0.92
duckdb / vortex-file-compressed (1.002x ➖, 1↑ 1↓)
name PR 8401ad8 (ns) base f3d6795 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 9813877 9603774 1.02
clickbench_q01/duckdb:vortex-file-compressed 15155466 15383445 0.99
clickbench_q02/duckdb:vortex-file-compressed 20921220 20377284 1.03
clickbench_q03/duckdb:vortex-file-compressed 27820879 28096332 0.99
clickbench_q04/duckdb:vortex-file-compressed 198128247 197324556 1.00
clickbench_q05/duckdb:vortex-file-compressed 186379449 182623456 1.02
clickbench_q06/duckdb:vortex-file-compressed 18923993 19986798 0.95
clickbench_q07/duckdb:vortex-file-compressed 19648275 20124150 0.98
clickbench_q08/duckdb:vortex-file-compressed 269704491 267369942 1.01
clickbench_q09/duckdb:vortex-file-compressed 346389713 346504079 1.00
clickbench_q10/duckdb:vortex-file-compressed 72927569 72996422 1.00
clickbench_q11/duckdb:vortex-file-compressed 83728152 83982641 1.00
clickbench_q12/duckdb:vortex-file-compressed 205393551 207391894 0.99
clickbench_q13/duckdb:vortex-file-compressed 424525716 408041449 1.04
clickbench_q14/duckdb:vortex-file-compressed 238400140 237037742 1.01
clickbench_q15/duckdb:vortex-file-compressed 261070969 251788240 1.04
clickbench_q16/duckdb:vortex-file-compressed 545662653 532850328 1.02
clickbench_q17/duckdb:vortex-file-compressed 435041057 429149827 1.01
clickbench_q18/duckdb:vortex-file-compressed 945453700 943964696 1.00
clickbench_q19/duckdb:vortex-file-compressed 21746693 20905071 1.04
clickbench_q20/duckdb:vortex-file-compressed 254978103 253839979 1.00
clickbench_q21/duckdb:vortex-file-compressed 334024015 330123137 1.01
clickbench_q22/duckdb:vortex-file-compressed 505292180 494094846 1.02
clickbench_q23/duckdb:vortex-file-compressed 🚀 145645490 166810616 0.87
clickbench_q24/duckdb:vortex-file-compressed 37986674 36791408 1.03
clickbench_q25/duckdb:vortex-file-compressed 83751141 78505918 1.07
clickbench_q26/duckdb:vortex-file-compressed 🚨 47266268 42274407 1.12
clickbench_q27/duckdb:vortex-file-compressed 225383019 211310714 1.07
clickbench_q28/duckdb:vortex-file-compressed 3022662590 3029198580 1.00
clickbench_q29/duckdb:vortex-file-compressed 25538511 26334898 0.97
clickbench_q30/duckdb:vortex-file-compressed 201817955 202759765 1.00
clickbench_q31/duckdb:vortex-file-compressed 300932194 292302745 1.03
clickbench_q32/duckdb:vortex-file-compressed 1128152397 1112208067 1.01
clickbench_q33/duckdb:vortex-file-compressed 1101852820 1073785993 1.03
clickbench_q34/duckdb:vortex-file-compressed 1189513246 1180232603 1.01
clickbench_q35/duckdb:vortex-file-compressed 373139994 372219378 1.00
clickbench_q36/duckdb:vortex-file-compressed 32284813 32307539 1.00
clickbench_q37/duckdb:vortex-file-compressed 21701172 23137185 0.94
clickbench_q38/duckdb:vortex-file-compressed 24378071 26177861 0.93
clickbench_q39/duckdb:vortex-file-compressed 46856870 47243822 0.99
clickbench_q40/duckdb:vortex-file-compressed 21480930 22868886 0.94
clickbench_q41/duckdb:vortex-file-compressed 20799405 21911036 0.95
clickbench_q42/duckdb:vortex-file-compressed 22045332 22239134 0.99
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base f3d6795 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 22751654 24157881 0.94
clickbench_q01/duckdb:parquet 31097123 30399276 1.02
clickbench_q02/duckdb:parquet 51000311 50697120 1.01
clickbench_q03/duckdb:parquet 40301238 40343862 1.00
clickbench_q04/duckdb:parquet 201144630 204505333 0.98
clickbench_q05/duckdb:parquet 261097558 258217241 1.01
clickbench_q06/duckdb:parquet 48206754 48128871 1.00
clickbench_q07/duckdb:parquet 32447475 32049529 1.01
clickbench_q08/duckdb:parquet 269627810 271836326 0.99
clickbench_q09/duckdb:parquet 396904500 400536005 0.99
clickbench_q10/duckdb:parquet 82371838 85073869 0.97
clickbench_q11/duckdb:parquet 102960031 102109916 1.01
clickbench_q12/duckdb:parquet 285879993 281211219 1.02
clickbench_q13/duckdb:parquet 482723336 472638438 1.02
clickbench_q14/duckdb:parquet 321165706 321255770 1.00
clickbench_q15/duckdb:parquet 258068274 255068156 1.01
clickbench_q16/duckdb:parquet 599971314 596293696 1.01
clickbench_q17/duckdb:parquet 508620511 497732043 1.02
clickbench_q18/duckdb:parquet 1033776249 1022006856 1.01
clickbench_q19/duckdb:parquet 29232719 29252940 1.00
clickbench_q20/duckdb:parquet 416732316 420407654 0.99
clickbench_q21/duckdb:parquet 539958583 536728809 1.01
clickbench_q22/duckdb:parquet 928848181 920133391 1.01
clickbench_q23/duckdb:parquet 264026859 278518592 0.95
clickbench_q24/duckdb:parquet 73246656 73311989 1.00
clickbench_q25/duckdb:parquet 164351161 163126047 1.01
clickbench_q26/duckdb:parquet 54355160 54227693 1.00
clickbench_q27/duckdb:parquet 487036779 472481740 1.03
clickbench_q28/duckdb:parquet 4773397519 4788004480 1.00
clickbench_q29/duckdb:parquet 42988128 44327529 0.97
clickbench_q30/duckdb:parquet 311218246 312767372 1.00
clickbench_q31/duckdb:parquet 378328907 376050136 1.01
clickbench_q32/duckdb:parquet 1116666487 1112064466 1.00
clickbench_q33/duckdb:parquet 1115600086 1111345893 1.00
clickbench_q34/duckdb:parquet 1161697158 1151501596 1.01
clickbench_q35/duckdb:parquet 372504023 369451117 1.01
clickbench_q36/duckdb:parquet 47027054 48193509 0.98
clickbench_q37/duckdb:parquet 34857535 35639157 0.98
clickbench_q38/duckdb:parquet 37704519 36489618 1.03
clickbench_q39/duckdb:parquet 88045125 90137763 0.98
clickbench_q40/duckdb:parquet 21358612 21400859 1.00
clickbench_q41/duckdb:parquet 20284556 21335470 0.95
clickbench_q42/duckdb:parquet 22978743 22888599 1.00
File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_0.vortex 1.0 vortex-compact 58.88 MB 0 B 58.88 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.67 MB 0 B 90.67 MB -100.0%
hits_10.vortex 1.0 vortex-compact 49.48 MB 0 B 49.48 MB -100.0%
hits_11.vortex 1.0 vortex-compact 56.11 MB 0 B 56.11 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_13.vortex 1.0 vortex-compact 69.24 MB 0 B 69.24 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.88 MB 0 B 74.88 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.41 MB 0 B 48.41 MB -100.0%
hits_16.vortex 1.0 vortex-compact 49.56 MB 0 B 49.56 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.79 MB 0 B 58.79 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.89 MB 0 B 64.89 MB -100.0%
hits_19.vortex 1.0 vortex-compact 49.73 MB 0 B 49.73 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.16 MB 0 B 129.16 MB -100.0%
hits_20.vortex 1.0 vortex-compact 38.36 MB 0 B 38.36 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.99 MB 0 B 51.99 MB -100.0%
hits_22.vortex 1.0 vortex-compact 46.22 MB 0 B 46.22 MB -100.0%
hits_23.vortex 1.0 vortex-compact 46.13 MB 0 B 46.13 MB -100.0%
hits_24.vortex 1.0 vortex-compact 45.11 MB 0 B 45.11 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.88 MB 0 B 73.88 MB -100.0%
hits_26.vortex 1.0 vortex-compact 71.99 MB 0 B 71.99 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.86 MB 0 B 69.86 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.92 MB 0 B 70.92 MB -100.0%
hits_29.vortex 1.0 vortex-compact 36.68 MB 0 B 36.68 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.12 MB 0 B 95.12 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.58 MB 0 B 58.58 MB -100.0%
hits_31.vortex 1.0 vortex-compact 55.77 MB 0 B 55.77 MB -100.0%
hits_32.vortex 1.0 vortex-compact 44.61 MB 0 B 44.61 MB -100.0%
hits_33.vortex 1.0 vortex-compact 35.92 MB 0 B 35.92 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.24 MB 0 B 58.24 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.53 MB 0 B 75.53 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.21 MB 0 B 49.21 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.76 MB 0 B 54.76 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_39.vortex 1.0 vortex-compact 50.10 MB 0 B 50.10 MB -100.0%
hits_4.vortex 1.0 vortex-compact 71.94 MB 0 B 71.94 MB -100.0%
hits_40.vortex 1.0 vortex-compact 77.42 MB 0 B 77.42 MB -100.0%
hits_41.vortex 1.0 vortex-compact 166.05 MB 0 B 166.05 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.53 MB 0 B 164.53 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.21 MB 0 B 169.21 MB -100.0%
hits_44.vortex 1.0 vortex-compact 133.26 MB 0 B 133.26 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.80 MB 0 B 75.80 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.27 MB 0 B 42.27 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.22 MB 0 B 18.22 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.85 MB 0 B 17.85 MB -100.0%
hits_49.vortex 1.0 vortex-compact 51.00 MB 0 B 51.00 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.33 MB 0 B 63.33 MB -100.0%
hits_50.vortex 1.0 vortex-compact 114.20 MB 0 B 114.20 MB -100.0%
hits_51.vortex 1.0 vortex-compact 168.34 MB 0 B 168.34 MB -100.0%
hits_52.vortex 1.0 vortex-compact 65.08 MB 0 B 65.08 MB -100.0%
hits_53.vortex 1.0 vortex-compact 60.05 MB 0 B 60.05 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.57 MB 0 B 117.57 MB -100.0%
hits_55.vortex 1.0 vortex-compact 92.56 MB 0 B 92.56 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.58 MB 0 B 78.58 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.73 MB 0 B 83.73 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.68 MB 0 B 66.68 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.57 MB 0 B 63.57 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.92 MB 0 B 64.92 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.73 MB 0 B 57.73 MB -100.0%
hits_62.vortex 1.0 vortex-compact 75.45 MB 0 B 75.45 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.44 MB 0 B 46.44 MB -100.0%
hits_64.vortex 1.0 vortex-compact 54.09 MB 0 B 54.09 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.40 MB 0 B 129.40 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.52 MB 0 B 53.52 MB -100.0%
hits_67.vortex 1.0 vortex-compact 114.44 MB 0 B 114.44 MB -100.0%
hits_68.vortex 1.0 vortex-compact 76.67 MB 0 B 76.67 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.98 MB 0 B 80.98 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.19 MB 0 B 64.19 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.84 MB 0 B 61.84 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.96 MB 0 B 69.96 MB -100.0%
hits_72.vortex 1.0 vortex-compact 52.74 MB 0 B 52.74 MB -100.0%
hits_73.vortex 1.0 vortex-compact 71.07 MB 0 B 71.07 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.87 MB 0 B 71.87 MB -100.0%
hits_75.vortex 1.0 vortex-compact 45.12 MB 0 B 45.12 MB -100.0%
hits_76.vortex 1.0 vortex-compact 77.10 MB 0 B 77.10 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.50 MB 0 B 118.50 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.85 MB 0 B 97.85 MB -100.0%
hits_79.vortex 1.0 vortex-compact 86.17 MB 0 B 86.17 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.39 MB 0 B 63.39 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.67 MB 0 B 68.67 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.95 MB 0 B 65.95 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.43 MB 0 B 67.43 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.62 MB 0 B 53.62 MB -100.0%
hits_84.vortex 1.0 vortex-compact 74.35 MB 0 B 74.35 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.86 MB 0 B 52.86 MB -100.0%
hits_86.vortex 1.0 vortex-compact 49.12 MB 0 B 49.12 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.86 MB 0 B 118.86 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.59 MB 0 B 73.59 MB -100.0%
hits_89.vortex 1.0 vortex-compact 114.10 MB 0 B 114.10 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.32 MB 0 B 66.32 MB -100.0%
hits_90.vortex 1.0 vortex-compact 82.09 MB 0 B 82.09 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.24 MB 0 B 61.24 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.40 MB 0 B 94.40 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.92 MB 0 B 59.92 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.90 MB 0 B 90.90 MB -100.0%
hits_95.vortex 1.0 vortex-compact 58.20 MB 0 B 58.20 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.74 MB 0 B 91.74 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.58 MB 0 B 69.58 MB -100.0%
hits_98.vortex 1.0 vortex-compact 73.15 MB 0 B 73.15 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.65 MB 0 B 77.65 MB -100.0%

Totals:

  • vortex-compact: 7.11 GB → 0 B (-100.0%)
  • vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): 0.989x ➖
Parquet (geomean): 0.983x ➖
Shifts: Parquet (control) -1.7% · Median polish -1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (0.989x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12290048 12009682 1.02
statpopgen_q01/duckdb:vortex-file-compressed 12830936 12397932 1.03
statpopgen_q02/duckdb:vortex-file-compressed 521519769 523147423 1.00
statpopgen_q03/duckdb:vortex-file-compressed 1040021014 1044749732 1.00
statpopgen_q04/duckdb:vortex-file-compressed 1020152969 1046336921 0.97
statpopgen_q05/duckdb:vortex-file-compressed 473983616 501228469 0.95
statpopgen_q06/duckdb:vortex-file-compressed 1499167359 1506568682 1.00
statpopgen_q07/duckdb:vortex-file-compressed 194123331 205832685 0.94
statpopgen_q08/duckdb:vortex-file-compressed 225381330 224808985 1.00
statpopgen_q09/duckdb:vortex-file-compressed 800117031 820829173 0.97
statpopgen_q10/duckdb:vortex-file-compressed 2513488313 2520324055 1.00
duckdb / parquet (0.983x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 326137193 335268822 0.97
statpopgen_q01/duckdb:parquet 408365446 420773368 0.97
statpopgen_q02/duckdb:parquet 782281006 793503604 0.99
statpopgen_q03/duckdb:parquet 1229777089 1222939730 1.01
statpopgen_q04/duckdb:parquet 1230857241 1235904228 1.00
statpopgen_q05/duckdb:parquet 837950645 846814891 0.99
statpopgen_q06/duckdb:parquet 1454609508 1450425011 1.00
statpopgen_q07/duckdb:parquet 880050689 907869183 0.97
statpopgen_q08/duckdb:parquet 888310919 918833169 0.97
statpopgen_q09/duckdb:parquet 1033891431 1047495419 0.99
statpopgen_q10/duckdb:parquet 2214644987 2287391952 0.97
File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)
File Scale Format Base HEAD Change %
duckdb.db 100000 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.66 MB 0 B 960.66 MB -100.0%

Totals:

  • vortex-compact: 960.92 MB → 0 B (-100.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (-4.1%, environment too noisy confidence) · DuckDB No clear signal (+2.0%, environment too noisy confidence)
Vortex (geomean): 1.062x ➖
Parquet (geomean): 1.073x ➖
Shifts: Parquet (control) +7.3% · Median polish +7.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.032x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 285436111 264433703 1.08
tpch_q02/datafusion:vortex-file-compressed 500015148 420197478 1.19
tpch_q03/datafusion:vortex-file-compressed 418910476 357756907 1.17
tpch_q04/datafusion:vortex-file-compressed 210445652 184358857 1.14
tpch_q05/datafusion:vortex-file-compressed 415961992 356934555 1.17
tpch_q06/datafusion:vortex-file-compressed 271219227 287007913 0.94
tpch_q07/datafusion:vortex-file-compressed 402809938 490604950 0.82
tpch_q08/datafusion:vortex-file-compressed 506823032 601968092 0.84
tpch_q09/datafusion:vortex-file-compressed 405326318 387756502 1.05
tpch_q10/datafusion:vortex-file-compressed 367875523 366322421 1.00
tpch_q11/datafusion:vortex-file-compressed 324717630 291168504 1.12
tpch_q12/datafusion:vortex-file-compressed 380819424 360345113 1.06
tpch_q13/datafusion:vortex-file-compressed 216320013 196661566 1.10
tpch_q14/datafusion:vortex-file-compressed 187907398 170805172 1.10
tpch_q15/datafusion:vortex-file-compressed 328894261 306252830 1.07
tpch_q16/datafusion:vortex-file-compressed 192334951 204732975 0.94
tpch_q17/datafusion:vortex-file-compressed 357332048 355896972 1.00
tpch_q18/datafusion:vortex-file-compressed 288335456 326970573 0.88
tpch_q19/datafusion:vortex-file-compressed 413047480 437267224 0.94
tpch_q20/datafusion:vortex-file-compressed 383096077 396886477 0.97
tpch_q21/datafusion:vortex-file-compressed 546741660 533416856 1.02
tpch_q22/datafusion:vortex-file-compressed 173851321 143237649 1.21
datafusion / parquet (1.075x ➖, 0↑ 1↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 234348235 237385927 0.99
tpch_q02/datafusion:parquet 299195862 278128327 1.08
tpch_q03/datafusion:parquet 307014244 320996075 0.96
tpch_q04/datafusion:parquet 157111959 200379296 0.78
tpch_q05/datafusion:parquet 400888145 360911194 1.11
tpch_q06/datafusion:parquet 142646633 141616263 1.01
tpch_q07/datafusion:parquet 370418387 361249621 1.03
tpch_q08/datafusion:parquet 461836551 426077921 1.08
tpch_q09/datafusion:parquet 456100940 427776789 1.07
tpch_q10/datafusion:parquet 462191781 415935231 1.11
tpch_q11/datafusion:parquet 285757862 270895888 1.05
tpch_q12/datafusion:parquet 210065957 179114909 1.17
tpch_q13/datafusion:parquet 456615038 425493541 1.07
tpch_q14/datafusion:parquet 195967785 167556741 1.17
tpch_q15/datafusion:parquet 316470082 276278809 1.15
tpch_q16/datafusion:parquet 134676792 112170245 1.20
tpch_q17/datafusion:parquet 344936509 309159938 1.12
tpch_q18/datafusion:parquet 505521455 439643900 1.15
tpch_q19/datafusion:parquet 201281897 201643750 1.00
tpch_q20/datafusion:parquet 🚨 342807222 263557209 1.30
tpch_q21/datafusion:parquet 495006650 476945773 1.04
tpch_q22/datafusion:parquet 203173095 178719034 1.14
duckdb / vortex-file-compressed (1.093x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 309587047 304270306 1.02
tpch_q02/duckdb:vortex-file-compressed 1010923286 951222118 1.06
tpch_q03/duckdb:vortex-file-compressed 647730168 595186132 1.09
tpch_q04/duckdb:vortex-file-compressed 457760123 368885047 1.24
tpch_q05/duckdb:vortex-file-compressed 850260765 739351055 1.15
tpch_q06/duckdb:vortex-file-compressed 384293579 310902266 1.24
tpch_q07/duckdb:vortex-file-compressed 870485100 802745455 1.08
tpch_q08/duckdb:vortex-file-compressed 1071784385 1032577979 1.04
tpch_q09/duckdb:vortex-file-compressed 816991364 831381103 0.98
tpch_q10/duckdb:vortex-file-compressed 766956827 724862659 1.06
tpch_q11/duckdb:vortex-file-compressed 508078908 476896809 1.07
tpch_q12/duckdb:vortex-file-compressed 666094591 526515651 1.27
tpch_q13/duckdb:vortex-file-compressed 398036584 348683816 1.14
tpch_q14/duckdb:vortex-file-compressed 423422327 397385602 1.07
tpch_q15/duckdb:vortex-file-compressed 304286842 308900062 0.99
tpch_q16/duckdb:vortex-file-compressed 365673713 337038795 1.08
tpch_q17/duckdb:vortex-file-compressed 670911044 650372565 1.03
tpch_q18/duckdb:vortex-file-compressed 625359831 532271221 1.17
tpch_q19/duckdb:vortex-file-compressed 483844483 439157708 1.10
tpch_q20/duckdb:vortex-file-compressed 794215714 716178797 1.11
tpch_q21/duckdb:vortex-file-compressed 1113259297 1026532859 1.08
tpch_q22/duckdb:vortex-file-compressed 263221578 253372977 1.04
duckdb / parquet (1.072x ➖, 0↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 325959655 319846217 1.02
tpch_q02/duckdb:parquet 736302130 747663635 0.98
tpch_q03/duckdb:parquet 787287860 816589462 0.96
tpch_q04/duckdb:parquet 540643767 448154394 1.21
tpch_q05/duckdb:parquet 978422442 900106221 1.09
tpch_q06/duckdb:parquet 330885870 309838961 1.07
tpch_q07/duckdb:parquet 947294197 870514624 1.09
tpch_q08/duckdb:parquet 1187303608 1087640991 1.09
tpch_q09/duckdb:parquet 1185054702 1102654409 1.07
tpch_q10/duckdb:parquet 1033674999 1042498245 0.99
tpch_q11/duckdb:parquet 487544402 421644195 1.16
tpch_q12/duckdb:parquet 579028281 527051307 1.10
tpch_q13/duckdb:parquet 827378780 805630299 1.03
tpch_q14/duckdb:parquet 536421951 473862051 1.13
tpch_q15/duckdb:parquet 410031043 373564675 1.10
tpch_q16/duckdb:parquet 527310230 496647297 1.06
tpch_q17/duckdb:parquet 524499492 489410601 1.07
tpch_q18/duckdb:parquet 719241884 629835231 1.14
tpch_q19/duckdb:parquet 603100882 632402392 0.95
tpch_q20/duckdb:parquet 874192653 831354528 1.05
tpch_q21/duckdb:parquet 848562555 702463970 1.21
tpch_q22/duckdb:parquet 435114429 415408064 1.05

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.3%
Engines: DataFusion No clear signal (-2.3%, low confidence) · DuckDB No clear signal (-4.2%, low confidence)
Vortex (geomean): 0.914x ➖
Parquet (geomean): 0.945x ➖
Shifts: Parquet (control) -5.5% · Median polish -7.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.898x ✅, 12↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 453167001 489059436 0.93
tpch_q02/datafusion:vortex-file-compressed 105523163 114833326 0.92
tpch_q03/datafusion:vortex-file-compressed 🚀 209000889 236804307 0.88
tpch_q04/datafusion:vortex-file-compressed 🚀 107915714 120293200 0.90
tpch_q05/datafusion:vortex-file-compressed 🚀 338646085 396220658 0.85
tpch_q06/datafusion:vortex-file-compressed 53408314 56889634 0.94
tpch_q07/datafusion:vortex-file-compressed 🚀 464123898 530535060 0.87
tpch_q08/datafusion:vortex-file-compressed 🚀 353234460 396525049 0.89
tpch_q09/datafusion:vortex-file-compressed 🚀 621363119 703764259 0.88
tpch_q10/datafusion:vortex-file-compressed 🚀 235128020 265295500 0.89
tpch_q11/datafusion:vortex-file-compressed 🚀 79140563 89035214 0.89
tpch_q12/datafusion:vortex-file-compressed 123776977 133325647 0.93
tpch_q13/datafusion:vortex-file-compressed 203570620 223027335 0.91
tpch_q14/datafusion:vortex-file-compressed 62792552 69288066 0.91
tpch_q15/datafusion:vortex-file-compressed 125688199 133038806 0.94
tpch_q16/datafusion:vortex-file-compressed 🚀 74646698 84519515 0.88
tpch_q17/datafusion:vortex-file-compressed 🚀 583985163 666120703 0.88
tpch_q18/datafusion:vortex-file-compressed 🚀 855643997 988299005 0.87
tpch_q19/datafusion:vortex-file-compressed 93947791 104015875 0.90
tpch_q20/datafusion:vortex-file-compressed 170227428 188655149 0.90
tpch_q21/datafusion:vortex-file-compressed 🚀 623906578 696062697 0.90
tpch_q22/datafusion:vortex-file-compressed 54090343 59863557 0.90
datafusion / parquet (0.920x ➖, 5↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 472467797 512910401 0.92
tpch_q02/datafusion:parquet 166369703 177989547 0.93
tpch_q03/datafusion:parquet 234465069 259306177 0.90
tpch_q04/datafusion:parquet 107207801 115232651 0.93
tpch_q05/datafusion:parquet 🚀 370793686 419994437 0.88
tpch_q06/datafusion:parquet 123387559 135550895 0.91
tpch_q07/datafusion:parquet 🚀 539247683 609565068 0.88
tpch_q08/datafusion:parquet 🚀 420704209 471416722 0.89
tpch_q09/datafusion:parquet 🚀 681666835 776227803 0.88
tpch_q10/datafusion:parquet 537217183 592249850 0.91
tpch_q11/datafusion:parquet 122474745 132720902 0.92
tpch_q12/datafusion:parquet 206982082 218124464 0.95
tpch_q13/datafusion:parquet 356334452 376657773 0.95
tpch_q14/datafusion:parquet 145225172 156881946 0.93
tpch_q15/datafusion:parquet 267803816 286802399 0.93
tpch_q16/datafusion:parquet 129855046 132068908 0.98
tpch_q17/datafusion:parquet 636502625 702125907 0.91
tpch_q18/datafusion:parquet 🚀 884952038 989355686 0.89
tpch_q19/datafusion:parquet 269109735 290097994 0.93
tpch_q20/datafusion:parquet 301242071 317177218 0.95
tpch_q21/datafusion:parquet 626778697 674446029 0.93
tpch_q22/datafusion:parquet 207216363 223952624 0.93
duckdb / vortex-file-compressed (0.930x ➖, 1↑ 0↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 171786538 180408506 0.95
tpch_q02/duckdb:vortex-file-compressed 53684613 56180118 0.96
tpch_q03/duckdb:vortex-file-compressed 129689376 142983117 0.91
tpch_q04/duckdb:vortex-file-compressed 158023989 175231905 0.90
tpch_q05/duckdb:vortex-file-compressed 139854699 152668215 0.92
tpch_q06/duckdb:vortex-file-compressed 38829888 42332769 0.92
tpch_q07/duckdb:vortex-file-compressed 127701581 138558875 0.92
tpch_q08/duckdb:vortex-file-compressed 164680140 182118009 0.90
tpch_q09/duckdb:vortex-file-compressed 375563077 404514047 0.93
tpch_q10/duckdb:vortex-file-compressed 198821353 210426683 0.94
tpch_q11/duckdb:vortex-file-compressed 30311335 32341757 0.94
tpch_q12/duckdb:vortex-file-compressed 107810541 116554767 0.92
tpch_q13/duckdb:vortex-file-compressed 271957083 284298424 0.96
tpch_q14/duckdb:vortex-file-compressed 53248879 55968888 0.95
tpch_q15/duckdb:vortex-file-compressed 93539246 98173257 0.95
tpch_q16/duckdb:vortex-file-compressed 78973295 83800919 0.94
tpch_q17/duckdb:vortex-file-compressed 97178038 106376754 0.91
tpch_q18/duckdb:vortex-file-compressed 284448144 303774294 0.94
tpch_q19/duckdb:vortex-file-compressed 83275347 88152629 0.94
tpch_q20/duckdb:vortex-file-compressed 143462980 155500689 0.92
tpch_q21/duckdb:vortex-file-compressed 🚀 486078406 553996234 0.88
tpch_q22/duckdb:vortex-file-compressed 64172665 67841370 0.95
duckdb / parquet (0.970x ➖, 1↑ 1↓)
name PR 8401ad8 (ns) base 2a54a2c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 241480095 240052807 1.01
tpch_q02/duckdb:parquet 🚀 84684472 94387590 0.90
tpch_q03/duckdb:parquet 188871573 201427483 0.94
tpch_q04/duckdb:parquet 141689058 145691784 0.97
tpch_q05/duckdb:parquet 215173946 222646384 0.97
tpch_q06/duckdb:parquet 78998512 80332045 0.98
tpch_q07/duckdb:parquet 187202237 193680342 0.97
tpch_q08/duckdb:parquet 259695614 273556359 0.95
tpch_q09/duckdb:parquet 432468762 450839737 0.96
tpch_q10/duckdb:parquet 644632045 661545197 0.97
tpch_q11/duckdb:parquet 🚨 43462625 37524217 1.16
tpch_q12/duckdb:parquet 147524734 151083738 0.98
tpch_q13/duckdb:parquet 461367914 476367869 0.97
tpch_q14/duckdb:parquet 179841394 185832245 0.97
tpch_q15/duckdb:parquet 106018444 109722732 0.97
tpch_q16/duckdb:parquet 137207787 145401951 0.94
tpch_q17/duckdb:parquet 180257094 182829513 0.99
tpch_q18/duckdb:parquet 336605354 353746457 0.95
tpch_q19/duckdb:parquet 282731420 290957339 0.97
tpch_q20/duckdb:parquet 227754536 233900487 0.97
tpch_q21/duckdb:parquet 528091889 566198087 0.93
tpch_q22/duckdb:parquet 294616411 307753652 0.96
File Size Changes (9 files changed, -44.0% overall, 0↑ 9↓)
File Scale Format Base HEAD Change %
customer.vortex 10.0 vortex-compact 74.00 MB 0 B 74.00 MB -100.0%
duckdb.db 10.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
lineitem.vortex 10.0 vortex-compact 1.28 GB 0 B 1.28 GB -100.0%
nation.vortex 10.0 vortex-compact 8.01 KB 0 B 8.01 KB -100.0%
orders.vortex 10.0 vortex-compact 344.31 MB 0 B 344.31 MB -100.0%
part.vortex 10.0 vortex-compact 35.89 MB 0 B 35.89 MB -100.0%
partsupp.vortex 10.0 vortex-compact 203.66 MB 0 B 203.66 MB -100.0%
region.vortex 10.0 vortex-compact 6.04 KB 0 B 6.04 KB -100.0%
supplier.vortex 10.0 vortex-compact 4.73 MB 0 B 4.73 MB -100.0%

Totals:

  • vortex-compact: 1.92 GB → 0 B (-100.0%)
  • vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

experimental Experimental change; requires broader validation

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@AdamGS