Only run benchmark env configuration after setup is complete by AdamGS · Pull Request #9075 · vortex-data/vortex

AdamGS · 2026-07-29T18:25:22Z

Rationale for this change

This step (tries) to make the box more predictable at the cost of some performance, we should only run it AFTER we do all the setup (downloading dependencies, building binaries, generating data).

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

github-actions · 2026-07-29T18:28:44Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`78f9998`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`78f9998`	statpopgen	1	Explore Profiling Data
🟢 Done	`78f9998`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`78f9998`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`78f9998`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`78f9998`	fineweb	1	Explore Profiling Data
🟢 Done	`78f9998`	polarsignals	1	Explore Profiling Data
🟢 Done	`78f9998`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`78f9998`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`78f9998`	tpch-s3	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-07-29T18:31:20Z

Benchmarks: PolarSignals Profiling 📖

Vortex (geomean): 0.974x ➖

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.974x ➖, 1↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed	120382572	124120157	0.97
polarsignals_q01/datafusion:vortex-file-compressed	282062932	274731629	1.03
polarsignals_q02/datafusion:vortex-file-compressed	21157115	22485840	0.94
polarsignals_q03/datafusion:vortex-file-compressed 🚀	256873447	289243877	0.89
polarsignals_q04/datafusion:vortex-file-compressed	9113671	9350876	0.97
polarsignals_q05/datafusion:vortex-file-compressed	14910393	15043476	0.99
polarsignals_q06/datafusion:vortex-file-compressed	20190667	20138731	1.00
polarsignals_q07/datafusion:vortex-file-compressed	13139779	13704690	0.96
polarsignals_q08/datafusion:vortex-file-compressed	396096399	416930743	0.95
polarsignals_q09/datafusion:vortex-file-compressed	10184099	9746675	1.04

No file size changes detected.

github-actions · 2026-07-29T18:31:51Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.0%
Engines: DataFusion No clear signal (+6.4%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): 1.034x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +1.7%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.053x ➖, 0↑ 8↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨	25495244	23050811	1.11
tpcds_q02/datafusion:vortex-file-compressed	46879156	42810028	1.10
tpcds_q03/datafusion:vortex-file-compressed	14649687	15225341	0.96
tpcds_q04/datafusion:vortex-file-compressed	237346842	232256334	1.02
tpcds_q05/datafusion:vortex-file-compressed	45864468	47630760	0.96
tpcds_q06/datafusion:vortex-file-compressed	24296245	23186265	1.05
tpcds_q07/datafusion:vortex-file-compressed	42607048	42433624	1.00
tpcds_q08/datafusion:vortex-file-compressed	31457304	30677609	1.03
tpcds_q09/datafusion:vortex-file-compressed	32235252	31553278	1.02
tpcds_q10/datafusion:vortex-file-compressed	39623475	38412585	1.03
tpcds_q11/datafusion:vortex-file-compressed	133297374	132048718	1.01
tpcds_q12/datafusion:vortex-file-compressed	18550645	17937007	1.03
tpcds_q13/datafusion:vortex-file-compressed	44766502	43944483	1.02
tpcds_q14/datafusion:vortex-file-compressed	167599741	163271291	1.03
tpcds_q15/datafusion:vortex-file-compressed	27633820	25784113	1.07
tpcds_q16/datafusion:vortex-file-compressed	23840078	23381967	1.02
tpcds_q17/datafusion:vortex-file-compressed	63688297	58606826	1.09
tpcds_q18/datafusion:vortex-file-compressed	61392705	58079641	1.06
tpcds_q19/datafusion:vortex-file-compressed	22572583	22242444	1.01
tpcds_q20/datafusion:vortex-file-compressed	19897178	19076384	1.04
tpcds_q21/datafusion:vortex-file-compressed	38687959	36926787	1.05
tpcds_q22/datafusion:vortex-file-compressed	131054982	126444787	1.04
tpcds_q23/datafusion:vortex-file-compressed	157347333	152217147	1.03
tpcds_q24/datafusion:vortex-file-compressed	88309230	81949552	1.08
tpcds_q25/datafusion:vortex-file-compressed	64412684	61801715	1.04
tpcds_q26/datafusion:vortex-file-compressed	30837199	29253880	1.05
tpcds_q27/datafusion:vortex-file-compressed	100160677	92596970	1.08
tpcds_q28/datafusion:vortex-file-compressed	32863048	32571494	1.01
tpcds_q29/datafusion:vortex-file-compressed	61428780	59201445	1.04
tpcds_q30/datafusion:vortex-file-compressed	25550054	24373012	1.05
tpcds_q31/datafusion:vortex-file-compressed	73735365	69465649	1.06
tpcds_q32/datafusion:vortex-file-compressed 🚨	20047093	17742326	1.13
tpcds_q33/datafusion:vortex-file-compressed	29523163	29620364	1.00
tpcds_q34/datafusion:vortex-file-compressed	27229997	25551719	1.07
tpcds_q35/datafusion:vortex-file-compressed	46030854	44237370	1.04
tpcds_q36/datafusion:vortex-file-compressed	61371979	59293266	1.04
tpcds_q37/datafusion:vortex-file-compressed	19129317	17875666	1.07
tpcds_q38/datafusion:vortex-file-compressed	41004102	40951428	1.00
tpcds_q39/datafusion:vortex-file-compressed	115698243	110324780	1.05
tpcds_q40/datafusion:vortex-file-compressed	31240493	29853823	1.05
tpcds_q41/datafusion:vortex-file-compressed	21798382	20131760	1.08
tpcds_q42/datafusion:vortex-file-compressed	13584688	13425115	1.01
tpcds_q43/datafusion:vortex-file-compressed	19713922	18348945	1.07
tpcds_q44/datafusion:vortex-file-compressed	30661512	30297578	1.01
tpcds_q45/datafusion:vortex-file-compressed	26986567	25156270	1.07
tpcds_q46/datafusion:vortex-file-compressed	36176166	35513686	1.02
tpcds_q47/datafusion:vortex-file-compressed	144108640	136677581	1.05
tpcds_q48/datafusion:vortex-file-compressed	39089518	35830079	1.09
tpcds_q49/datafusion:vortex-file-compressed	62453011	58393061	1.07
tpcds_q50/datafusion:vortex-file-compressed	40099236	38162227	1.05
tpcds_q51/datafusion:vortex-file-compressed	91501286	89023611	1.03
tpcds_q52/datafusion:vortex-file-compressed	14458729	13323358	1.09
tpcds_q53/datafusion:vortex-file-compressed	23252748	21378855	1.09
tpcds_q54/datafusion:vortex-file-compressed	36094897	33365871	1.08
tpcds_q55/datafusion:vortex-file-compressed 🚨	14300345	12895941	1.11
tpcds_q56/datafusion:vortex-file-compressed	32580778	30571257	1.07
tpcds_q57/datafusion:vortex-file-compressed	93080868	90992800	1.02
tpcds_q58/datafusion:vortex-file-compressed	56302853	52885324	1.06
tpcds_q59/datafusion:vortex-file-compressed	59300878	57712456	1.03
tpcds_q60/datafusion:vortex-file-compressed	31585231	29533564	1.07
tpcds_q61/datafusion:vortex-file-compressed	41809957	38763476	1.08
tpcds_q62/datafusion:vortex-file-compressed 🚨	22914569	20689834	1.11
tpcds_q63/datafusion:vortex-file-compressed 🚨	23848186	21676864	1.10
tpcds_q64/datafusion:vortex-file-compressed	409766724	394670242	1.04
tpcds_q65/datafusion:vortex-file-compressed	52996834	50841809	1.04
tpcds_q66/datafusion:vortex-file-compressed	71421612	70368126	1.01
tpcds_q67/datafusion:vortex-file-compressed	157301830	155653426	1.01
tpcds_q68/datafusion:vortex-file-compressed	35241347	32309230	1.09
tpcds_q69/datafusion:vortex-file-compressed 🚨	37983116	33682654	1.13
tpcds_q70/datafusion:vortex-file-compressed	101031326	95425466	1.06
tpcds_q71/datafusion:vortex-file-compressed	24046229	23000927	1.05
tpcds_q72/datafusion:vortex-file-compressed	2191787697	2097572833	1.04
tpcds_q73/datafusion:vortex-file-compressed	24992027	23478294	1.06
tpcds_q74/datafusion:vortex-file-compressed	81726369	78889330	1.04
tpcds_q75/datafusion:vortex-file-compressed	111499040	106330555	1.05
tpcds_q76/datafusion:vortex-file-compressed	30793850	28438914	1.08
tpcds_q77/datafusion:vortex-file-compressed	38388254	35698621	1.08
tpcds_q78/datafusion:vortex-file-compressed	115052280	107564350	1.07
tpcds_q79/datafusion:vortex-file-compressed	29213092	28749763	1.02
tpcds_q80/datafusion:vortex-file-compressed	92236555	88417603	1.04
tpcds_q81/datafusion:vortex-file-compressed	26026050	24670117	1.05
tpcds_q82/datafusion:vortex-file-compressed	20885137	19887918	1.05
tpcds_q83/datafusion:vortex-file-compressed	36864441	35241607	1.05
tpcds_q84/datafusion:vortex-file-compressed 🚨	13889955	12153079	1.14
tpcds_q85/datafusion:vortex-file-compressed	93641183	86819717	1.08
tpcds_q86/datafusion:vortex-file-compressed	16068699	14926224	1.08
tpcds_q87/datafusion:vortex-file-compressed	41928673	38261679	1.10
tpcds_q88/datafusion:vortex-file-compressed	56434813	53682617	1.05
tpcds_q89/datafusion:vortex-file-compressed	26021647	25017598	1.04
tpcds_q90/datafusion:vortex-file-compressed	13641262	12747355	1.07
tpcds_q91/datafusion:vortex-file-compressed 🚨	20714986	18352163	1.13
tpcds_q92/datafusion:vortex-file-compressed	16655299	15617284	1.07
tpcds_q93/datafusion:vortex-file-compressed	31576878	32153316	0.98
tpcds_q94/datafusion:vortex-file-compressed	21695087	19828640	1.09
tpcds_q95/datafusion:vortex-file-compressed	58461750	53750228	1.09
tpcds_q96/datafusion:vortex-file-compressed	13024086	12589195	1.03
tpcds_q97/datafusion:vortex-file-compressed	29738520	27784768	1.07
tpcds_q98/datafusion:vortex-file-compressed	25180707	23028752	1.09
tpcds_q99/datafusion:vortex-file-compressed	25274932	24540861	1.03

datafusion / parquet (0.990x ➖, 0↑ 1↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpcds_q01/datafusion:parquet	25252594	25638617	0.98
tpcds_q02/datafusion:parquet	43267295	44664634	0.97
tpcds_q03/datafusion:parquet	14675725	14757560	0.99
tpcds_q04/datafusion:parquet	328991733	332618350	0.99
tpcds_q05/datafusion:parquet	47687436	50917309	0.94
tpcds_q06/datafusion:parquet	25239479	25815821	0.98
tpcds_q07/datafusion:parquet	85664894	82713806	1.04
tpcds_q08/datafusion:parquet	31001524	31528657	0.98
tpcds_q09/datafusion:parquet	40034515	41255514	0.97
tpcds_q10/datafusion:parquet	77543223	76296210	1.02
tpcds_q11/datafusion:parquet	156313949	161367879	0.97
tpcds_q12/datafusion:parquet	19069087	17473919	1.09
tpcds_q13/datafusion:parquet	80269751	80149250	1.00
tpcds_q14/datafusion:parquet	167226253	171088296	0.98
tpcds_q15/datafusion:parquet	22058628	22560318	0.98
tpcds_q16/datafusion:parquet	30969697	31824632	0.97
tpcds_q17/datafusion:parquet	66534671	64816893	1.03
tpcds_q18/datafusion:parquet	113368104	114971681	0.99
tpcds_q19/datafusion:parquet	24459096	25238827	0.97
tpcds_q20/datafusion:parquet	19501906	19424925	1.00
tpcds_q21/datafusion:parquet	20730667	20660857	1.00
tpcds_q22/datafusion:parquet 🚨	209992451	171206774	1.23
tpcds_q23/datafusion:parquet	159191322	172399476	0.92
tpcds_q24/datafusion:parquet	93291485	97196373	0.96
tpcds_q25/datafusion:parquet	65864168	70517290	0.93
tpcds_q26/datafusion:parquet	72069759	72169087	1.00
tpcds_q27/datafusion:parquet	142496662	157462286	0.90
tpcds_q28/datafusion:parquet	46494063	46423757	1.00
tpcds_q29/datafusion:parquet	68933764	69862887	0.99
tpcds_q30/datafusion:parquet	34643915	37813337	0.92
tpcds_q31/datafusion:parquet	70941395	70831680	1.00
tpcds_q32/datafusion:parquet	18273678	18075970	1.01
tpcds_q33/datafusion:parquet	28191855	29556932	0.95
tpcds_q34/datafusion:parquet	24934872	23771922	1.05
tpcds_q35/datafusion:parquet	83756439	83139156	1.01
tpcds_q36/datafusion:parquet	60348865	61076696	0.99
tpcds_q37/datafusion:parquet	20272566	21808285	0.93
tpcds_q38/datafusion:parquet	44103527	43822665	1.01
tpcds_q39/datafusion:parquet	89280568	86545569	1.03
tpcds_q40/datafusion:parquet	25284433	24262243	1.04
tpcds_q41/datafusion:parquet	16217506	17304537	0.94
tpcds_q42/datafusion:parquet	12371504	13057510	0.95
tpcds_q43/datafusion:parquet	18895250	18494227	1.02
tpcds_q44/datafusion:parquet	35005868	35886690	0.98
tpcds_q45/datafusion:parquet	30017183	30458528	0.99
tpcds_q46/datafusion:parquet	34527422	33969106	1.02
tpcds_q47/datafusion:parquet	136151130	141700679	0.96
tpcds_q48/datafusion:parquet	73664191	74229469	0.99
tpcds_q49/datafusion:parquet	60144844	60737629	0.99
tpcds_q50/datafusion:parquet	44987977	43419715	1.04
tpcds_q51/datafusion:parquet	93415829	93101537	1.00
tpcds_q52/datafusion:parquet	12678898	12414428	1.02
tpcds_q53/datafusion:parquet	19202324	18870363	1.02
tpcds_q54/datafusion:parquet	35824646	34706433	1.03
tpcds_q55/datafusion:parquet	12533763	12101760	1.04
tpcds_q56/datafusion:parquet	29793614	29644243	1.01
tpcds_q57/datafusion:parquet	103435779	103592019	1.00
tpcds_q58/datafusion:parquet	59860220	58395222	1.03
tpcds_q59/datafusion:parquet	63870861	64604053	0.99
tpcds_q60/datafusion:parquet	30799359	29108520	1.06
tpcds_q61/datafusion:parquet	45058410	46319474	0.97
tpcds_q62/datafusion:parquet	27059542	26870019	1.01
tpcds_q63/datafusion:parquet	19560656	18853965	1.04
tpcds_q64/datafusion:parquet	330243550	347160904	0.95
tpcds_q65/datafusion:parquet	39469754	40824349	0.97
tpcds_q66/datafusion:parquet	76907463	76282666	1.01
tpcds_q67/datafusion:parquet	154235991	168863947	0.91
tpcds_q68/datafusion:parquet	33405574	34921300	0.96
tpcds_q69/datafusion:parquet	70846496	72563447	0.98
tpcds_q70/datafusion:parquet	34051102	37129913	0.92
tpcds_q71/datafusion:parquet	23539643	24490446	0.96
tpcds_q72/datafusion:parquet	628217257	643437856	0.98
tpcds_q73/datafusion:parquet	22882355	23096286	0.99
tpcds_q74/datafusion:parquet	90362559	91101698	0.99
tpcds_q75/datafusion:parquet	113260606	112774332	1.00
tpcds_q76/datafusion:parquet	33277422	33307181	1.00
tpcds_q77/datafusion:parquet	40086993	42198956	0.95
tpcds_q78/datafusion:parquet	118065557	115862500	1.02
tpcds_q79/datafusion:parquet	28385818	30125494	0.94
tpcds_q80/datafusion:parquet	82036479	88054091	0.93
tpcds_q81/datafusion:parquet	32931487	32578542	1.01
tpcds_q82/datafusion:parquet	20097336	21504823	0.93
tpcds_q83/datafusion:parquet	45982152	45320427	1.01
tpcds_q84/datafusion:parquet	43972984	44745849	0.98
tpcds_q85/datafusion:parquet	157844356	153747945	1.03
tpcds_q86/datafusion:parquet	16716818	17780377	0.94
tpcds_q87/datafusion:parquet	46872759	47451071	0.99
tpcds_q88/datafusion:parquet	61705363	62988988	0.98
tpcds_q89/datafusion:parquet	24929343	24019682	1.04
tpcds_q90/datafusion:parquet	15921247	15823042	1.01
tpcds_q91/datafusion:parquet	62030048	62251518	1.00
tpcds_q92/datafusion:parquet	20010201	19723356	1.01
tpcds_q93/datafusion:parquet	32692382	34063663	0.96
tpcds_q94/datafusion:parquet	23947889	22342594	1.07
tpcds_q95/datafusion:parquet	63011804	61410183	1.03
tpcds_q96/datafusion:parquet	12820098	14193150	0.90
tpcds_q97/datafusion:parquet	32227952	32198305	1.00
tpcds_q98/datafusion:parquet	22867844	23281998	0.98
tpcds_q99/datafusion:parquet	27395744	28494229	0.96

duckdb / vortex-file-compressed (1.016x ➖, 1↑ 9↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed	23472966	24445663	0.96
tpcds_q02/duckdb:vortex-file-compressed	24050323	24763112	0.97
tpcds_q03/duckdb:vortex-file-compressed	19920448	21879857	0.91
tpcds_q04/duckdb:vortex-file-compressed	99853786	105905164	0.94
tpcds_q05/duckdb:vortex-file-compressed	36201041	36578777	0.99
tpcds_q06/duckdb:vortex-file-compressed	35059057	36878159	0.95
tpcds_q07/duckdb:vortex-file-compressed 🚀	28545749	32048343	0.89
tpcds_q08/duckdb:vortex-file-compressed	28757942	31792344	0.90
tpcds_q09/duckdb:vortex-file-compressed	16078955	16992262	0.95
tpcds_q10/duckdb:vortex-file-compressed	41794931	42881554	0.97
tpcds_q11/duckdb:vortex-file-compressed	75868737	77110265	0.98
tpcds_q12/duckdb:vortex-file-compressed	15451178	15630854	0.99
tpcds_q13/duckdb:vortex-file-compressed	36606366	35278793	1.04
tpcds_q14/duckdb:vortex-file-compressed	109337823	102850658	1.06
tpcds_q15/duckdb:vortex-file-compressed	28129806	29289186	0.96
tpcds_q16/duckdb:vortex-file-compressed	23733307	23148938	1.03
tpcds_q17/duckdb:vortex-file-compressed	50138709	48808038	1.03
tpcds_q18/duckdb:vortex-file-compressed	44483443	41841225	1.06
tpcds_q19/duckdb:vortex-file-compressed	36139345	38138567	0.95
tpcds_q20/duckdb:vortex-file-compressed	15485284	15543535	1.00
tpcds_q21/duckdb:vortex-file-compressed	16620071	17192528	0.97
tpcds_q22/duckdb:vortex-file-compressed	73600334	75912995	0.97
tpcds_q23/duckdb:vortex-file-compressed	91359522	90864868	1.01
tpcds_q24/duckdb:vortex-file-compressed	47995627	47541899	1.01
tpcds_q25/duckdb:vortex-file-compressed	36603755	38877634	0.94
tpcds_q26/duckdb:vortex-file-compressed	19729088	20012666	0.99
tpcds_q27/duckdb:vortex-file-compressed	29574746	29917280	0.99
tpcds_q28/duckdb:vortex-file-compressed	12583100	13066584	0.96
tpcds_q29/duckdb:vortex-file-compressed	49520586	50306625	0.98
tpcds_q30/duckdb:vortex-file-compressed	26191175	26562502	0.99
tpcds_q31/duckdb:vortex-file-compressed	31458121	32236189	0.98
tpcds_q32/duckdb:vortex-file-compressed	13904194	14832019	0.94
tpcds_q33/duckdb:vortex-file-compressed	27219890	27766545	0.98
tpcds_q34/duckdb:vortex-file-compressed	28424324	30099073	0.94
tpcds_q35/duckdb:vortex-file-compressed	67813415	70649054	0.96
tpcds_q36/duckdb:vortex-file-compressed	25555633	27548535	0.93
tpcds_q37/duckdb:vortex-file-compressed	20301243	20131575	1.01
tpcds_q38/duckdb:vortex-file-compressed	37844756	40832338	0.93
tpcds_q39/duckdb:vortex-file-compressed	29602601	28823393	1.03
tpcds_q40/duckdb:vortex-file-compressed	18881616	20188820	0.94
tpcds_q41/duckdb:vortex-file-compressed	12946586	12953290	1.00
tpcds_q42/duckdb:vortex-file-compressed	16592768	16836039	0.99
tpcds_q43/duckdb:vortex-file-compressed	19200042	18608810	1.03
tpcds_q44/duckdb:vortex-file-compressed	23197910	22279897	1.04
tpcds_q45/duckdb:vortex-file-compressed	32109569	32391565	0.99
tpcds_q46/duckdb:vortex-file-compressed	38547366	38819287	0.99
tpcds_q47/duckdb:vortex-file-compressed	54556233	55541766	0.98
tpcds_q48/duckdb:vortex-file-compressed	33219149	33999866	0.98
tpcds_q49/duckdb:vortex-file-compressed	37705016	38156318	0.99
tpcds_q50/duckdb:vortex-file-compressed	28877063	28759645	1.00
tpcds_q51/duckdb:vortex-file-compressed	107990638	105363467	1.02
tpcds_q52/duckdb:vortex-file-compressed	16540724	15732230	1.05
tpcds_q53/duckdb:vortex-file-compressed	24813335	24823199	1.00
tpcds_q54/duckdb:vortex-file-compressed	31258435	30237995	1.03
tpcds_q55/duckdb:vortex-file-compressed	15597724	15169171	1.03
tpcds_q56/duckdb:vortex-file-compressed	29035018	30202702	0.96
tpcds_q57/duckdb:vortex-file-compressed	38067626	36652831	1.04
tpcds_q58/duckdb:vortex-file-compressed 🚨	33748171	30370923	1.11
tpcds_q59/duckdb:vortex-file-compressed	39502774	36154611	1.09
tpcds_q60/duckdb:vortex-file-compressed	28591915	27207707	1.05
tpcds_q61/duckdb:vortex-file-compressed 🚨	35746359	32390309	1.10
tpcds_q62/duckdb:vortex-file-compressed	15958755	14895306	1.07
tpcds_q63/duckdb:vortex-file-compressed	22144041	21847440	1.01
tpcds_q64/duckdb:vortex-file-compressed	105285942	98266315	1.07
tpcds_q65/duckdb:vortex-file-compressed	24741319	23155125	1.07
tpcds_q66/duckdb:vortex-file-compressed	30056088	29233109	1.03
tpcds_q67/duckdb:vortex-file-compressed	148568925	142296424	1.04
tpcds_q68/duckdb:vortex-file-compressed	39364022	37721139	1.04
tpcds_q69/duckdb:vortex-file-compressed	45814365	44719106	1.02
tpcds_q70/duckdb:vortex-file-compressed	35744080	32960682	1.08
tpcds_q71/duckdb:vortex-file-compressed	24953919	23450793	1.06
tpcds_q72/duckdb:vortex-file-compressed	156183931	157239287	0.99
tpcds_q73/duckdb:vortex-file-compressed	30976959	28457472	1.09
tpcds_q74/duckdb:vortex-file-compressed	48443507	46450834	1.04
tpcds_q75/duckdb:vortex-file-compressed	51363425	48704446	1.05
tpcds_q76/duckdb:vortex-file-compressed	22964529	21949485	1.05
tpcds_q77/duckdb:vortex-file-compressed 🚨	28041382	24430637	1.15
tpcds_q78/duckdb:vortex-file-compressed	68717133	66257012	1.04
tpcds_q79/duckdb:vortex-file-compressed	28010829	27383035	1.02
tpcds_q80/duckdb:vortex-file-compressed 🚨	53520361	46702577	1.15
tpcds_q81/duckdb:vortex-file-compressed	31573535	29443561	1.07
tpcds_q82/duckdb:vortex-file-compressed	47651702	46227361	1.03
tpcds_q83/duckdb:vortex-file-compressed 🚨	31146325	27559496	1.13
tpcds_q84/duckdb:vortex-file-compressed 🚨	18307095	16386711	1.12
tpcds_q85/duckdb:vortex-file-compressed	45392174	43600621	1.04
tpcds_q86/duckdb:vortex-file-compressed	17259550	16585862	1.04
tpcds_q87/duckdb:vortex-file-compressed	42108606	42943328	0.98
tpcds_q88/duckdb:vortex-file-compressed	59119028	55756309	1.06
tpcds_q89/duckdb:vortex-file-compressed	23376981	23360844	1.00
tpcds_q90/duckdb:vortex-file-compressed	11605077	11284611	1.03
tpcds_q91/duckdb:vortex-file-compressed	24100506	21998162	1.10
tpcds_q92/duckdb:vortex-file-compressed	19902150	18473989	1.08
tpcds_q93/duckdb:vortex-file-compressed	29782676	28195746	1.06
tpcds_q94/duckdb:vortex-file-compressed 🚨	23858629	21412347	1.11
tpcds_q95/duckdb:vortex-file-compressed	126325168	122591409	1.03
tpcds_q96/duckdb:vortex-file-compressed 🚨	14962015	13316546	1.12
tpcds_q97/duckdb:vortex-file-compressed	39707839	38403941	1.03
tpcds_q98/duckdb:vortex-file-compressed 🚨	21661872	19570909	1.11
tpcds_q99/duckdb:vortex-file-compressed	19911157	18528879	1.07

duckdb / parquet (1.020x ➖, 1↑ 5↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpcds_q01/duckdb:parquet 🚨	32784669	29596718	1.11
tpcds_q02/duckdb:parquet	25033620	24644626	1.02
tpcds_q03/duckdb:parquet	13150384	13654460	0.96
tpcds_q04/duckdb:parquet 🚨	193121768	174295062	1.11
tpcds_q05/duckdb:parquet	34667082	33248881	1.04
tpcds_q06/duckdb:parquet	35548813	35142903	1.01
tpcds_q07/duckdb:parquet	24877025	24595679	1.01
tpcds_q08/duckdb:parquet	30828733	30167160	1.02
tpcds_q09/duckdb:parquet	45377952	45178048	1.00
tpcds_q10/duckdb:parquet	39427112	39497470	1.00
tpcds_q11/duckdb:parquet 🚨	109859320	95818726	1.15
tpcds_q12/duckdb:parquet	16563159	16673737	0.99
tpcds_q13/duckdb:parquet	36390369	35616723	1.02
tpcds_q14/duckdb:parquet	106377385	103467229	1.03
tpcds_q15/duckdb:parquet	32452215	31920309	1.02
tpcds_q16/duckdb:parquet	23662209	23532238	1.01
tpcds_q17/duckdb:parquet	39840725	39391297	1.01
tpcds_q18/duckdb:parquet	50417739	49085527	1.03
tpcds_q19/duckdb:parquet	33632196	33158574	1.01
tpcds_q20/duckdb:parquet	17864934	17462855	1.02
tpcds_q21/duckdb:parquet	12807384	12597665	1.02
tpcds_q22/duckdb:parquet	79909736	72975714	1.10
tpcds_q23/duckdb:parquet	84060053	81474702	1.03
tpcds_q24/duckdb:parquet	48677106	48330389	1.01
tpcds_q25/duckdb:parquet	37428160	36066326	1.04
tpcds_q26/duckdb:parquet	42054010	40355321	1.04
tpcds_q27/duckdb:parquet	56757138	53494657	1.06
tpcds_q28/duckdb:parquet	44061106	43602588	1.01
tpcds_q29/duckdb:parquet	37994236	38040900	1.00
tpcds_q30/duckdb:parquet	39482608	37948096	1.04
tpcds_q31/duckdb:parquet	29239574	28927802	1.01
tpcds_q32/duckdb:parquet	13483748	12784192	1.05
tpcds_q33/duckdb:parquet	24740741	23875482	1.04
tpcds_q34/duckdb:parquet	23603306	23601797	1.00
tpcds_q35/duckdb:parquet	64410627	62146596	1.04
tpcds_q36/duckdb:parquet	23654452	22567486	1.05
tpcds_q37/duckdb:parquet	14857302	14406865	1.03
tpcds_q38/duckdb:parquet 🚨	41392044	37038705	1.12
tpcds_q39/duckdb:parquet	33335961	32471378	1.03
tpcds_q40/duckdb:parquet	21085635	19560264	1.08
tpcds_q41/duckdb:parquet	9538951	8826855	1.08
tpcds_q42/duckdb:parquet	13488387	12713952	1.06
tpcds_q43/duckdb:parquet	17714799	18569774	0.95
tpcds_q44/duckdb:parquet	27555993	26104547	1.06
tpcds_q45/duckdb:parquet	29954024	28485101	1.05
tpcds_q46/duckdb:parquet 🚨	56359899	47299146	1.19
tpcds_q47/duckdb:parquet	51957199	50479034	1.03
tpcds_q48/duckdb:parquet	33428311	32942200	1.01
tpcds_q49/duckdb:parquet	31145484	28598221	1.09
tpcds_q50/duckdb:parquet	26711400	26567241	1.01
tpcds_q51/duckdb:parquet	108784147	103021678	1.06
tpcds_q52/duckdb:parquet	12884208	13613929	0.95
tpcds_q53/duckdb:parquet	17586334	16800782	1.05
tpcds_q54/duckdb:parquet	30422672	28748476	1.06
tpcds_q55/duckdb:parquet	13117288	13503164	0.97
tpcds_q56/duckdb:parquet	26002379	24514479	1.06
tpcds_q57/duckdb:parquet	39777652	39010078	1.02
tpcds_q58/duckdb:parquet	27374558	27224362	1.01
tpcds_q59/duckdb:parquet	36889515	36825770	1.00
tpcds_q60/duckdb:parquet	26086352	25760065	1.01
tpcds_q61/duckdb:parquet	33417853	34871924	0.96
tpcds_q62/duckdb:parquet	14095427	12979071	1.09
tpcds_q63/duckdb:parquet	16214570	16366464	0.99
tpcds_q64/duckdb:parquet	78209983	75902583	1.03
tpcds_q65/duckdb:parquet	24419645	23081215	1.06
tpcds_q66/duckdb:parquet	31829539	33690386	0.94
tpcds_q67/duckdb:parquet	140294913	141139805	0.99
tpcds_q68/duckdb:parquet	41258392	39113657	1.05
tpcds_q69/duckdb:parquet	39629190	39780052	1.00
tpcds_q70/duckdb:parquet	23028108	22624174	1.02
tpcds_q71/duckdb:parquet	24890836	24313401	1.02
tpcds_q72/duckdb:parquet	171888025	166315472	1.03
tpcds_q73/duckdb:parquet	20811243	21124152	0.99
tpcds_q74/duckdb:parquet	133670541	132273681	1.01
tpcds_q75/duckdb:parquet	60588040	57761137	1.05
tpcds_q76/duckdb:parquet	22676857	22087099	1.03
tpcds_q77/duckdb:parquet	26200223	26669590	0.98
tpcds_q78/duckdb:parquet	79412785	85436229	0.93
tpcds_q79/duckdb:parquet	31272835	32237489	0.97
tpcds_q80/duckdb:parquet	46476444	49207239	0.94
tpcds_q81/duckdb:parquet	37120099	38693345	0.96
tpcds_q82/duckdb:parquet	17188912	18503413	0.93
tpcds_q83/duckdb:parquet	19259209	19762508	0.97
tpcds_q84/duckdb:parquet	21113584	21570209	0.98
tpcds_q85/duckdb:parquet	44078388	44503656	0.99
tpcds_q86/duckdb:parquet	15024702	14915515	1.01
tpcds_q87/duckdb:parquet	42840893	42661164	1.00
tpcds_q88/duckdb:parquet	54071415	53715296	1.01
tpcds_q89/duckdb:parquet	19055486	19162609	0.99
tpcds_q90/duckdb:parquet	8923108	8665356	1.03
tpcds_q91/duckdb:parquet	26317469	25641831	1.03
tpcds_q92/duckdb:parquet	14115627	14049004	1.00
tpcds_q93/duckdb:parquet	33180615	33627857	0.99
tpcds_q94/duckdb:parquet	18795191	19189542	0.98
tpcds_q95/duckdb:parquet	140630305	137358235	1.02
tpcds_q96/duckdb:parquet	12044054	11631680	1.04
tpcds_q97/duckdb:parquet	43755573	40843251	1.07
tpcds_q98/duckdb:parquet	22511148	22716366	0.99
tpcds_q99/duckdb:parquet 🚀	21241173	23852100	0.89

File Size Changes (25 files changed, -43.5% overall, 0↑ 25↓)

File	Scale	Format	Base	Change	%
call_center.vortex	1.0	vortex-compact	47.64 KB	47.64 KB	-100.0%
catalog_page.vortex	1.0	vortex-compact	362.64 KB	362.64 KB	-100.0%
catalog_returns.vortex	1.0	vortex-compact	6.04 MB	6.04 MB	-100.0%
catalog_sales.vortex	1.0	vortex-compact	59.49 MB	59.49 MB	-100.0%
customer.vortex	1.0	vortex-compact	3.29 MB	3.29 MB	-100.0%
customer_address.vortex	1.0	vortex-compact	639.04 KB	639.04 KB	-100.0%
customer_demographics.vortex	1.0	vortex-compact	424.38 KB	424.38 KB	-100.0%
date_dim.vortex	1.0	vortex-compact	140.48 KB	140.48 KB	-100.0%
duckdb.db	1.0	vortex-compact	268.00 KB	268.00 KB	-100.0%
household_demographics.vortex	1.0	vortex-compact	10.49 KB	10.49 KB	-100.0%
income_band.vortex	1.0	vortex-compact	5.77 KB	5.77 KB	-100.0%
inventory.vortex	1.0	vortex-compact	16.07 MB	16.07 MB	-100.0%
item.vortex	1.0	vortex-compact	1000.52 KB	1000.52 KB	-100.0%
promotion.vortex	1.0	vortex-compact	50.52 KB	50.52 KB	-100.0%
reason.vortex	1.0	vortex-compact	6.17 KB	6.17 KB	-100.0%
ship_mode.vortex	1.0	vortex-compact	10.93 KB	10.93 KB	-100.0%
store.vortex	1.0	vortex-compact	43.42 KB	43.42 KB	-100.0%
store_returns.vortex	1.0	vortex-compact	9.36 MB	9.36 MB	-100.0%
store_sales.vortex	1.0	vortex-compact	78.12 MB	78.12 MB	-100.0%
time_dim.vortex	1.0	vortex-compact	96.80 KB	96.80 KB	-100.0%
warehouse.vortex	1.0	vortex-compact	22.35 KB	22.35 KB	-100.0%
web_page.vortex	1.0	vortex-compact	25.21 KB	25.21 KB	-100.0%
web_returns.vortex	1.0	vortex-compact	3.00 MB	3.00 MB	-100.0%
web_sales.vortex	1.0	vortex-compact	29.45 MB	29.45 MB	-100.0%
web_site.vortex	1.0	vortex-compact	42.39 KB	42.39 KB	-100.0%

Totals:

vortex-compact: 207.94 MB → 0 B (-100.0%)
vortex-file-compressed: 269.98 MB → 269.98 MB (0.0%)

github-actions · 2026-07-29T18:31:53Z

Benchmarks: TPC-H SF=1 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.4%
Engines: DataFusion No clear signal (+4.0%, environment too noisy confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): 1.036x ➖
Parquet (geomean): 1.012x ➖
Shifts: Parquet (control) +1.2% · Median polish +2.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.045x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	55731631	52579065	1.06
tpch_q02/datafusion:vortex-file-compressed	22501990	22069019	1.02
tpch_q03/datafusion:vortex-file-compressed	31937059	31209147	1.02
tpch_q04/datafusion:vortex-file-compressed	19654099	19635164	1.00
tpch_q05/datafusion:vortex-file-compressed	49339145	45292779	1.09
tpch_q06/datafusion:vortex-file-compressed	10997550	10471981	1.05
tpch_q07/datafusion:vortex-file-compressed	54253862	51813680	1.05
tpch_q08/datafusion:vortex-file-compressed	40098391	38887041	1.03
tpch_q09/datafusion:vortex-file-compressed	52547857	48999549	1.07
tpch_q10/datafusion:vortex-file-compressed	33926607	32144186	1.06
tpch_q11/datafusion:vortex-file-compressed	16093799	15557809	1.03
tpch_q12/datafusion:vortex-file-compressed	24622204	23925708	1.03
tpch_q13/datafusion:vortex-file-compressed	25243972	24288887	1.04
tpch_q14/datafusion:vortex-file-compressed	15369757	14691368	1.05
tpch_q15/datafusion:vortex-file-compressed	23641886	22855733	1.03
tpch_q16/datafusion:vortex-file-compressed	19504732	18715419	1.04
tpch_q17/datafusion:vortex-file-compressed	68431436	62769146	1.09
tpch_q18/datafusion:vortex-file-compressed	76069719	73425327	1.04
tpch_q19/datafusion:vortex-file-compressed	20362690	19235982	1.06
tpch_q20/datafusion:vortex-file-compressed	29782694	29283334	1.02
tpch_q21/datafusion:vortex-file-compressed	71634099	67621536	1.06
tpch_q22/datafusion:vortex-file-compressed	12276149	11547150	1.06

datafusion / parquet (1.005x ➖, 0↑ 1↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	115643879	128106524	0.90
tpch_q02/datafusion:parquet	62255888	59059558	1.05
tpch_q03/datafusion:parquet	82493259	81160710	1.02
tpch_q04/datafusion:parquet	47705472	47451022	1.01
tpch_q05/datafusion:parquet	89499382	91159621	0.98
tpch_q06/datafusion:parquet	38616570	40313808	0.96
tpch_q07/datafusion:parquet	97409664	97978909	0.99
tpch_q08/datafusion:parquet	99300684	92371027	1.08
tpch_q09/datafusion:parquet	120871184	127888793	0.95
tpch_q10/datafusion:parquet	118753272	116095300	1.02
tpch_q11/datafusion:parquet	43034744	41421069	1.04
tpch_q12/datafusion:parquet	83753222	87392863	0.96
tpch_q13/datafusion:parquet	196162692	194932953	1.01
tpch_q14/datafusion:parquet 🚨	47591274	40913013	1.16
tpch_q15/datafusion:parquet	62180637	59251486	1.05
tpch_q16/datafusion:parquet	42987654	42291964	1.02
tpch_q17/datafusion:parquet	142218356	142714961	1.00
tpch_q18/datafusion:parquet	158797613	155976011	1.02
tpch_q19/datafusion:parquet	73499245	77891543	0.94
tpch_q20/datafusion:parquet	76266696	74807545	1.02
tpch_q21/datafusion:parquet	135778747	144059420	0.94
tpch_q22/datafusion:parquet	46515593	45107562	1.03

duckdb / vortex-file-compressed (1.028x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	29331299	28602512	1.03
tpch_q02/duckdb:vortex-file-compressed	25429792	24317924	1.05
tpch_q03/duckdb:vortex-file-compressed	33134341	31914832	1.04
tpch_q04/duckdb:vortex-file-compressed	28690733	27602770	1.04
tpch_q05/duckdb:vortex-file-compressed	35968770	35076636	1.03
tpch_q06/duckdb:vortex-file-compressed	8917226	8966883	0.99
tpch_q07/duckdb:vortex-file-compressed	33450673	33089046	1.01
tpch_q08/duckdb:vortex-file-compressed	40033300	39198880	1.02
tpch_q09/duckdb:vortex-file-compressed	56563432	54016995	1.05
tpch_q10/duckdb:vortex-file-compressed	42294045	41765260	1.01
tpch_q11/duckdb:vortex-file-compressed	13916660	13479592	1.03
tpch_q12/duckdb:vortex-file-compressed	23719711	22312125	1.06
tpch_q13/duckdb:vortex-file-compressed	40458195	39346041	1.03
tpch_q14/duckdb:vortex-file-compressed	19798017	19543777	1.01
tpch_q15/duckdb:vortex-file-compressed	16834651	16430457	1.02
tpch_q16/duckdb:vortex-file-compressed	27649610	26959124	1.03
tpch_q17/duckdb:vortex-file-compressed	23768927	23337613	1.02
tpch_q18/duckdb:vortex-file-compressed	51595506	50733506	1.02
tpch_q19/duckdb:vortex-file-compressed	29116541	28014683	1.04
tpch_q20/duckdb:vortex-file-compressed	32100903	31072920	1.03
tpch_q21/duckdb:vortex-file-compressed	102480846	101359735	1.01
tpch_q22/duckdb:vortex-file-compressed	16846515	16112182	1.05

duckdb / parquet (1.019x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	70746303	70006224	1.01
tpch_q02/duckdb:parquet	40525477	39801775	1.02
tpch_q03/duckdb:parquet	71131682	70977635	1.00
tpch_q04/duckdb:parquet	51134397	49767307	1.03
tpch_q05/duckdb:parquet	69144933	68439408	1.01
tpch_q06/duckdb:parquet	21896756	21543927	1.02
tpch_q07/duckdb:parquet	71273006	69259545	1.03
tpch_q08/duckdb:parquet	83207550	82898863	1.00
tpch_q09/duckdb:parquet	161657450	160963678	1.00
tpch_q10/duckdb:parquet	127118591	125407266	1.01
tpch_q11/duckdb:parquet	23200607	22722557	1.02
tpch_q12/duckdb:parquet	47008680	46001074	1.02
tpch_q13/duckdb:parquet	265104077	251546410	1.05
tpch_q14/duckdb:parquet	50442933	49424866	1.02
tpch_q15/duckdb:parquet	27579734	26701177	1.03
tpch_q16/duckdb:parquet	59751203	58158593	1.03
tpch_q17/duckdb:parquet	50559137	50519874	1.00
tpch_q18/duckdb:parquet	117441668	116091955	1.01
tpch_q19/duckdb:parquet	72019151	69051406	1.04
tpch_q20/duckdb:parquet	66814614	66322631	1.01
tpch_q21/duckdb:parquet	166616055	162227299	1.03
tpch_q22/duckdb:parquet	55920009	55570475	1.01

File Size Changes (9 files changed, -43.9% overall, 0↑ 9↓)

File	Scale	Format	Base	Change	%
customer.vortex	1.0	vortex-compact	7.40 MB	7.40 MB	-100.0%
duckdb.db	1.0	vortex-compact	268.00 KB	268.00 KB	-100.0%
lineitem.vortex	1.0	vortex-compact	126.00 MB	126.00 MB	-100.0%
nation.vortex	1.0	vortex-compact	8.01 KB	8.01 KB	-100.0%
orders.vortex	1.0	vortex-compact	31.73 MB	31.73 MB	-100.0%
part.vortex	1.0	vortex-compact	3.55 MB	3.55 MB	-100.0%
partsupp.vortex	1.0	vortex-compact	20.29 MB	20.29 MB	-100.0%
region.vortex	1.0	vortex-compact	6.04 KB	6.04 KB	-100.0%
supplier.vortex	1.0	vortex-compact	496.67 KB	496.67 KB	-100.0%

Totals:

vortex-compact: 189.73 MB → 0 B (-100.0%)
vortex-file-compressed: 242.85 MB → 242.85 MB (0.0%)

github-actions · 2026-07-29T18:32:01Z

Benchmarks: FineWeb NVMe 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.5%
Engines: DataFusion No clear signal (-3.0%, low confidence) · DuckDB No clear signal (-4.1%, low confidence)
Vortex (geomean): 0.921x ➖
Parquet (geomean): 0.955x ➖
Shifts: Parquet (control) -4.5% · Median polish -4.9%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.932x ➖, 3↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀	4812669	5392094	0.89
fineweb_q01/datafusion:vortex-file-compressed	30962925	31387875	0.99
fineweb_q02/datafusion:vortex-file-compressed	36115979	37351674	0.97
fineweb_q03/datafusion:vortex-file-compressed 🚀	53747118	59804116	0.90
fineweb_q04/datafusion:vortex-file-compressed	238657939	255436320	0.93
fineweb_q05/datafusion:vortex-file-compressed	183426604	194733370	0.94
fineweb_q06/datafusion:vortex-file-compressed	49267525	52593280	0.94
fineweb_q07/datafusion:vortex-file-compressed	52723754	55110459	0.96
fineweb_q08/datafusion:vortex-file-compressed 🚀	19137199	21747166	0.88

datafusion / parquet (0.961x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet	7000906	6947275	1.01
fineweb_q01/datafusion:parquet	296919061	309685641	0.96
fineweb_q02/datafusion:parquet	298223205	311132263	0.96
fineweb_q03/datafusion:parquet	288718813	300124041	0.96
fineweb_q04/datafusion:parquet	310893269	325215220	0.96
fineweb_q05/datafusion:parquet	299726054	322820093	0.93
fineweb_q06/datafusion:parquet	289308208	303779711	0.95
fineweb_q07/datafusion:parquet	286204186	301769156	0.95
fineweb_q08/datafusion:parquet	286817547	292632118	0.98

duckdb / vortex-file-compressed (0.911x ➖, 3↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀	3380654	3867898	0.87
fineweb_q01/duckdb:vortex-file-compressed	32296330	35431511	0.91
fineweb_q02/duckdb:vortex-file-compressed	36411236	39196095	0.93
fineweb_q03/duckdb:vortex-file-compressed	98548290	102687066	0.96
fineweb_q04/duckdb:vortex-file-compressed	243938361	257859275	0.95
fineweb_q05/duckdb:vortex-file-compressed	181644255	194029524	0.94
fineweb_q06/duckdb:vortex-file-compressed 🚀	50542022	57988109	0.87
fineweb_q07/duckdb:vortex-file-compressed	52517194	56938496	0.92
fineweb_q08/duckdb:vortex-file-compressed 🚀	21107763	24816495	0.85

duckdb / parquet (0.949x ➖, 1↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	31863893	34752600	0.92
fineweb_q01/duckdb:parquet	88494828	95087649	0.93
fineweb_q02/duckdb:parquet	88650323	93555225	0.95
fineweb_q03/duckdb:parquet	315821850	328167501	0.96
fineweb_q04/duckdb:parquet	448846816	455067227	0.99
fineweb_q05/duckdb:parquet	416616283	427337232	0.97
fineweb_q06/duckdb:parquet	205598672	213893357	0.96
fineweb_q07/duckdb:parquet	218656850	224816842	0.97
fineweb_q08/duckdb:parquet 🚀	37336525	41769877	0.89

File Size Changes (2 files changed, -46.3% overall, 0↑ 2↓)

File	Scale	Format	Base	HEAD	Change	%
duckdb.db	1.0	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%
sample.vortex	1.0	vortex-compact	1.23 GB	0 B	1.23 GB	-100.0%

Totals:

vortex-compact: 1.23 GB → 0 B (-100.0%)
vortex-file-compressed: 1.43 GB → 1.43 GB (0.0%)

github-actions · 2026-07-29T18:37:08Z

Benchmarks: Statistical and Population Genetics 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.009x ➖
Shifts: Parquet (control) +0.9% · Median polish +1.6%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed (1.005x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed	12384549	12009682	1.03
statpopgen_q01/duckdb:vortex-file-compressed	13133230	12397932	1.06
statpopgen_q02/duckdb:vortex-file-compressed	534332095	523147423	1.02
statpopgen_q03/duckdb:vortex-file-compressed	1077674515	1044749732	1.03
statpopgen_q04/duckdb:vortex-file-compressed	1032070352	1046336921	0.99
statpopgen_q05/duckdb:vortex-file-compressed	461325972	501228469	0.92
statpopgen_q06/duckdb:vortex-file-compressed	1518219729	1506568682	1.01
statpopgen_q07/duckdb:vortex-file-compressed	197820357	205832685	0.96
statpopgen_q08/duckdb:vortex-file-compressed	231223895	224808985	1.03
statpopgen_q09/duckdb:vortex-file-compressed	824709376	820829173	1.00
statpopgen_q10/duckdb:vortex-file-compressed	2557112403	2520324055	1.01

duckdb / parquet (1.009x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
statpopgen_q00/duckdb:parquet	341387558	335268822	1.02
statpopgen_q01/duckdb:parquet	421190533	420773368	1.00
statpopgen_q02/duckdb:parquet	814456322	793503604	1.03
statpopgen_q03/duckdb:parquet	1235950788	1222939730	1.01
statpopgen_q04/duckdb:parquet	1252684989	1235904228	1.01
statpopgen_q05/duckdb:parquet	849779145	846814891	1.00
statpopgen_q06/duckdb:parquet	1486235739	1450425011	1.02
statpopgen_q07/duckdb:parquet	904654685	907869183	1.00
statpopgen_q08/duckdb:parquet	927318107	918833169	1.01
statpopgen_q09/duckdb:parquet	1060191609	1047495419	1.01
statpopgen_q10/duckdb:parquet	2255037388	2287391952	0.99

File Size Changes (2 files changed, -32.3% overall, 0↑ 2↓)

File	Scale	Format	Base	HEAD	Change	%
duckdb.db	100000	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex	100000	vortex-compact	960.66 MB	0 B	960.66 MB	-100.0%

Totals:

vortex-compact: 960.92 MB → 0 B (-100.0%)
vortex-file-compressed: 1.96 GB → 1.96 GB (0.0%)

github-actions · 2026-07-29T18:37:24Z

Benchmarks: TPC-H SF=1 on S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (+0.8%, environment too noisy confidence) · DuckDB No clear signal (-1.6%, environment too noisy confidence)
Vortex (geomean): 1.087x ➖
Parquet (geomean): 1.092x ➖
Shifts: Parquet (control) +9.2% · Median polish +8.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.092x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed	264603117	264433703	1.00
tpch_q02/datafusion:vortex-file-compressed	444234081	420197478	1.06
tpch_q03/datafusion:vortex-file-compressed	398615610	357756907	1.11
tpch_q04/datafusion:vortex-file-compressed	201314978	184358857	1.09
tpch_q05/datafusion:vortex-file-compressed	450147440	356934555	1.26
tpch_q06/datafusion:vortex-file-compressed	307842926	287007913	1.07
tpch_q07/datafusion:vortex-file-compressed	516654823	490604950	1.05
tpch_q08/datafusion:vortex-file-compressed	562538977	601968092	0.93
tpch_q09/datafusion:vortex-file-compressed	479112846	387756502	1.24
tpch_q10/datafusion:vortex-file-compressed	392099025	366322421	1.07
tpch_q11/datafusion:vortex-file-compressed	297496680	291168504	1.02
tpch_q12/datafusion:vortex-file-compressed	424705177	360345113	1.18
tpch_q13/datafusion:vortex-file-compressed	204634125	196661566	1.04
tpch_q14/datafusion:vortex-file-compressed	195529978	170805172	1.14
tpch_q15/datafusion:vortex-file-compressed	373382118	306252830	1.22
tpch_q16/datafusion:vortex-file-compressed	207784165	204732975	1.01
tpch_q17/datafusion:vortex-file-compressed	363856556	355896972	1.02
tpch_q18/datafusion:vortex-file-compressed	336336936	326970573	1.03
tpch_q19/datafusion:vortex-file-compressed	449950415	437267224	1.03
tpch_q20/datafusion:vortex-file-compressed	443339653	396886477	1.12
tpch_q21/datafusion:vortex-file-compressed	586303509	533416856	1.10
tpch_q22/datafusion:vortex-file-compressed	184051598	143237649	1.28

datafusion / parquet (1.083x ➖, 0↑ 3↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet	241003411	237385927	1.02
tpch_q02/datafusion:parquet	270230282	278128327	0.97
tpch_q03/datafusion:parquet	302788443	320996075	0.94
tpch_q04/datafusion:parquet	192122098	200379296	0.96
tpch_q05/datafusion:parquet	397418008	360911194	1.10
tpch_q06/datafusion:parquet 🚨	203439182	141616263	1.44
tpch_q07/datafusion:parquet	410939660	361249621	1.14
tpch_q08/datafusion:parquet	428011513	426077921	1.00
tpch_q09/datafusion:parquet	477072732	427776789	1.12
tpch_q10/datafusion:parquet	454078402	415935231	1.09
tpch_q11/datafusion:parquet 🚨	355299294	270895888	1.31
tpch_q12/datafusion:parquet 🚨	248462137	179114909	1.39
tpch_q13/datafusion:parquet	506561788	425493541	1.19
tpch_q14/datafusion:parquet	176975826	167556741	1.06
tpch_q15/datafusion:parquet	301282643	276278809	1.09
tpch_q16/datafusion:parquet	139160835	112170245	1.24
tpch_q17/datafusion:parquet	323019098	309159938	1.04
tpch_q18/datafusion:parquet	435774082	439643900	0.99
tpch_q19/datafusion:parquet	198178279	201643750	0.98
tpch_q20/datafusion:parquet	285317192	263557209	1.08
tpch_q21/datafusion:parquet	413844001	476945773	0.87
tpch_q22/datafusion:parquet	178393051	178719034	1.00

duckdb / vortex-file-compressed (1.083x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	322395383	304270306	1.06
tpch_q02/duckdb:vortex-file-compressed	1021632191	951222118	1.07
tpch_q03/duckdb:vortex-file-compressed	668783300	595186132	1.12
tpch_q04/duckdb:vortex-file-compressed	335875729	368885047	0.91
tpch_q05/duckdb:vortex-file-compressed	815724312	739351055	1.10
tpch_q06/duckdb:vortex-file-compressed	382437121	310902266	1.23
tpch_q07/duckdb:vortex-file-compressed	834753283	802745455	1.04
tpch_q08/duckdb:vortex-file-compressed	1067297085	1032577979	1.03
tpch_q09/duckdb:vortex-file-compressed	913465513	831381103	1.10
tpch_q10/duckdb:vortex-file-compressed	793504305	724862659	1.09
tpch_q11/duckdb:vortex-file-compressed	535340561	476896809	1.12
tpch_q12/duckdb:vortex-file-compressed	605630933	526515651	1.15
tpch_q13/duckdb:vortex-file-compressed	437199499	348683816	1.25
tpch_q14/duckdb:vortex-file-compressed	383457520	397385602	0.96
tpch_q15/duckdb:vortex-file-compressed	347840423	308900062	1.13
tpch_q16/duckdb:vortex-file-compressed	335293755	337038795	0.99
tpch_q17/duckdb:vortex-file-compressed	640299692	650372565	0.98
tpch_q18/duckdb:vortex-file-compressed	642397627	532271221	1.21
tpch_q19/duckdb:vortex-file-compressed	461875708	439157708	1.05
tpch_q20/duckdb:vortex-file-compressed	778510805	716178797	1.09
tpch_q21/duckdb:vortex-file-compressed	1038068867	1026532859	1.01
tpch_q22/duckdb:vortex-file-compressed	296182815	253372977	1.17

duckdb / parquet (1.100x ➖, 0↑ 1↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	351801892	319846217	1.10
tpch_q02/duckdb:parquet	710329593	747663635	0.95
tpch_q03/duckdb:parquet	863783215	816589462	1.06
tpch_q04/duckdb:parquet	551454808	448154394	1.23
tpch_q05/duckdb:parquet	1020078990	900106221	1.13
tpch_q06/duckdb:parquet	314207792	309838961	1.01
tpch_q07/duckdb:parquet	947763379	870514624	1.09
tpch_q08/duckdb:parquet	1220581301	1087640991	1.12
tpch_q09/duckdb:parquet	1140184068	1102654409	1.03
tpch_q10/duckdb:parquet	1137997168	1042498245	1.09
tpch_q11/duckdb:parquet	474583248	421644195	1.13
tpch_q12/duckdb:parquet	605327178	527051307	1.15
tpch_q13/duckdb:parquet	867886236	805630299	1.08
tpch_q14/duckdb:parquet 🚨	651666428	473862051	1.38
tpch_q15/duckdb:parquet	438245643	373564675	1.17
tpch_q16/duckdb:parquet	520320272	496647297	1.05
tpch_q17/duckdb:parquet	526236046	489410601	1.08
tpch_q18/duckdb:parquet	713830334	629835231	1.13
tpch_q19/duckdb:parquet	638992461	632402392	1.01
tpch_q20/duckdb:parquet	902846462	831354528	1.09
tpch_q21/duckdb:parquet	769710313	702463970	1.10
tpch_q22/duckdb:parquet	455507883	415408064	1.10

github-actions · 2026-07-29T18:37:28Z

Benchmarks: FineWeb S3 📖

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-2.9%, environment too noisy confidence) · DuckDB No clear signal (+3.9%, low confidence)
Vortex (geomean): 1.018x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish +3.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.991x ➖, 1↑ 1↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨	65915922	37998177	1.73
fineweb_q01/datafusion:vortex-file-compressed	493476318	605489585	0.82
fineweb_q02/datafusion:vortex-file-compressed	560974176	502261657	1.12
fineweb_q03/datafusion:vortex-file-compressed 🚀	1078324757	1615127183	0.67
fineweb_q04/datafusion:vortex-file-compressed	1141031428	1162495826	0.98
fineweb_q05/datafusion:vortex-file-compressed	1077880372	1134162042	0.95
fineweb_q06/datafusion:vortex-file-compressed	1249307965	1293851806	0.97
fineweb_q07/datafusion:vortex-file-compressed	1070371098	1074941380	1.00
fineweb_q08/datafusion:vortex-file-compressed	465298145	477404468	0.97

datafusion / parquet (1.021x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
fineweb_q00/datafusion:parquet	1244779287	1409840876	0.88
fineweb_q01/datafusion:parquet	1870819428	1783798506	1.05
fineweb_q02/datafusion:parquet	2128953830	1986633716	1.07
fineweb_q03/datafusion:parquet	1754287928	1784502521	0.98
fineweb_q04/datafusion:parquet	2022170322	1834150597	1.10
fineweb_q05/datafusion:parquet	2212505856	2676216164	0.83
fineweb_q06/datafusion:parquet	2176344882	1837599107	1.18
fineweb_q07/datafusion:parquet	1783824023	1796205828	0.99
fineweb_q08/datafusion:parquet	1997853693	1735077112	1.15

duckdb / vortex-file-compressed (1.046x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed	96871675	86232455	1.12
fineweb_q01/duckdb:vortex-file-compressed	682791520	582829588	1.17
fineweb_q02/duckdb:vortex-file-compressed	508793194	489504640	1.04
fineweb_q03/duckdb:vortex-file-compressed	1207468920	1247270738	0.97
fineweb_q04/duckdb:vortex-file-compressed	1480485512	1288549240	1.15
fineweb_q05/duckdb:vortex-file-compressed	1322479584	1231047844	1.07
fineweb_q06/duckdb:vortex-file-compressed	1352678932	1395413728	0.97
fineweb_q07/duckdb:vortex-file-compressed	1291088190	1270865587	1.02
fineweb_q08/duckdb:vortex-file-compressed	571802383	615069678	0.93

duckdb / parquet (1.006x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
fineweb_q00/duckdb:parquet	1063339628	1074595517	0.99
fineweb_q01/duckdb:parquet	1363897435	1333043424	1.02
fineweb_q02/duckdb:parquet	1338855786	1352513084	0.99
fineweb_q03/duckdb:parquet	3580074217	3756153367	0.95
fineweb_q04/duckdb:parquet	1881238944	1928963184	0.98
fineweb_q05/duckdb:parquet	2153933241	2119440265	1.02
fineweb_q06/duckdb:parquet	4541791424	4436057791	1.02
fineweb_q07/duckdb:parquet	2782935401	2589876842	1.07
fineweb_q08/duckdb:parquet	1066875379	1051942619	1.01

github-actions · 2026-07-29T18:37:42Z

Benchmarks: TPC-H SF=10 on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.4%
Engines: DataFusion No clear signal (-1.6%, low confidence) · DuckDB No clear signal (-5.1%, environment too noisy confidence)
Vortex (geomean): 0.915x ➖
Parquet (geomean): 0.947x ➖
Shifts: Parquet (control) -5.3% · Median polish -7.7%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.902x ➖, 13↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀	437673998	489059436	0.89
tpch_q02/datafusion:vortex-file-compressed 🚀	101930818	114833326	0.89
tpch_q03/datafusion:vortex-file-compressed 🚀	205525781	236804307	0.87
tpch_q04/datafusion:vortex-file-compressed 🚀	107866595	120293200	0.90
tpch_q05/datafusion:vortex-file-compressed	366618317	396220658	0.93
tpch_q06/datafusion:vortex-file-compressed	52793729	56889634	0.93
tpch_q07/datafusion:vortex-file-compressed 🚀	470991332	530535060	0.89
tpch_q08/datafusion:vortex-file-compressed	363614633	396525049	0.92
tpch_q09/datafusion:vortex-file-compressed 🚀	630823301	703764259	0.90
tpch_q10/datafusion:vortex-file-compressed	239004237	265295500	0.90
tpch_q11/datafusion:vortex-file-compressed 🚀	79640452	89035214	0.89
tpch_q12/datafusion:vortex-file-compressed	123961990	133325647	0.93
tpch_q13/datafusion:vortex-file-compressed 🚀	198829248	223027335	0.89
tpch_q14/datafusion:vortex-file-compressed	63658024	69288066	0.92
tpch_q15/datafusion:vortex-file-compressed	121475245	133038806	0.91
tpch_q16/datafusion:vortex-file-compressed 🚀	74875272	84519515	0.89
tpch_q17/datafusion:vortex-file-compressed 🚀	584500270	666120703	0.88
tpch_q18/datafusion:vortex-file-compressed 🚀	859578542	988299005	0.87
tpch_q19/datafusion:vortex-file-compressed	95143180	104015875	0.91
tpch_q20/datafusion:vortex-file-compressed 🚀	166599145	188655149	0.88
tpch_q21/datafusion:vortex-file-compressed 🚀	625912021	696062697	0.90
tpch_q22/datafusion:vortex-file-compressed	57655371	59863557	0.96

datafusion / parquet (0.916x ➖, 8↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpch_q01/datafusion:parquet 🚀	451812467	512910401	0.88
tpch_q02/datafusion:parquet	167343835	177989547	0.94
tpch_q03/datafusion:parquet	235092385	259306177	0.91
tpch_q04/datafusion:parquet	108582508	115232651	0.94
tpch_q05/datafusion:parquet	382477154	419994437	0.91
tpch_q06/datafusion:parquet	132549467	135550895	0.98
tpch_q07/datafusion:parquet 🚀	548377443	609565068	0.90
tpch_q08/datafusion:parquet 🚀	418884989	471416722	0.89
tpch_q09/datafusion:parquet 🚀	679802806	776227803	0.88
tpch_q10/datafusion:parquet 🚀	530467850	592249850	0.90
tpch_q11/datafusion:parquet	120328908	132720902	0.91
tpch_q12/datafusion:parquet	199640152	218124464	0.92
tpch_q13/datafusion:parquet	356319544	376657773	0.95
tpch_q14/datafusion:parquet	148451187	156881946	0.95
tpch_q15/datafusion:parquet 🚀	257046678	286802399	0.90
tpch_q16/datafusion:parquet 🚀	118281692	132068908	0.90
tpch_q17/datafusion:parquet 🚀	625423091	702125907	0.89
tpch_q18/datafusion:parquet	893499898	989355686	0.90
tpch_q19/datafusion:parquet	276013272	290097994	0.95
tpch_q20/datafusion:parquet	297871606	317177218	0.94
tpch_q21/datafusion:parquet	617059198	674446029	0.91
tpch_q22/datafusion:parquet	211463255	223952624	0.94

duckdb / vortex-file-compressed (0.929x ➖, 2↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed	173786471	180408506	0.96
tpch_q02/duckdb:vortex-file-compressed	52725157	56180118	0.94
tpch_q03/duckdb:vortex-file-compressed 🚀	128443208	142983117	0.90
tpch_q04/duckdb:vortex-file-compressed	158427706	175231905	0.90
tpch_q05/duckdb:vortex-file-compressed	140945223	152668215	0.92
tpch_q06/duckdb:vortex-file-compressed	39103526	42332769	0.92
tpch_q07/duckdb:vortex-file-compressed	126337167	138558875	0.91
tpch_q08/duckdb:vortex-file-compressed	164543041	182118009	0.90
tpch_q09/duckdb:vortex-file-compressed	374002397	404514047	0.92
tpch_q10/duckdb:vortex-file-compressed	200045925	210426683	0.95
tpch_q11/duckdb:vortex-file-compressed	30325088	32341757	0.94
tpch_q12/duckdb:vortex-file-compressed	109224428	116554767	0.94
tpch_q13/duckdb:vortex-file-compressed	268935165	284298424	0.95
tpch_q14/duckdb:vortex-file-compressed	53618045	55968888	0.96
tpch_q15/duckdb:vortex-file-compressed	95260468	98173257	0.97
tpch_q16/duckdb:vortex-file-compressed	77103377	83800919	0.92
tpch_q17/duckdb:vortex-file-compressed	96643797	106376754	0.91
tpch_q18/duckdb:vortex-file-compressed	286113473	303774294	0.94
tpch_q19/duckdb:vortex-file-compressed	82697034	88152629	0.94
tpch_q20/duckdb:vortex-file-compressed	143430145	155500689	0.92
tpch_q21/duckdb:vortex-file-compressed 🚀	486714375	553996234	0.88
tpch_q22/duckdb:vortex-file-compressed	64315347	67841370	0.95

duckdb / parquet (0.979x ➖, 0↑ 1↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
tpch_q01/duckdb:parquet	238844648	240052807	0.99
tpch_q02/duckdb:parquet	91153886	94387590	0.97
tpch_q03/duckdb:parquet	202174868	201427483	1.00
tpch_q04/duckdb:parquet	140816040	145691784	0.97
tpch_q05/duckdb:parquet	227956293	222646384	1.02
tpch_q06/duckdb:parquet	79085428	80332045	0.98
tpch_q07/duckdb:parquet	187506286	193680342	0.97
tpch_q08/duckdb:parquet	248168663	273556359	0.91
tpch_q09/duckdb:parquet	435229929	450839737	0.97
tpch_q10/duckdb:parquet	639350174	661545197	0.97
tpch_q11/duckdb:parquet 🚨	45742672	37524217	1.22
tpch_q12/duckdb:parquet	147516649	151083738	0.98
tpch_q13/duckdb:parquet	450572127	476367869	0.95
tpch_q14/duckdb:parquet	178632496	185832245	0.96
tpch_q15/duckdb:parquet	106152016	109722732	0.97
tpch_q16/duckdb:parquet	137431040	145401951	0.95
tpch_q17/duckdb:parquet	181398464	182829513	0.99
tpch_q18/duckdb:parquet	343523738	353746457	0.97
tpch_q19/duckdb:parquet	282979284	290957339	0.97
tpch_q20/duckdb:parquet	230489939	233900487	0.99
tpch_q21/duckdb:parquet	533475811	566198087	0.94
tpch_q22/duckdb:parquet	292364172	307753652	0.95

File Size Changes (9 files changed, -44.0% overall, 0↑ 9↓)

File	Scale	Format	Base	Change	%
customer.vortex	10.0	vortex-compact	74.00 MB	74.00 MB	-100.0%
duckdb.db	10.0	vortex-compact	268.00 KB	268.00 KB	-100.0%
lineitem.vortex	10.0	vortex-compact	1.28 GB	1.28 GB	-100.0%
nation.vortex	10.0	vortex-compact	8.01 KB	8.01 KB	-100.0%
orders.vortex	10.0	vortex-compact	344.31 MB	344.31 MB	-100.0%
part.vortex	10.0	vortex-compact	35.89 MB	35.89 MB	-100.0%
partsupp.vortex	10.0	vortex-compact	203.66 MB	203.66 MB	-100.0%
region.vortex	10.0	vortex-compact	6.04 KB	6.04 KB	-100.0%
supplier.vortex	10.0	vortex-compact	4.73 MB	4.73 MB	-100.0%

Totals:

vortex-compact: 1.92 GB → 0 B (-100.0%)
vortex-file-compressed: 2.45 GB → 2.45 GB (0.0%)

github-actions · 2026-07-29T18:37:51Z

Benchmarks: Clickbench Sorted on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.2%
Engines: DataFusion No clear signal (-5.3%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): 0.968x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish -2.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.956x ➖, 1↑ 1↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
clickbench-sorted_q23/datafusion:vortex-file-compressed 🚀	382149241	575669230	0.66
clickbench-sorted_q24/datafusion:vortex-file-compressed	21142962	22006990	0.96
clickbench-sorted_q26/datafusion:vortex-file-compressed 🚨	23275718	20616911	1.13
clickbench-sorted_q36/datafusion:vortex-file-compressed	58752307	56283760	1.04
clickbench-sorted_q37/datafusion:vortex-file-compressed	42155661	41751433	1.01
clickbench-sorted_q38/datafusion:vortex-file-compressed	41287890	44023197	0.94
clickbench-sorted_q39/datafusion:vortex-file-compressed	111002844	112218591	0.99
clickbench-sorted_q40/datafusion:vortex-file-compressed	20121938	22287333	0.90
clickbench-sorted_q41/datafusion:vortex-file-compressed	19212777	20298488	0.95
clickbench-sorted_q42/datafusion:vortex-file-compressed	14839178	14054957	1.06

datafusion / parquet (1.010x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
clickbench-sorted_q23/datafusion:parquet	4680879833	4637615151	1.01
clickbench-sorted_q24/datafusion:parquet	27318239	27256032	1.00
clickbench-sorted_q26/datafusion:parquet	28185077	27076051	1.04
clickbench-sorted_q36/datafusion:parquet	177567300	186526540	0.95
clickbench-sorted_q37/datafusion:parquet	110151326	114185120	0.96
clickbench-sorted_q38/datafusion:parquet	165839251	161378525	1.03
clickbench-sorted_q39/datafusion:parquet	300693449	304896538	0.99
clickbench-sorted_q40/datafusion:parquet	71736335	66914291	1.07
clickbench-sorted_q41/datafusion:parquet	61595377	61958381	0.99
clickbench-sorted_q42/datafusion:parquet	33332454	31652159	1.05

duckdb / vortex-file-compressed (0.980x ➖, 1↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
clickbench-sorted_q23/duckdb:vortex-file-compressed 🚀	164010589	184605081	0.89
clickbench-sorted_q24/duckdb:vortex-file-compressed	31132744	30129689	1.03
clickbench-sorted_q26/duckdb:vortex-file-compressed	46517349	49109485	0.95
clickbench-sorted_q36/duckdb:vortex-file-compressed	57449910	60335393	0.95
clickbench-sorted_q37/duckdb:vortex-file-compressed	44912025	42884677	1.05
clickbench-sorted_q38/duckdb:vortex-file-compressed	52304641	49719209	1.05
clickbench-sorted_q39/duckdb:vortex-file-compressed	104575000	111455469	0.94
clickbench-sorted_q40/duckdb:vortex-file-compressed	29097326	29032818	1.00
clickbench-sorted_q41/duckdb:vortex-file-compressed	27691523	28372148	0.98
clickbench-sorted_q42/duckdb:vortex-file-compressed	24464144	24975352	0.98

duckdb / parquet (0.990x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
clickbench-sorted_q23/duckdb:parquet	202743466	201848792	1.00
clickbench-sorted_q24/duckdb:parquet	28221012	28987619	0.97
clickbench-sorted_q26/duckdb:parquet	23390741	24845881	0.94
clickbench-sorted_q36/duckdb:parquet	109804208	113442996	0.97
clickbench-sorted_q37/duckdb:parquet	94222950	93536271	1.01
clickbench-sorted_q38/duckdb:parquet	95394331	96933638	0.98
clickbench-sorted_q39/duckdb:parquet	178593899	179880737	0.99
clickbench-sorted_q40/duckdb:parquet	42735569	41751565	1.02
clickbench-sorted_q41/duckdb:parquet	42703678	41724005	1.02
clickbench-sorted_q42/duckdb:parquet	30261278	30609931	0.99

File Size Changes (201 files changed, -42.8% overall, 58↑ 143↓)

File	Scale	Format	Base	HEAD	Change	%
hits_086.vortex	1.0	vortex-file-compressed	192.10 MB	194.85 MB	+2.75 MB	+1.4%
hits_027.vortex	1.0	vortex-file-compressed	190.09 MB	192.44 MB	+2.35 MB	+1.2%
hits_074.vortex	1.0	vortex-file-compressed	197.87 MB	199.21 MB	+1.34 MB	+0.7%
hits_069.vortex	1.0	vortex-file-compressed	142.30 MB	143.16 MB	+881.21 KB	+0.6%
hits_059.vortex	1.0	vortex-file-compressed	197.95 MB	199.04 MB	+1.08 MB	+0.5%
hits_076.vortex	1.0	vortex-file-compressed	161.01 MB	161.51 MB	+515.18 KB	+0.3%
hits_057.vortex	1.0	vortex-file-compressed	160.09 MB	160.57 MB	+491.76 KB	+0.3%
hits_026.vortex	1.0	vortex-file-compressed	131.31 MB	131.69 MB	+384.66 KB	+0.3%
hits_031.vortex	1.0	vortex-file-compressed	159.80 MB	160.24 MB	+454.50 KB	+0.3%
hits_020.vortex	1.0	vortex-file-compressed	160.53 MB	160.93 MB	+414.76 KB	+0.3%
hits_042.vortex	1.0	vortex-file-compressed	201.67 MB	202.17 MB	+511.49 KB	+0.2%
hits_028.vortex	1.0	vortex-file-compressed	151.92 MB	152.26 MB	+355.74 KB	+0.2%
hits_032.vortex	1.0	vortex-file-compressed	154.75 MB	155.10 MB	+353.70 KB	+0.2%
hits_000.vortex	1.0	vortex-file-compressed	131.45 MB	131.74 MB	+295.69 KB	+0.2%
hits_049.vortex	1.0	vortex-file-compressed	191.31 MB	191.72 MB	+416.22 KB	+0.2%
hits_098.vortex	1.0	vortex-file-compressed	137.49 MB	137.76 MB	+274.63 KB	+0.2%
hits_060.vortex	1.0	vortex-file-compressed	193.10 MB	193.42 MB	+328.74 KB	+0.2%
hits_036.vortex	1.0	vortex-file-compressed	171.20 MB	171.48 MB	+289.54 KB	+0.2%
hits_088.vortex	1.0	vortex-file-compressed	171.97 MB	172.22 MB	+249.82 KB	+0.1%
hits_023.vortex	1.0	vortex-file-compressed	195.26 MB	195.52 MB	+268.09 KB	+0.1%
hits_041.vortex	1.0	vortex-file-compressed	131.17 MB	131.34 MB	+177.29 KB	+0.1%
hits_012.vortex	1.0	vortex-file-compressed	191.00 MB	191.24 MB	+240.88 KB	+0.1%
hits_094.vortex	1.0	vortex-file-compressed	158.69 MB	158.85 MB	+169.20 KB	+0.1%
hits_070.vortex	1.0	vortex-file-compressed	199.87 MB	200.05 MB	+182.87 KB	+0.1%
hits_055.vortex	1.0	vortex-file-compressed	198.26 MB	198.42 MB	+167.05 KB	+0.1%
hits_054.vortex	1.0	vortex-file-compressed	146.96 MB	147.07 MB	+122.46 KB	+0.1%
hits_022.vortex	1.0	vortex-file-compressed	198.91 MB	199.06 MB	+156.31 KB	+0.1%
hits_002.vortex	1.0	vortex-file-compressed	160.93 MB	161.05 MB	+121.95 KB	+0.1%
hits_018.vortex	1.0	vortex-file-compressed	199.38 MB	199.53 MB	+149.30 KB	+0.1%
hits_058.vortex	1.0	vortex-file-compressed	155.28 MB	155.39 MB	+115.90 KB	+0.1%
hits_075.vortex	1.0	vortex-file-compressed	189.45 MB	189.58 MB	+129.88 KB	+0.1%
hits_096.vortex	1.0	vortex-file-compressed	199.48 MB	199.61 MB	+131.71 KB	+0.1%
hits_077.vortex	1.0	vortex-file-compressed	172.37 MB	172.48 MB	+111.70 KB	+0.1%
hits_047.vortex	1.0	vortex-file-compressed	154.47 MB	154.57 MB	+98.92 KB	+0.1%
hits_083.vortex	1.0	vortex-file-compressed	157.13 MB	157.22 MB	+95.69 KB	+0.1%
hits_071.vortex	1.0	vortex-file-compressed	140.84 MB	140.92 MB	+83.54 KB	+0.1%
hits_024.vortex	1.0	vortex-file-compressed	160.55 MB	160.64 MB	+91.95 KB	+0.1%
hits_014.vortex	1.0	vortex-file-compressed	172.14 MB	172.24 MB	+98.30 KB	+0.1%
hits_061.vortex	1.0	vortex-file-compressed	160.90 MB	160.99 MB	+89.10 KB	+0.1%
hits_084.vortex	1.0	vortex-file-compressed	154.43 MB	154.51 MB	+84.53 KB	+0.1%
hits_089.vortex	1.0	vortex-file-compressed	131.49 MB	131.56 MB	+64.25 KB	+0.0%
hits_095.vortex	1.0	vortex-file-compressed	154.63 MB	154.70 MB	+74.84 KB	+0.0%
hits_079.vortex	1.0	vortex-file-compressed	181.03 MB	181.10 MB	+65.97 KB	+0.0%
hits_085.vortex	1.0	vortex-file-compressed	199.80 MB	199.87 MB	+67.78 KB	+0.0%
hits_013.vortex	1.0	vortex-file-compressed	161.22 MB	161.27 MB	+54.62 KB	+0.0%
hits_015.vortex	1.0	vortex-file-compressed	131.19 MB	131.23 MB	+36.45 KB	+0.0%
hits_008.vortex	1.0	vortex-file-compressed	139.98 MB	140.01 MB	+35.76 KB	+0.0%
hits_093.vortex	1.0	vortex-file-compressed	131.57 MB	131.59 MB	+26.38 KB	+0.0%
hits_064.vortex	1.0	vortex-file-compressed	190.96 MB	191.00 MB	+37.47 KB	+0.0%
hits_009.vortex	1.0	vortex-file-compressed	101.28 MB	101.30 MB	+16.22 KB	+0.0%
hits_029.vortex	1.0	vortex-file-compressed	199.89 MB	199.92 MB	+30.16 KB	+0.0%
hits_097.vortex	1.0	vortex-file-compressed	192.84 MB	192.86 MB	+28.13 KB	+0.0%
hits_039.vortex	1.0	vortex-file-compressed	161.12 MB	161.14 MB	+22.77 KB	+0.0%
hits_092.vortex	1.0	vortex-file-compressed	199.51 MB	199.53 MB	+23.99 KB	+0.0%
hits_051.vortex	1.0	vortex-file-compressed	172.40 MB	172.42 MB	+19.45 KB	+0.0%
hits_063.vortex	1.0	vortex-file-compressed	131.97 MB	131.99 MB	+13.93 KB	+0.0%
hits_025.vortex	1.0	vortex-file-compressed	171.97 MB	171.99 MB	+17.06 KB	+0.0%
hits_019.vortex	1.0	vortex-file-compressed	140.82 MB	140.82 MB	+1.41 KB	+0.0%
hits_006.vortex	1.0	vortex-file-compressed	126.36 MB	126.36 MB	424 B	-0.0%
hits_016.vortex	1.0	vortex-file-compressed	180.63 MB	180.62 MB	4.16 KB	-0.0%
hits_037.vortex	1.0	vortex-file-compressed	177.21 MB	177.21 MB	4.25 KB	-0.0%
hits_056.vortex	1.0	vortex-file-compressed	135.72 MB	135.70 MB	14.96 KB	-0.0%
hits_021.vortex	1.0	vortex-file-compressed	154.49 MB	154.47 MB	19.47 KB	-0.0%
hits_017.vortex	1.0	vortex-file-compressed	146.86 MB	146.84 MB	19.52 KB	-0.0%
hits_044.vortex	1.0	vortex-file-compressed	200.05 MB	200.01 MB	44.05 KB	-0.0%
hits_078.vortex	1.0	vortex-file-compressed	131.15 MB	131.12 MB	31.86 KB	-0.0%
hits_073.vortex	1.0	vortex-file-compressed	172.93 MB	172.87 MB	55.53 KB	-0.0%
hits_090.vortex	1.0	vortex-file-compressed	192.75 MB	192.67 MB	80.97 KB	-0.0%
hits_050.vortex	1.0	vortex-file-compressed	161.12 MB	161.06 MB	67.76 KB	-0.0%
hits_068.vortex	1.0	vortex-file-compressed	160.47 MB	160.40 MB	72.33 KB	-0.0%
hits_004.vortex	1.0	vortex-file-compressed	131.59 MB	131.52 MB	67.83 KB	-0.1%
hits_007.vortex	1.0	vortex-file-compressed	200.18 MB	200.07 MB	118.05 KB	-0.1%
hits_030.vortex	1.0	vortex-file-compressed	131.93 MB	131.85 MB	82.12 KB	-0.1%
hits_034.vortex	1.0	vortex-file-compressed	182.22 MB	182.10 MB	121.49 KB	-0.1%
hits_048.vortex	1.0	vortex-file-compressed	198.26 MB	198.13 MB	132.37 KB	-0.1%
hits_011.vortex	1.0	vortex-file-compressed	200.01 MB	199.88 MB	133.74 KB	-0.1%
hits_065.vortex	1.0	vortex-file-compressed	161.27 MB	161.16 MB	113.23 KB	-0.1%
hits_052.vortex	1.0	vortex-file-compressed	130.89 MB	130.78 MB	107.10 KB	-0.1%
hits_010.vortex	1.0	vortex-file-compressed	169.19 MB	169.04 MB	150.28 KB	-0.1%
hits_045.vortex	1.0	vortex-file-compressed	140.91 MB	140.76 MB	149.46 KB	-0.1%
hits_080.vortex	1.0	vortex-file-compressed	126.94 MB	126.79 MB	154.17 KB	-0.1%
hits_043.vortex	1.0	vortex-file-compressed	126.63 MB	126.48 MB	155.16 KB	-0.1%
hits_046.vortex	1.0	vortex-file-compressed	101.36 MB	101.24 MB	125.02 KB	-0.1%
hits_087.vortex	1.0	vortex-file-compressed	161.00 MB	160.80 MB	205.93 KB	-0.1%
hits_062.vortex	1.0	vortex-file-compressed	170.90 MB	170.64 MB	262.89 KB	-0.2%
hits_081.vortex	1.0	vortex-file-compressed	199.90 MB	199.59 MB	321.52 KB	-0.2%
hits_067.vortex	1.0	vortex-file-compressed	132.13 MB	131.89 MB	252.78 KB	-0.2%
hits_099.vortex	1.0	vortex-file-compressed	171.77 MB	171.42 MB	349.49 KB	-0.2%
hits_072.vortex	1.0	vortex-file-compressed	102.46 MB	102.25 MB	217.75 KB	-0.2%
hits_005.vortex	1.0	vortex-file-compressed	167.99 MB	167.56 MB	441.40 KB	-0.3%
hits_082.vortex	1.0	vortex-file-compressed	140.45 MB	140.03 MB	429.30 KB	-0.3%
hits_091.vortex	1.0	vortex-file-compressed	147.59 MB	147.10 MB	496.79 KB	-0.3%
hits_035.vortex	1.0	vortex-file-compressed	103.03 MB	102.68 MB	358.26 KB	-0.3%
hits_040.vortex	1.0	vortex-file-compressed	143.74 MB	143.12 MB	635.48 KB	-0.4%
hits_003.vortex	1.0	vortex-file-compressed	137.29 MB	136.61 MB	696.47 KB	-0.5%
hits_033.vortex	1.0	vortex-file-compressed	200.55 MB	199.30 MB	1.26 MB	-0.6%
hits_053.vortex	1.0	vortex-file-compressed	192.09 MB	190.35 MB	1.74 MB	-0.9%
hits_066.vortex	1.0	vortex-file-compressed	165.03 MB	163.24 MB	1.79 MB	-1.1%
hits_001.vortex	1.0	vortex-file-compressed	193.42 MB	191.10 MB	2.32 MB	-1.2%
hits_038.vortex	1.0	vortex-file-compressed	192.75 MB	189.98 MB	2.76 MB	-1.4%
duckdb.db	1.0	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%
hits_000.vortex	1.0	vortex-compact	99.68 MB	0 B	99.68 MB	-100.0%
hits_001.vortex	1.0	vortex-compact	139.19 MB	0 B	139.19 MB	-100.0%
hits_002.vortex	1.0	vortex-compact	125.40 MB	0 B	125.40 MB	-100.0%
hits_003.vortex	1.0	vortex-compact	104.53 MB	0 B	104.53 MB	-100.0%
hits_004.vortex	1.0	vortex-compact	98.71 MB	0 B	98.71 MB	-100.0%
hits_005.vortex	1.0	vortex-compact	115.84 MB	0 B	115.84 MB	-100.0%
hits_006.vortex	1.0	vortex-compact	93.96 MB	0 B	93.96 MB	-100.0%
hits_007.vortex	1.0	vortex-compact	153.72 MB	0 B	153.72 MB	-100.0%
hits_008.vortex	1.0	vortex-compact	105.71 MB	0 B	105.71 MB	-100.0%
hits_009.vortex	1.0	vortex-compact	75.24 MB	0 B	75.24 MB	-100.0%
hits_010.vortex	1.0	vortex-compact	123.45 MB	0 B	123.45 MB	-100.0%
hits_011.vortex	1.0	vortex-compact	153.05 MB	0 B	153.05 MB	-100.0%
hits_012.vortex	1.0	vortex-compact	139.99 MB	0 B	139.99 MB	-100.0%
hits_013.vortex	1.0	vortex-compact	125.48 MB	0 B	125.48 MB	-100.0%
hits_014.vortex	1.0	vortex-compact	133.77 MB	0 B	133.77 MB	-100.0%
hits_015.vortex	1.0	vortex-compact	97.37 MB	0 B	97.37 MB	-100.0%
hits_016.vortex	1.0	vortex-compact	127.39 MB	0 B	127.39 MB	-100.0%
hits_017.vortex	1.0	vortex-compact	111.89 MB	0 B	111.89 MB	-100.0%
hits_018.vortex	1.0	vortex-compact	153.02 MB	0 B	153.02 MB	-100.0%
hits_019.vortex	1.0	vortex-compact	106.67 MB	0 B	106.67 MB	-100.0%
hits_020.vortex	1.0	vortex-compact	111.74 MB	0 B	111.74 MB	-100.0%
hits_021.vortex	1.0	vortex-compact	110.66 MB	0 B	110.66 MB	-100.0%
hits_022.vortex	1.0	vortex-compact	153.12 MB	0 B	153.12 MB	-100.0%
hits_023.vortex	1.0	vortex-compact	142.72 MB	0 B	142.72 MB	-100.0%
hits_024.vortex	1.0	vortex-compact	125.32 MB	0 B	125.32 MB	-100.0%
hits_025.vortex	1.0	vortex-compact	133.48 MB	0 B	133.48 MB	-100.0%
hits_026.vortex	1.0	vortex-compact	98.36 MB	0 B	98.36 MB	-100.0%
hits_027.vortex	1.0	vortex-compact	138.07 MB	0 B	138.07 MB	-100.0%
hits_028.vortex	1.0	vortex-compact	115.68 MB	0 B	115.68 MB	-100.0%
hits_029.vortex	1.0	vortex-compact	153.34 MB	0 B	153.34 MB	-100.0%
hits_030.vortex	1.0	vortex-compact	98.07 MB	0 B	98.07 MB	-100.0%
hits_031.vortex	1.0	vortex-compact	111.18 MB	0 B	111.18 MB	-100.0%
hits_032.vortex	1.0	vortex-compact	110.60 MB	0 B	110.60 MB	-100.0%
hits_033.vortex	1.0	vortex-compact	153.63 MB	0 B	153.63 MB	-100.0%
hits_034.vortex	1.0	vortex-compact	133.35 MB	0 B	133.35 MB	-100.0%
hits_035.vortex	1.0	vortex-compact	75.97 MB	0 B	75.97 MB	-100.0%
hits_036.vortex	1.0	vortex-compact	133.24 MB	0 B	133.24 MB	-100.0%
hits_037.vortex	1.0	vortex-compact	132.56 MB	0 B	132.56 MB	-100.0%
hits_038.vortex	1.0	vortex-compact	139.43 MB	0 B	139.43 MB	-100.0%
hits_039.vortex	1.0	vortex-compact	124.21 MB	0 B	124.21 MB	-100.0%
hits_040.vortex	1.0	vortex-compact	110.03 MB	0 B	110.03 MB	-100.0%
hits_041.vortex	1.0	vortex-compact	98.57 MB	0 B	98.57 MB	-100.0%
hits_042.vortex	1.0	vortex-compact	136.60 MB	0 B	136.60 MB	-100.0%
hits_043.vortex	1.0	vortex-compact	94.12 MB	0 B	94.12 MB	-100.0%
hits_044.vortex	1.0	vortex-compact	153.65 MB	0 B	153.65 MB	-100.0%
hits_045.vortex	1.0	vortex-compact	106.24 MB	0 B	106.24 MB	-100.0%
hits_046.vortex	1.0	vortex-compact	74.95 MB	0 B	74.95 MB	-100.0%
hits_047.vortex	1.0	vortex-compact	110.49 MB	0 B	110.49 MB	-100.0%
hits_048.vortex	1.0	vortex-compact	153.51 MB	0 B	153.51 MB	-100.0%
hits_049.vortex	1.0	vortex-compact	139.32 MB	0 B	139.32 MB	-100.0%
hits_050.vortex	1.0	vortex-compact	125.38 MB	0 B	125.38 MB	-100.0%
hits_051.vortex	1.0	vortex-compact	133.88 MB	0 B	133.88 MB	-100.0%
hits_052.vortex	1.0	vortex-compact	98.59 MB	0 B	98.59 MB	-100.0%
hits_053.vortex	1.0	vortex-compact	138.42 MB	0 B	138.42 MB	-100.0%
hits_054.vortex	1.0	vortex-compact	112.03 MB	0 B	112.03 MB	-100.0%
hits_055.vortex	1.0	vortex-compact	153.46 MB	0 B	153.46 MB	-100.0%
hits_056.vortex	1.0	vortex-compact	100.92 MB	0 B	100.92 MB	-100.0%
hits_057.vortex	1.0	vortex-compact	111.82 MB	0 B	111.82 MB	-100.0%
hits_058.vortex	1.0	vortex-compact	111.06 MB	0 B	111.06 MB	-100.0%
hits_059.vortex	1.0	vortex-compact	152.86 MB	0 B	152.86 MB	-100.0%
hits_060.vortex	1.0	vortex-compact	141.23 MB	0 B	141.23 MB	-100.0%
hits_061.vortex	1.0	vortex-compact	124.88 MB	0 B	124.88 MB	-100.0%
hits_062.vortex	1.0	vortex-compact	132.61 MB	0 B	132.61 MB	-100.0%
hits_063.vortex	1.0	vortex-compact	98.47 MB	0 B	98.47 MB	-100.0%
hits_064.vortex	1.0	vortex-compact	140.05 MB	0 B	140.05 MB	-100.0%
hits_065.vortex	1.0	vortex-compact	124.33 MB	0 B	124.33 MB	-100.0%
hits_066.vortex	1.0	vortex-compact	117.68 MB	0 B	117.68 MB	-100.0%
hits_067.vortex	1.0	vortex-compact	99.30 MB	0 B	99.30 MB	-100.0%
hits_068.vortex	1.0	vortex-compact	112.43 MB	0 B	112.43 MB	-100.0%
hits_069.vortex	1.0	vortex-compact	99.81 MB	0 B	99.81 MB	-100.0%
hits_070.vortex	1.0	vortex-compact	153.45 MB	0 B	153.45 MB	-100.0%
hits_071.vortex	1.0	vortex-compact	106.23 MB	0 B	106.23 MB	-100.0%
hits_072.vortex	1.0	vortex-compact	75.63 MB	0 B	75.63 MB	-100.0%
hits_073.vortex	1.0	vortex-compact	134.14 MB	0 B	134.14 MB	-100.0%
hits_074.vortex	1.0	vortex-compact	153.08 MB	0 B	153.08 MB	-100.0%
hits_075.vortex	1.0	vortex-compact	137.83 MB	0 B	137.83 MB	-100.0%
hits_076.vortex	1.0	vortex-compact	124.83 MB	0 B	124.83 MB	-100.0%
hits_077.vortex	1.0	vortex-compact	134.73 MB	0 B	134.73 MB	-100.0%
hits_078.vortex	1.0	vortex-compact	97.17 MB	0 B	97.17 MB	-100.0%
hits_079.vortex	1.0	vortex-compact	128.05 MB	0 B	128.05 MB	-100.0%
hits_080.vortex	1.0	vortex-compact	94.51 MB	0 B	94.51 MB	-100.0%
hits_081.vortex	1.0	vortex-compact	152.53 MB	0 B	152.53 MB	-100.0%
hits_082.vortex	1.0	vortex-compact	105.79 MB	0 B	105.79 MB	-100.0%
hits_083.vortex	1.0	vortex-compact	110.06 MB	0 B	110.06 MB	-100.0%
hits_084.vortex	1.0	vortex-compact	110.70 MB	0 B	110.70 MB	-100.0%
hits_085.vortex	1.0	vortex-compact	153.20 MB	0 B	153.20 MB	-100.0%
hits_086.vortex	1.0	vortex-compact	140.79 MB	0 B	140.79 MB	-100.0%
hits_087.vortex	1.0	vortex-compact	125.58 MB	0 B	125.58 MB	-100.0%
hits_088.vortex	1.0	vortex-compact	134.38 MB	0 B	134.38 MB	-100.0%
hits_089.vortex	1.0	vortex-compact	99.24 MB	0 B	99.24 MB	-100.0%
hits_090.vortex	1.0	vortex-compact	141.20 MB	0 B	141.20 MB	-100.0%
hits_091.vortex	1.0	vortex-compact	112.32 MB	0 B	112.32 MB	-100.0%
hits_092.vortex	1.0	vortex-compact	153.30 MB	0 B	153.30 MB	-100.0%
hits_093.vortex	1.0	vortex-compact	98.95 MB	0 B	98.95 MB	-100.0%
hits_094.vortex	1.0	vortex-compact	110.73 MB	0 B	110.73 MB	-100.0%
hits_095.vortex	1.0	vortex-compact	110.66 MB	0 B	110.66 MB	-100.0%
hits_096.vortex	1.0	vortex-compact	153.20 MB	0 B	153.20 MB	-100.0%
hits_097.vortex	1.0	vortex-compact	140.14 MB	0 B	140.14 MB	-100.0%
hits_098.vortex	1.0	vortex-compact	103.45 MB	0 B	103.45 MB	-100.0%
hits_099.vortex	1.0	vortex-compact	133.18 MB	0 B	133.18 MB	-100.0%

Totals:

vortex-compact: 11.93 GB → 0 B (-100.0%)
vortex-file-compressed: 15.97 GB → 15.97 GB (+0.0%)

github-actions · 2026-07-29T18:39:20Z

Benchmarks: Clickbench on NVME 📖

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.0%
Engines: DataFusion No clear signal (+1.7%, low confidence) · DuckDB No clear signal (+2.3%, low confidence)
Vortex (geomean): 1.023x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.6%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.022x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed	1744033	1637673	1.06
clickbench_q01/datafusion:vortex-file-compressed	17048274	16770928	1.02
clickbench_q02/datafusion:vortex-file-compressed	34718841	33637452	1.03
clickbench_q03/datafusion:vortex-file-compressed	34716478	37232883	0.93
clickbench_q04/datafusion:vortex-file-compressed	245277771	236422446	1.04
clickbench_q05/datafusion:vortex-file-compressed	312183528	300137152	1.04
clickbench_q06/datafusion:vortex-file-compressed	1708645	1649943	1.04
clickbench_q07/datafusion:vortex-file-compressed	23050510	21822928	1.06
clickbench_q08/datafusion:vortex-file-compressed	342917555	337051996	1.02
clickbench_q09/datafusion:vortex-file-compressed	464235364	444867655	1.04
clickbench_q10/datafusion:vortex-file-compressed	70944281	72516842	0.98
clickbench_q11/datafusion:vortex-file-compressed	87283829	83607733	1.04
clickbench_q12/datafusion:vortex-file-compressed	269234157	264516796	1.02
clickbench_q13/datafusion:vortex-file-compressed	428161898	408044602	1.05
clickbench_q14/datafusion:vortex-file-compressed	259963184	252700354	1.03
clickbench_q15/datafusion:vortex-file-compressed	281452328	280866627	1.00
clickbench_q16/datafusion:vortex-file-compressed	665882099	654670446	1.02
clickbench_q17/datafusion:vortex-file-compressed	652602642	647496819	1.01
clickbench_q18/datafusion:vortex-file-compressed	1362229222	1367537537	1.00
clickbench_q19/datafusion:vortex-file-compressed	25391498	25651472	0.99
clickbench_q20/datafusion:vortex-file-compressed	263425290	257063052	1.02
clickbench_q21/datafusion:vortex-file-compressed	341395343	344255043	0.99
clickbench_q22/datafusion:vortex-file-compressed	447680661	436422215	1.03
clickbench_q23/datafusion:vortex-file-compressed	607276857	553947272	1.10
clickbench_q24/datafusion:vortex-file-compressed	44776732	40929058	1.09
clickbench_q25/datafusion:vortex-file-compressed	71989441	72154282	1.00
clickbench_q26/datafusion:vortex-file-compressed	43353228	40665747	1.07
clickbench_q27/datafusion:vortex-file-compressed	378567449	374836720	1.01
clickbench_q28/datafusion:vortex-file-compressed	2334008212	2334282995	1.00
clickbench_q29/datafusion:vortex-file-compressed	52535601	48340833	1.09
clickbench_q30/datafusion:vortex-file-compressed	232301337	227472538	1.02
clickbench_q31/datafusion:vortex-file-compressed	251198188	238414354	1.05
clickbench_q32/datafusion:vortex-file-compressed	1079031609	1042275164	1.04
clickbench_q33/datafusion:vortex-file-compressed	1408285464	1367069502	1.03
clickbench_q34/datafusion:vortex-file-compressed	1380583919	1369854361	1.01
clickbench_q35/datafusion:vortex-file-compressed	245746936	245295697	1.00
clickbench_q36/datafusion:vortex-file-compressed	61350457	56573077	1.08
clickbench_q37/datafusion:vortex-file-compressed	25146042	24998795	1.01
clickbench_q38/datafusion:vortex-file-compressed	14544071	15161353	0.96
clickbench_q39/datafusion:vortex-file-compressed	122017563	121525250	1.00
clickbench_q40/datafusion:vortex-file-compressed	11617360	11995220	0.97
clickbench_q41/datafusion:vortex-file-compressed	11611832	11736129	0.99
clickbench_q42/datafusion:vortex-file-compressed	11196227	11026750	1.02

datafusion / parquet (1.005x ➖, 0↑ 1↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
clickbench_q00/datafusion:parquet	1646165	1633347	1.01
clickbench_q01/datafusion:parquet	19872931	20122165	0.99
clickbench_q02/datafusion:parquet	42882524	44423276	0.97
clickbench_q03/datafusion:parquet	36028181	35264448	1.02
clickbench_q04/datafusion:parquet	273074250	273522663	1.00
clickbench_q05/datafusion:parquet	325627267	314225897	1.04
clickbench_q06/datafusion:parquet 🚨	1764199	1582916	1.11
clickbench_q07/datafusion:parquet	20782820	21035542	0.99
clickbench_q08/datafusion:parquet	333312498	341225916	0.98
clickbench_q09/datafusion:parquet	480494860	464216070	1.04
clickbench_q10/datafusion:parquet	91611895	92494404	0.99
clickbench_q11/datafusion:parquet	117803930	114714604	1.03
clickbench_q12/datafusion:parquet	302868281	291976774	1.04
clickbench_q13/datafusion:parquet	473424175	468901236	1.01
clickbench_q14/datafusion:parquet	312191884	310046990	1.01
clickbench_q15/datafusion:parquet	282811942	282586730	1.00
clickbench_q16/datafusion:parquet	665574571	665847122	1.00
clickbench_q17/datafusion:parquet	648881635	662885087	0.98
clickbench_q18/datafusion:parquet	1381667724	1469326549	0.94
clickbench_q19/datafusion:parquet	26906757	28124492	0.96
clickbench_q20/datafusion:parquet	563677433	564212227	1.00
clickbench_q21/datafusion:parquet	621752142	625090412	0.99
clickbench_q22/datafusion:parquet	922485943	908244360	1.02
clickbench_q23/datafusion:parquet	4066523907	4028951716	1.01
clickbench_q24/datafusion:parquet	56067133	54697414	1.03
clickbench_q25/datafusion:parquet	127469715	129948471	0.98
clickbench_q26/datafusion:parquet	55204961	53849841	1.03
clickbench_q27/datafusion:parquet	656802241	656723664	1.00
clickbench_q28/datafusion:parquet	2445803034	2440374974	1.00
clickbench_q29/datafusion:parquet	44995478	44800542	1.00
clickbench_q30/datafusion:parquet	319629221	316903692	1.01
clickbench_q31/datafusion:parquet	340586863	348656369	0.98
clickbench_q32/datafusion:parquet	1101732418	1123553273	0.98
clickbench_q33/datafusion:parquet	1501825165	1492106499	1.01
clickbench_q34/datafusion:parquet	1502124189	1476027388	1.02
clickbench_q35/datafusion:parquet	245927479	237745971	1.03
clickbench_q36/datafusion:parquet	111469894	105758385	1.05
clickbench_q37/datafusion:parquet	41969698	41835216	1.00
clickbench_q38/datafusion:parquet	61162127	59734869	1.02
clickbench_q39/datafusion:parquet	210902961	204619902	1.03
clickbench_q40/datafusion:parquet	22365699	23268025	0.96
clickbench_q41/datafusion:parquet	21013030	20855303	1.01
clickbench_q42/datafusion:parquet	21671657	21753632	1.00

duckdb / vortex-file-compressed (1.024x ➖, 1↑ 6↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨	10558675	8911088	1.18
clickbench_q01/duckdb:vortex-file-compressed	15982664	15214698	1.05
clickbench_q02/duckdb:vortex-file-compressed	21939867	21244920	1.03
clickbench_q03/duckdb:vortex-file-compressed	25869332	27175043	0.95
clickbench_q04/duckdb:vortex-file-compressed	199844114	199084456	1.00
clickbench_q05/duckdb:vortex-file-compressed	186610850	180631752	1.03
clickbench_q06/duckdb:vortex-file-compressed	20201128	18399087	1.10
clickbench_q07/duckdb:vortex-file-compressed	20788119	19513040	1.07
clickbench_q08/duckdb:vortex-file-compressed	264405119	264354476	1.00
clickbench_q09/duckdb:vortex-file-compressed	355482700	345515928	1.03
clickbench_q10/duckdb:vortex-file-compressed	74086859	73353210	1.01
clickbench_q11/duckdb:vortex-file-compressed	85359207	85357376	1.00
clickbench_q12/duckdb:vortex-file-compressed	205845975	204311424	1.01
clickbench_q13/duckdb:vortex-file-compressed	411070492	422855015	0.97
clickbench_q14/duckdb:vortex-file-compressed	238308775	238499798	1.00
clickbench_q15/duckdb:vortex-file-compressed	256300640	250066581	1.02
clickbench_q16/duckdb:vortex-file-compressed	539303599	534934990	1.01
clickbench_q17/duckdb:vortex-file-compressed	429785034	430542075	1.00
clickbench_q18/duckdb:vortex-file-compressed	946943778	951741892	0.99
clickbench_q19/duckdb:vortex-file-compressed	20550857	20742753	0.99
clickbench_q20/duckdb:vortex-file-compressed	250169119	247214258	1.01
clickbench_q21/duckdb:vortex-file-compressed	339203246	334470465	1.01
clickbench_q22/duckdb:vortex-file-compressed	504948731	505559426	1.00
clickbench_q23/duckdb:vortex-file-compressed 🚀	131379627	155115189	0.85
clickbench_q24/duckdb:vortex-file-compressed 🚨	48024136	37067430	1.30
clickbench_q25/duckdb:vortex-file-compressed	81108468	81716060	0.99
clickbench_q26/duckdb:vortex-file-compressed	49676784	54213141	0.92
clickbench_q27/duckdb:vortex-file-compressed	219882975	223342856	0.98
clickbench_q28/duckdb:vortex-file-compressed	3026689352	3018674337	1.00
clickbench_q29/duckdb:vortex-file-compressed	26370256	26968411	0.98
clickbench_q30/duckdb:vortex-file-compressed	201332065	202225789	1.00
clickbench_q31/duckdb:vortex-file-compressed	294065600	296053515	0.99
clickbench_q32/duckdb:vortex-file-compressed	1135427549	1126516905	1.01
clickbench_q33/duckdb:vortex-file-compressed	1090973970	1111906578	0.98
clickbench_q34/duckdb:vortex-file-compressed	1172997386	1173749607	1.00
clickbench_q35/duckdb:vortex-file-compressed	369763706	368806023	1.00
clickbench_q36/duckdb:vortex-file-compressed 🚨	31952656	28669834	1.11
clickbench_q37/duckdb:vortex-file-compressed 🚨	23476461	19838165	1.18
clickbench_q38/duckdb:vortex-file-compressed	25313713	23792906	1.06
clickbench_q39/duckdb:vortex-file-compressed	46200171	47064825	0.98
clickbench_q40/duckdb:vortex-file-compressed 🚨	22953480	20394079	1.13
clickbench_q41/duckdb:vortex-file-compressed 🚨	21626734	18622423	1.16
clickbench_q42/duckdb:vortex-file-compressed	22656365	21737620	1.04

duckdb / parquet (1.002x ➖, 0↑ 0↓)

name	PR `78f9998` (ns)	base `2a54a2c` (ns)	ratio (PR/base)
clickbench_q00/duckdb:parquet	23304521	23618424	0.99
clickbench_q01/duckdb:parquet	30048172	30284085	0.99
clickbench_q02/duckdb:parquet	51488631	51688078	1.00
clickbench_q03/duckdb:parquet	41051975	42647806	0.96
clickbench_q04/duckdb:parquet	211429323	202480179	1.04
clickbench_q05/duckdb:parquet	257753466	258922489	1.00
clickbench_q06/duckdb:parquet	48140696	48412525	0.99
clickbench_q07/duckdb:parquet	32453394	32899015	0.99
clickbench_q08/duckdb:parquet	273725175	267552540	1.02
clickbench_q09/duckdb:parquet	402372362	397784071	1.01
clickbench_q10/duckdb:parquet	84574092	83987701	1.01
clickbench_q11/duckdb:parquet	102597640	101401529	1.01
clickbench_q12/duckdb:parquet	282997348	281563067	1.01
clickbench_q13/duckdb:parquet	479605138	475605604	1.01
clickbench_q14/duckdb:parquet	318532305	317969153	1.00
clickbench_q15/duckdb:parquet	264722756	255729261	1.04
clickbench_q16/duckdb:parquet	607138416	599812865	1.01
clickbench_q17/duckdb:parquet	504099325	501377672	1.01
clickbench_q18/duckdb:parquet	1035282981	1022925899	1.01
clickbench_q19/duckdb:parquet	27767402	28301083	0.98
clickbench_q20/duckdb:parquet	415794964	416485387	1.00
clickbench_q21/duckdb:parquet	531523794	534124966	1.00
clickbench_q22/duckdb:parquet	924860994	919356486	1.01
clickbench_q23/duckdb:parquet	269959854	269659929	1.00
clickbench_q24/duckdb:parquet	71315801	71779135	0.99
clickbench_q25/duckdb:parquet	165617600	163083580	1.02
clickbench_q26/duckdb:parquet	58433685	55991786	1.04
clickbench_q27/duckdb:parquet	470823261	481176602	0.98
clickbench_q28/duckdb:parquet	4786055197	4770053637	1.00
clickbench_q29/duckdb:parquet	43621304	44094937	0.99
clickbench_q30/duckdb:parquet	314690545	315467709	1.00
clickbench_q31/duckdb:parquet	378937490	388462193	0.98
clickbench_q32/duckdb:parquet	1103972768	1110475116	0.99
clickbench_q33/duckdb:parquet	1114717297	1106216408	1.01
clickbench_q34/duckdb:parquet	1163022121	1150292221	1.01
clickbench_q35/duckdb:parquet	377479238	369348928	1.02
clickbench_q36/duckdb:parquet	51056635	51616345	0.99
clickbench_q37/duckdb:parquet	36527900	35751810	1.02
clickbench_q38/duckdb:parquet	36250685	36776196	0.99
clickbench_q39/duckdb:parquet	81740483	85680604	0.95
clickbench_q40/duckdb:parquet	21378093	21827100	0.98
clickbench_q41/duckdb:parquet	21650954	20731824	1.04
clickbench_q42/duckdb:parquet	24688004	24810659	1.00

File Size Changes (101 files changed, -39.2% overall, 0↑ 101↓)

File	Scale	Format	Base	Change	%
duckdb.db	1.0	vortex-compact	268.00 KB	268.00 KB	-100.0%
hits_0.vortex	1.0	vortex-compact	58.88 MB	58.88 MB	-100.0%
hits_1.vortex	1.0	vortex-compact	90.67 MB	90.67 MB	-100.0%
hits_10.vortex	1.0	vortex-compact	49.48 MB	49.48 MB	-100.0%
hits_11.vortex	1.0	vortex-compact	56.11 MB	56.11 MB	-100.0%
hits_12.vortex	1.0	vortex-compact	69.86 MB	69.86 MB	-100.0%
hits_13.vortex	1.0	vortex-compact	69.24 MB	69.24 MB	-100.0%
hits_14.vortex	1.0	vortex-compact	74.88 MB	74.88 MB	-100.0%
hits_15.vortex	1.0	vortex-compact	48.41 MB	48.41 MB	-100.0%
hits_16.vortex	1.0	vortex-compact	49.56 MB	49.56 MB	-100.0%
hits_17.vortex	1.0	vortex-compact	58.79 MB	58.79 MB	-100.0%
hits_18.vortex	1.0	vortex-compact	64.89 MB	64.89 MB	-100.0%
hits_19.vortex	1.0	vortex-compact	49.73 MB	49.73 MB	-100.0%
hits_2.vortex	1.0	vortex-compact	129.16 MB	129.16 MB	-100.0%
hits_20.vortex	1.0	vortex-compact	38.36 MB	38.36 MB	-100.0%
hits_21.vortex	1.0	vortex-compact	51.99 MB	51.99 MB	-100.0%
hits_22.vortex	1.0	vortex-compact	46.22 MB	46.22 MB	-100.0%
hits_23.vortex	1.0	vortex-compact	46.13 MB	46.13 MB	-100.0%
hits_24.vortex	1.0	vortex-compact	45.11 MB	45.11 MB	-100.0%
hits_25.vortex	1.0	vortex-compact	73.88 MB	73.88 MB	-100.0%
hits_26.vortex	1.0	vortex-compact	71.99 MB	71.99 MB	-100.0%
hits_27.vortex	1.0	vortex-compact	69.86 MB	69.86 MB	-100.0%
hits_28.vortex	1.0	vortex-compact	70.92 MB	70.92 MB	-100.0%
hits_29.vortex	1.0	vortex-compact	36.68 MB	36.68 MB	-100.0%
hits_3.vortex	1.0	vortex-compact	95.12 MB	95.12 MB	-100.0%
hits_30.vortex	1.0	vortex-compact	58.58 MB	58.58 MB	-100.0%
hits_31.vortex	1.0	vortex-compact	55.77 MB	55.77 MB	-100.0%
hits_32.vortex	1.0	vortex-compact	44.61 MB	44.61 MB	-100.0%
hits_33.vortex	1.0	vortex-compact	35.92 MB	35.92 MB	-100.0%
hits_34.vortex	1.0	vortex-compact	58.24 MB	58.24 MB	-100.0%
hits_35.vortex	1.0	vortex-compact	75.53 MB	75.53 MB	-100.0%
hits_36.vortex	1.0	vortex-compact	49.21 MB	49.21 MB	-100.0%
hits_37.vortex	1.0	vortex-compact	54.76 MB	54.76 MB	-100.0%
hits_38.vortex	1.0	vortex-compact	63.39 MB	63.39 MB	-100.0%
hits_39.vortex	1.0	vortex-compact	50.10 MB	50.10 MB	-100.0%
hits_4.vortex	1.0	vortex-compact	71.94 MB	71.94 MB	-100.0%
hits_40.vortex	1.0	vortex-compact	77.42 MB	77.42 MB	-100.0%
hits_41.vortex	1.0	vortex-compact	166.05 MB	166.05 MB	-100.0%
hits_42.vortex	1.0	vortex-compact	164.53 MB	164.53 MB	-100.0%
hits_43.vortex	1.0	vortex-compact	169.21 MB	169.21 MB	-100.0%
hits_44.vortex	1.0	vortex-compact	133.26 MB	133.26 MB	-100.0%
hits_45.vortex	1.0	vortex-compact	75.80 MB	75.80 MB	-100.0%
hits_46.vortex	1.0	vortex-compact	42.27 MB	42.27 MB	-100.0%
hits_47.vortex	1.0	vortex-compact	18.22 MB	18.22 MB	-100.0%
hits_48.vortex	1.0	vortex-compact	17.85 MB	17.85 MB	-100.0%
hits_49.vortex	1.0	vortex-compact	51.00 MB	51.00 MB	-100.0%
hits_5.vortex	1.0	vortex-compact	63.33 MB	63.33 MB	-100.0%
hits_50.vortex	1.0	vortex-compact	114.20 MB	114.20 MB	-100.0%
hits_51.vortex	1.0	vortex-compact	168.34 MB	168.34 MB	-100.0%
hits_52.vortex	1.0	vortex-compact	65.08 MB	65.08 MB	-100.0%
hits_53.vortex	1.0	vortex-compact	60.05 MB	60.05 MB	-100.0%
hits_54.vortex	1.0	vortex-compact	117.57 MB	117.57 MB	-100.0%
hits_55.vortex	1.0	vortex-compact	92.56 MB	92.56 MB	-100.0%
hits_56.vortex	1.0	vortex-compact	78.58 MB	78.58 MB	-100.0%
hits_57.vortex	1.0	vortex-compact	83.73 MB	83.73 MB	-100.0%
hits_58.vortex	1.0	vortex-compact	61.24 MB	61.24 MB	-100.0%
hits_59.vortex	1.0	vortex-compact	66.68 MB	66.68 MB	-100.0%
hits_6.vortex	1.0	vortex-compact	63.57 MB	63.57 MB	-100.0%
hits_60.vortex	1.0	vortex-compact	64.92 MB	64.92 MB	-100.0%
hits_61.vortex	1.0	vortex-compact	57.73 MB	57.73 MB	-100.0%
hits_62.vortex	1.0	vortex-compact	75.45 MB	75.45 MB	-100.0%
hits_63.vortex	1.0	vortex-compact	46.44 MB	46.44 MB	-100.0%
hits_64.vortex	1.0	vortex-compact	54.09 MB	54.09 MB	-100.0%
hits_65.vortex	1.0	vortex-compact	129.40 MB	129.40 MB	-100.0%
hits_66.vortex	1.0	vortex-compact	53.52 MB	53.52 MB	-100.0%
hits_67.vortex	1.0	vortex-compact	114.44 MB	114.44 MB	-100.0%
hits_68.vortex	1.0	vortex-compact	76.67 MB	76.67 MB	-100.0%
hits_69.vortex	1.0	vortex-compact	80.98 MB	80.98 MB	-100.0%
hits_7.vortex	1.0	vortex-compact	64.19 MB	64.19 MB	-100.0%
hits_70.vortex	1.0	vortex-compact	61.84 MB	61.84 MB	-100.0%
hits_71.vortex	1.0	vortex-compact	69.96 MB	69.96 MB	-100.0%
hits_72.vortex	1.0	vortex-compact	52.74 MB	52.74 MB	-100.0%
hits_73.vortex	1.0	vortex-compact	71.07 MB	71.07 MB	-100.0%
hits_74.vortex	1.0	vortex-compact	71.87 MB	71.87 MB	-100.0%
hits_75.vortex	1.0	vortex-compact	45.12 MB	45.12 MB	-100.0%
hits_76.vortex	1.0	vortex-compact	77.10 MB	77.10 MB	-100.0%
hits_77.vortex	1.0	vortex-compact	118.50 MB	118.50 MB	-100.0%
hits_78.vortex	1.0	vortex-compact	97.85 MB	97.85 MB	-100.0%
hits_79.vortex	1.0	vortex-compact	86.17 MB	86.17 MB	-100.0%
hits_8.vortex	1.0	vortex-compact	63.39 MB	63.39 MB	-100.0%
hits_80.vortex	1.0	vortex-compact	68.67 MB	68.67 MB	-100.0%
hits_81.vortex	1.0	vortex-compact	65.95 MB	65.95 MB	-100.0%
hits_82.vortex	1.0	vortex-compact	67.43 MB	67.43 MB	-100.0%
hits_83.vortex	1.0	vortex-compact	53.62 MB	53.62 MB	-100.0%
hits_84.vortex	1.0	vortex-compact	74.35 MB	74.35 MB	-100.0%
hits_85.vortex	1.0	vortex-compact	52.86 MB	52.86 MB	-100.0%
hits_86.vortex	1.0	vortex-compact	49.12 MB	49.12 MB	-100.0%
hits_87.vortex	1.0	vortex-compact	118.86 MB	118.86 MB	-100.0%
hits_88.vortex	1.0	vortex-compact	73.59 MB	73.59 MB	-100.0%
hits_89.vortex	1.0	vortex-compact	114.10 MB	114.10 MB	-100.0%
hits_9.vortex	1.0	vortex-compact	66.32 MB	66.32 MB	-100.0%
hits_90.vortex	1.0	vortex-compact	82.09 MB	82.09 MB	-100.0%
hits_91.vortex	1.0	vortex-compact	61.24 MB	61.24 MB	-100.0%
hits_92.vortex	1.0	vortex-compact	94.40 MB	94.40 MB	-100.0%
hits_93.vortex	1.0	vortex-compact	59.92 MB	59.92 MB	-100.0%
hits_94.vortex	1.0	vortex-compact	90.90 MB	90.90 MB	-100.0%
hits_95.vortex	1.0	vortex-compact	58.20 MB	58.20 MB	-100.0%
hits_96.vortex	1.0	vortex-compact	91.74 MB	91.74 MB	-100.0%
hits_97.vortex	1.0	vortex-compact	69.58 MB	69.58 MB	-100.0%
hits_98.vortex	1.0	vortex-compact	73.15 MB	73.15 MB	-100.0%
hits_99.vortex	1.0	vortex-compact	77.65 MB	77.65 MB	-100.0%

Totals:

vortex-compact: 7.11 GB → 0 B (-100.0%)
vortex-file-compressed: 11.04 GB → 11.04 GB (0.0%)

Only run benchmark env configuration after setup is complete

78f9998

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

AdamGS requested a review from robert3005 July 29, 2026 18:25

AdamGS added changelog/ci action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Jul 29, 2026

github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Jul 29, 2026

robert3005 approved these changes Jul 29, 2026

View reviewed changes

AdamGS merged commit 0462621 into develop Jul 29, 2026
105 of 107 checks passed

AdamGS deleted the adamg/bench-setup-fix branch July 29, 2026 18:41

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Only run benchmark env configuration after setup is complete - #9075

Only run benchmark env configuration after setup is complete#9075
AdamGS merged 1 commit into
developfrom
adamg/bench-setup-fix

AdamGS commented Jul 29, 2026

Uh oh!

github-actions Bot commented Jul 29, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Jul 29, 2026

Uh oh!

github-actions Bot commented Jul 29, 2026

Uh oh!

github-actions Bot commented Jul 29, 2026

Uh oh!

github-actions Bot commented Jul 29, 2026

Uh oh!

github-actions Bot commented Jul 29, 2026

Uh oh!

github-actions Bot commented Jul 29, 2026

Uh oh!

github-actions Bot commented Jul 29, 2026

Uh oh!

github-actions Bot commented Jul 29, 2026

Uh oh!

github-actions Bot commented Jul 29, 2026

Uh oh!

github-actions Bot commented Jul 29, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

AdamGS commented Jul 29, 2026

Rationale for this change

Uh oh!

github-actions Bot commented Jul 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented Jul 29, 2026

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Jul 29, 2026

Benchmarks: TPC-DS SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Jul 29, 2026

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Jul 29, 2026

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Jul 29, 2026

Benchmarks: Statistical and Population Genetics 📖

Uh oh!

github-actions Bot commented Jul 29, 2026

Benchmarks: TPC-H SF=1 on S3 📖

Uh oh!

github-actions Bot commented Jul 29, 2026

Benchmarks: FineWeb S3 📖

Uh oh!

github-actions Bot commented Jul 29, 2026

Benchmarks: TPC-H SF=10 on NVME 📖

Uh oh!

github-actions Bot commented Jul 29, 2026

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

github-actions Bot commented Jul 29, 2026

Benchmarks: Clickbench on NVME 📖

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

github-actions Bot commented Jul 29, 2026 •

edited

Loading