perf: batch fragmented CASE branch execution by gatesn · Pull Request #9820 · vortex-data/vortex

gatesn · 2026-09-09T17:44:51Z

Why

Fragmented CASE selections can repeatedly execute lazy branch expressions for tiny runs or individual rows. Batch those selections so branch evaluation stays columnar, while keeping the existing low-overhead approach for coarse runs.

Changes

Evaluate later WHEN conditions only on unmatched rows; evaluate THEN/ELSE values only where selected. Preserve first-match semantics, nullability, and errors from selected rows.
Compact fragmented branch results and restore row positions with a bulk take. Assemble coarse runs directly. Builders and the permutation buffer use the execution context's allocator.
Push filters through all scalar-function arguments and reduce contiguous filters to slices. These shared rules are not CASE-specific.
Add focused semantic tests and extend the existing CASE benchmark with decimal products and string branches across run lengths.

Validation

cargo nextest run -p vortex-array: 3,453 passed, one skipped (including 55 CASE tests).
cargo clippy -p vortex-array --all-targets --all-features -- -D warnings: passed.
cargo +nightly fmt --all and git diff --check: passed.
cargo bench -p vortex-array --bench expr_case_when -- --sample-count 30: completed, including simple, n-ary, early-exit, fragmented, and coarse-run controls.

On this revision, 65,536-row alternating decimal-product and string cases have medians of 165.5 µs and 157.1 µs. These are candidate-only measurements, not a fresh comparison against develop. Earlier paired experiments motivated the change, but also found small n-ary regressions; this is not a claim of uniform improvement.

Review considerations

The 128-rows-per-run heuristic is empirical. Compact assembly adds temporary output/permutation storage; no memory-saving claim is made. The shared scalar-function filter rule broadens selection pushdown, so its contract and deeply nested expression behavior deserve particular review.

Ported and validated with Codex. No dependency changes or unrelated Vortex experiments are included.

codspeed · 2026-09-09T17:52:56Z

Merging this PR will regress 6 benchmarks

⚠️

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️

1 benchmark measured no execution time

Nothing ran under measurement, usually because the compiler removed the code under test. This result is not comparable, so it counts as unchanged.

Preventing compiler optimizations

⚠️

Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 6 improved benchmarks
❌ 6 regressed benchmarks
✅ 2165 untouched benchmarks
🆕 6 new benchmarks
⏩ 409 skipped benchmarks¹

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
❌	Simulation	`case_when_nary_10_conditions[1000]`	266 µs	369.9 µs	-28.07%
❌	Simulation	`case_when_nary_equality_lookup[1000]`	237.4 µs	296.7 µs	-19.98%
❌	Simulation	`case_when_nary_3_conditions[1000]`	167.6 µs	205.7 µs	-18.52%
❌	Simulation	`case_when_nary_early_dominant[1000]`	167.1 µs	204.6 µs	-18.34%
❌	Simulation	`case_when_nary_equality_lookup[10000]`	379.5 µs	454.9 µs	-16.58%
❌	WallTime	`bitpack_blocked_compress_avx2`	6.7 µs	7.6 µs	-11.92%
⚡	Simulation	`case_when_fragmented[400]`	507.1 µs	183.9 µs	×2.8
⚡	WallTime	`mul_u64_nonnull_neon`	39.7 µs	28.7 µs	+38.35%
⚡	Simulation	`case_when_fragmented[100]`	203.3 µs	157.9 µs	+28.77%
⚡	WallTime	`multiply_shapes_neon[(32768, PerRowPerRow)]`	38.7 µs	32.6 µs	+18.96%
⚡	WallTime	`mul_i64_nonnull_neon`	38.6 µs	32.6 µs	+18.41%
⚡	Simulation	`case_when_nary_10_conditions[10000]`	500.7 µs	448.9 µs	+11.53%
🆕	Simulation	`case_when_decimal_product[1]`	N/A	230 µs	N/A
🆕	Simulation	`case_when_decimal_product[64]`	N/A	206.3 µs	N/A
🆕	Simulation	`case_when_string_values[1]`	N/A	192.8 µs	N/A
🆕	Simulation	`case_when_string_values[64]`	N/A	180.6 µs	N/A
🆕	Simulation	`case_when_decimal_product[8]`	N/A	208.2 µs	N/A
🆕	Simulation	`case_when_string_values[8]`	N/A	189.5 µs	N/A
⚠️	Simulation	`bench_compare_primitive[(10000, 2)]`	< 1 ns	< 1 ns	N/A

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

_{Comparing ngates/batched-case-execution (f83e38f) with develop (2b4c682)²}

409 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
No successful run was found on develop (1ee4e3a) during the generation of this report, so 2b4c682 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

github-actions · 2026-09-09T18:08:19Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`f83e38f`	vortex-queries	1	Explore Profiling Data
🟢 Done	`f83e38f`	statpopgen	1	Explore Profiling Data
🟢 Done	`f83e38f`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`f83e38f`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`f83e38f`	tpch-s3-10	1	Explore Profiling Data
🟢 Done	`f83e38f`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`f83e38f`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`f83e38f`	appian-nvme	1	Explore Profiling Data
🟢 Done	`f83e38f`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`f83e38f`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`f83e38f`	polarsignals	1	Explore Profiling Data
🟢 Done	`f83e38f`	fineweb	1	Explore Profiling Data
🟢 Done	`f83e38f`	tpch-s3	1	Explore Profiling Data

Previous Runs (17)

Status	Commit	Job	Attempt	Link
🟢 Done	`9c7a9f5`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`9c7a9f5`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`9c7a9f5`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`9c7a9f5`	fineweb	1	Explore Profiling Data
🟢 Done	`9c7a9f5`	polarsignals	1	Explore Profiling Data
🟢 Done	`9c7a9f5`	tpch-s3	1	Explore Profiling Data
🟢 Done	`9c7a9f5`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`2ae4de6`	statpopgen	2	Explore Profiling Data
🟢 Done	`2ae4de6`	clickbench-sorted-nvme	2	Explore Profiling Data
🟢 Done	`2ae4de6`	fineweb-s3	2	Explore Profiling Data
🟢 Done	`2ae4de6`	clickbench-nvme	2	Explore Profiling Data
🟢 Done	`2ae4de6`	tpcds-nvme	2	Explore Profiling Data
🟢 Done	`2ae4de6`	tpch-nvme	2	Explore Profiling Data
🟢 Done	`2ae4de6`	polarsignals	2	Explore Profiling Data
🟢 Done	`2ae4de6`	tpch-s3	2	Explore Profiling Data
🟢 Done	`2ae4de6`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`2ae4de6`	fineweb	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-09-09T18:09:42Z

Benchmarks: FineWeb NVMe 📖

Commits: PR f83e38f5 vs base 1ee4e3a5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.9%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (+8.9%, medium confidence)
Vortex (geomean): hot 1.040x ➖ · cold 1.040x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.006x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.6%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	6849876 / 6875152 / -0.4%	20226752 / 19983459 / +1.2%	0.34 / 0.34 / -1.6%
fineweb_q01/datafusion:vortex-file-compressed	13121722 / 12291321 / +6.8%	45811287 / 48448158 / -5.4%	0.29 / 0.25 / +12.9%
fineweb_q02/datafusion:vortex-file-compressed	12996414 / 13872453 / -6.3%	50968720 / 55850387 / -8.7%	0.25 / 0.25 / +2.7%
fineweb_q03/datafusion:vortex-file-compressed	21520766 / 22494748 / -4.3%	113296422 / 114291986 / -0.9%	0.19 / 0.20 / -3.5%
fineweb_q04/datafusion:vortex-file-compressed	81255368 / 81890428 / -0.8%	171672950 / 171228361 / +0.3%	0.47 / 0.48 / -1.0%
fineweb_q05/datafusion:vortex-file-compressed	68892966 / 67475151 / +2.1%	148636583 / 151445826 / -1.9%	0.46 / 0.45 / +4.0%
fineweb_q06/datafusion:vortex-file-compressed	20413566 / 20785622 / -1.8%	115763985 / 115668867 / +0.1%	0.18 / 0.18 / -1.9%
fineweb_q07/datafusion:vortex-file-compressed	19806181 / 19867853 / -0.3%	110975576 / 108083621 / +2.7%	0.18 / 0.18 / -2.9%
fineweb_q08/datafusion:vortex-file-compressed	8973114 / 9077686 / -1.2%	64490468 / 60128739 / +7.3%	0.14 / 0.15 / -7.8%

datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	9411938 / 9339124 / +0.8%	34144126 / 35704690 / -4.4%	0.28 / 0.26 / +5.4%
fineweb_q01/datafusion:parquet	75608258 / 74942446 / +0.9%	169767705 / 164909600 / +2.9%	0.45 / 0.45 / -2.0%
fineweb_q02/datafusion:parquet	75370142 / 75263034 / +0.1%	163651674 / 159774212 / +2.4%	0.46 / 0.47 / -2.2%
fineweb_q03/datafusion:parquet	74228470 / 73508565 / +1.0%	168828912 / 152573442 / +10.7% 🔴	0.44 / 0.48 / -8.7%
fineweb_q04/datafusion:parquet	82586922 / 81800950 / +1.0%	165476824 / 160441474 / +3.1%	0.50 / 0.51 / -2.1%
fineweb_q05/datafusion:parquet	80540867 / 80505656 / +0.0%	157959932 / 162386695 / -2.7%	0.51 / 0.50 / +2.8%
fineweb_q06/datafusion:parquet	74271908 / 76149042 / -2.5%	162768837 / 164597711 / -1.1%	0.46 / 0.46 / -1.4%
fineweb_q07/datafusion:parquet	75560090 / 74906776 / +0.9%	157253667 / 159400843 / -1.3%	0.48 / 0.47 / +2.2%
fineweb_q08/datafusion:parquet	73154490 / 73404396 / -0.3%	162242104 / 155113937 / +4.6%	0.45 / 0.47 / -4.7%

duckdb / vortex-file-compressed / ns (1.090x ➖, 1↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	2652448 / 2279612 / +16.4% 🔴	4784099 / 5704617 / -16.1% 🟢	0.55 / 0.40 / +38.7%
fineweb_q01/duckdb:vortex-file-compressed	24836803 / 20002106 / +24.2% 🔴	61758626 / 58497226 / +5.6%	0.40 / 0.34 / +17.6%
fineweb_q02/duckdb:vortex-file-compressed	20356799 / 20347515 / +0.0%	50635697 / 54601330 / -7.3%	0.40 / 0.37 / +7.9%
fineweb_q03/duckdb:vortex-file-compressed	21556688 / 34700147 / -37.9% 🟢	97947304 / 132248067 / -25.9% 🟢	0.22 / 0.26 / -16.1%
fineweb_q04/duckdb:vortex-file-compressed	90536618 / 84249488 / +7.5%	204354199 / 189382998 / +7.9%	0.44 / 0.44 / -0.4%
fineweb_q05/duckdb:vortex-file-compressed	101130582 / 67614560 / +49.6% 🔴	198473665 / 104587162 / +89.8% 🔴	0.51 / 0.65 / -21.2%
fineweb_q06/duckdb:vortex-file-compressed	53065920 / 38463356 / +38.0% 🔴	146019488 / 111502316 / +31.0% 🔴	0.36 / 0.34 / +5.4%
fineweb_q07/duckdb:vortex-file-compressed	30887023 / 28135790 / +9.8%	119593131 / 114753405 / +4.2%	0.26 / 0.25 / +5.3%
fineweb_q08/duckdb:vortex-file-compressed	6942202 / 6960788 / -0.3%	17916414 / 14177560 / +26.4% 🔴	0.39 / 0.49 / -21.1%

duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	22737695 / 24499563 / -7.2%	23198394 / 24930605 / -6.9%	0.98 / 0.98 / -0.3%
fineweb_q01/duckdb:parquet	44380438 / 44868810 / -1.1%	53487226 / 55425811 / -3.5%	0.83 / 0.81 / +2.5%
fineweb_q02/duckdb:parquet	43883365 / 43714270 / +0.4%	56777617 / 56545579 / +0.4%	0.77 / 0.77 / -0.0%
fineweb_q03/duckdb:parquet	96356063 / 94318956 / +2.2%	185369141 / 184313333 / +0.6%	0.52 / 0.51 / +1.6%
fineweb_q04/duckdb:parquet	152600363 / 151389140 / +0.8%	197596423 / 205372149 / -3.8%	0.77 / 0.74 / +4.8%
fineweb_q05/duckdb:parquet	143215612 / 142267683 / +0.7%	201498458 / 194367058 / +3.7%	0.71 / 0.73 / -2.9%
fineweb_q06/duckdb:parquet	71517715 / 70833176 / +1.0%	133064814 / 119460152 / +11.4% 🔴	0.54 / 0.59 / -9.4%
fineweb_q07/duckdb:parquet	72212234 / 72391958 / -0.2%	159457286 / 146320695 / +9.0%	0.45 / 0.49 / -8.5%
fineweb_q08/duckdb:parquet	25001776 / 23799850 / +5.1%	24240091 / 27323975 / -11.3% 🟢	1.03 / 0.87 / +18.4%

No file size changes detected.

github-actions · 2026-09-09T18:11:53Z

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR f83e38f5 vs base 1ee4e3a5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (+2.1%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 1.023x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	95675178 / 99911568 / -4.2%	171165808 / 168340405 / +1.7%	0.56 / 0.59 / -5.8%
tpch_q02/datafusion:vortex-file-compressed	64565445 / 65097700 / -0.8%	98861746 / 95780165 / +3.2%	0.65 / 0.68 / -3.9%
tpch_q03/datafusion:vortex-file-compressed	64906888 / 64468323 / +0.7%	116855143 / 116974891 / -0.1%	0.56 / 0.55 / +0.8%
tpch_q04/datafusion:vortex-file-compressed	35169510 / 35306876 / -0.4%	76508587 / 74967811 / +2.1%	0.46 / 0.47 / -2.4%
tpch_q05/datafusion:vortex-file-compressed	116022589 / 117644287 / -1.4%	176343235 / 175793300 / +0.3%	0.66 / 0.67 / -1.7%
tpch_q06/datafusion:vortex-file-compressed	14017129 / 14179058 / -1.1%	70225990 / 71668897 / -2.0%	0.20 / 0.20 / +0.9%
tpch_q07/datafusion:vortex-file-compressed	138176524 / 140122432 / -1.4%	186048407 / 194385191 / -4.3%	0.74 / 0.72 / +3.0%
tpch_q08/datafusion:vortex-file-compressed	145509844 / 143215058 / +1.6%	209729973 / 205513486 / +2.1%	0.69 / 0.70 / -0.4%
tpch_q09/datafusion:vortex-file-compressed	182009754 / 188893537 / -3.6%	261941276 / 270975884 / -3.3%	0.69 / 0.70 / -0.3%
tpch_q10/datafusion:vortex-file-compressed	73511704 / 73002521 / +0.7%	136483593 / 134236421 / +1.7%	0.54 / 0.54 / -1.0%
tpch_q11/datafusion:vortex-file-compressed	43073182 / 43835648 / -1.7%	66341534 / 67721891 / -2.0%	0.65 / 0.65 / +0.3%
tpch_q12/datafusion:vortex-file-compressed	44218607 / 42998756 / +2.8%	93690236 / 93203958 / +0.5%	0.47 / 0.46 / +2.3%
tpch_q13/datafusion:vortex-file-compressed	47289678 / 46778530 / +1.1%	78722760 / 74629985 / +5.5%	0.60 / 0.63 / -4.2%
tpch_q14/datafusion:vortex-file-compressed	24674957 / 25236324 / -2.2%	101045645 / 99168287 / +1.9%	0.24 / 0.25 / -4.0%
tpch_q15/datafusion:vortex-file-compressed	36283628 / 36936404 / -1.8%	100093631 / 99466715 / +0.6%	0.36 / 0.37 / -2.4%
tpch_q16/datafusion:vortex-file-compressed	37581126 / 37794072 / -0.6%	66826210 / 65602728 / +1.9%	0.56 / 0.58 / -2.4%
tpch_q17/datafusion:vortex-file-compressed	171941958 / 177444766 / -3.1%	219977913 / 224248649 / -1.9%	0.78 / 0.79 / -1.2%
tpch_q18/datafusion:vortex-file-compressed	202277111 / 203612580 / -0.7%	266519854 / 261407299 / +2.0%	0.76 / 0.78 / -2.6%
tpch_q19/datafusion:vortex-file-compressed	33797207 / 34188607 / -1.1%	94403557 / 93564093 / +0.9%	0.36 / 0.37 / -2.0%
tpch_q20/datafusion:vortex-file-compressed	63874230 / 62848308 / +1.6%	124878207 / 122657120 / +1.8%	0.51 / 0.51 / -0.2%
tpch_q21/datafusion:vortex-file-compressed	181477757 / 183288065 / -1.0%	240890019 / 241118236 / -0.1%	0.75 / 0.76 / -0.9%
tpch_q22/datafusion:vortex-file-compressed	25379117 / 24709114 / +2.7%	58330796 / 54432364 / +7.2%	0.44 / 0.45 / -4.2%

datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	86770820 / 87281816 / -0.6%	130678563 / 130676071 / +0.0%	0.66 / 0.67 / -0.6%
tpch_q02/datafusion:parquet	158261933 / 157834637 / +0.3%	189646304 / 181221979 / +4.6%	0.83 / 0.87 / -4.2%
tpch_q03/datafusion:parquet	142482876 / 141826484 / +0.5%	197644235 / 191607319 / +3.2%	0.72 / 0.74 / -2.6%
tpch_q04/datafusion:parquet	59624698 / 59151727 / +0.8%	96013935 / 98522098 / -2.5%	0.62 / 0.60 / +3.4%
tpch_q05/datafusion:parquet	181483096 / 180947230 / +0.3%	242307983 / 239806009 / +1.0%	0.75 / 0.75 / -0.7%
tpch_q06/datafusion:parquet	35161218 / 35106351 / +0.2%	82016599 / 78237340 / +4.8%	0.43 / 0.45 / -4.5%
tpch_q07/datafusion:parquet	230614214 / 232949505 / -1.0%	289214736 / 288034189 / +0.4%	0.80 / 0.81 / -1.4%
tpch_q08/datafusion:parquet	234148022 / 235250037 / -0.5%	312112736 / 303437202 / +2.9%	0.75 / 0.78 / -3.2%
tpch_q09/datafusion:parquet	313899478 / 315339597 / -0.5%	388115940 / 389924520 / -0.5%	0.81 / 0.81 / +0.0%
tpch_q10/datafusion:parquet	410964728 / 404764956 / +1.5%	465580488 / 457574264 / +1.7%	0.88 / 0.88 / -0.2%
tpch_q11/datafusion:parquet	104117767 / 104564522 / -0.4%	126479270 / 126265429 / +0.2%	0.82 / 0.83 / -0.6%
tpch_q12/datafusion:parquet	84521828 / 84616053 / -0.1%	123228745 / 124184041 / -0.8%	0.69 / 0.68 / +0.7%
tpch_q13/datafusion:parquet	228028811 / 228340602 / -0.1%	256408270 / 254397814 / +0.8%	0.89 / 0.90 / -0.9%
tpch_q14/datafusion:parquet	87733993 / 86631284 / +1.3%	199707574 / 188066444 / +6.2%	0.44 / 0.46 / -4.6%
tpch_q15/datafusion:parquet	91978470 / 92599400 / -0.7%	141429830 / 140746441 / +0.5%	0.65 / 0.66 / -1.2%
tpch_q16/datafusion:parquet	95035319 / 94751751 / +0.3%	121798267 / 120528300 / +1.1%	0.78 / 0.79 / -0.7%
tpch_q17/datafusion:parquet	215861331 / 215790413 / +0.0%	273493194 / 266341623 / +2.7%	0.79 / 0.81 / -2.6%
tpch_q18/datafusion:parquet	290908902 / 294623800 / -1.3%	326918023 / 340903876 / -4.1%	0.89 / 0.86 / +3.0%
tpch_q19/datafusion:parquet	108852567 / 108918934 / -0.1%	173541955 / 172513021 / +0.6%	0.63 / 0.63 / -0.7%
tpch_q20/datafusion:parquet	184420537 / 183325545 / +0.6%	247007259 / 249285272 / -0.9%	0.75 / 0.74 / +1.5%
tpch_q21/datafusion:parquet	242675178 / 244015070 / -0.5%	313146179 / 318546503 / -1.7%	0.77 / 0.77 / +1.2%
tpch_q22/datafusion:parquet	199847626 / 200424693 / -0.3%	222259356 / 221536663 / +0.3%	0.90 / 0.90 / -0.6%

duckdb / vortex-file-compressed / ns (1.016x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	54307100 / 54995299 / -1.3%	101285525 / 101798329 / -0.5%	0.54 / 0.54 / -0.8%
tpch_q02/duckdb:vortex-file-compressed	31890669 / 32238123 / -1.1%	45352932 / 46363378 / -2.2%	0.70 / 0.70 / +1.1%
tpch_q03/duckdb:vortex-file-compressed	58180593 / 57696435 / +0.8%	104919699 / 104825547 / +0.1%	0.55 / 0.55 / +0.7%
tpch_q04/duckdb:vortex-file-compressed	81733412 / 81203407 / +0.7%	110398779 / 116588514 / -5.3%	0.74 / 0.70 / +6.3%
tpch_q05/duckdb:vortex-file-compressed	65409345 / 64013081 / +2.2%	123076879 / 112603848 / +9.3%	0.53 / 0.57 / -6.5%
tpch_q06/duckdb:vortex-file-compressed	21187274 / 21310120 / -0.6%	60737777 / 65223559 / -6.9%	0.35 / 0.33 / +6.8%
tpch_q07/duckdb:vortex-file-compressed	62350916 / 59497436 / +4.8%	127266759 / 121416698 / +4.8%	0.49 / 0.49 / -0.0%
tpch_q08/duckdb:vortex-file-compressed	87743689 / 84905463 / +3.3%	153360644 / 146810235 / +4.5%	0.57 / 0.58 / -1.1%
tpch_q09/duckdb:vortex-file-compressed	169535899 / 167062361 / +1.5%	236294008 / 229257788 / +3.1%	0.72 / 0.73 / -1.5%
tpch_q10/duckdb:vortex-file-compressed	108622342 / 111496252 / -2.6%	160662422 / 163119533 / -1.5%	0.68 / 0.68 / -1.1%
tpch_q11/duckdb:vortex-file-compressed	16928879 / 17374117 / -2.6%	30996066 / 27829062 / +11.4% 🔴	0.55 / 0.62 / -12.5%
tpch_q12/duckdb:vortex-file-compressed	52657773 / 56362079 / -6.6%	99685249 / 96812603 / +3.0%	0.53 / 0.58 / -9.3%
tpch_q13/duckdb:vortex-file-compressed	90590033 / 92304384 / -1.9%	140522372 / 141147775 / -0.4%	0.64 / 0.65 / -1.4%
tpch_q14/duckdb:vortex-file-compressed	36149583 / 31751737 / +13.9% 🔴	86146023 / 74797952 / +15.2% 🔴	0.42 / 0.42 / -1.1%
tpch_q15/duckdb:vortex-file-compressed	40454361 / 39075421 / +3.5%	88903873 / 88597918 / +0.3%	0.46 / 0.44 / +3.2%
tpch_q16/duckdb:vortex-file-compressed	42288883 / 42277347 / +0.0%	54465850 / 55291140 / -1.5%	0.78 / 0.76 / +1.5%
tpch_q17/duckdb:vortex-file-compressed	58757077 / 52477451 / +12.0% 🔴	116966319 / 94689325 / +23.5% 🔴	0.50 / 0.55 / -9.4%
tpch_q18/duckdb:vortex-file-compressed	137602171 / 132127585 / +4.1%	175555058 / 157315267 / +11.6% 🔴	0.78 / 0.84 / -6.7%
tpch_q19/duckdb:vortex-file-compressed	41190442 / 39954249 / +3.1%	89290729 / 85698077 / +4.2%	0.46 / 0.47 / -1.1%
tpch_q20/duckdb:vortex-file-compressed	60619886 / 58598029 / +3.5%	123206434 / 105689724 / +16.6% 🔴	0.49 / 0.55 / -11.3%
tpch_q21/duckdb:vortex-file-compressed	237122107 / 239619676 / -1.0%	275198254 / 287243401 / -4.2%	0.86 / 0.83 / +3.3%
tpch_q22/duckdb:vortex-file-compressed	41963022 / 41683950 / +0.7%	63047262 / 60234067 / +4.7%	0.67 / 0.69 / -3.8%

duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	72268336 / 72557923 / -0.4%	86044999 / 85684171 / +0.4%	0.84 / 0.85 / -0.8%
tpch_q02/duckdb:parquet	80455722 / 80901869 / -0.6%	91139165 / 90396558 / +0.8%	0.88 / 0.89 / -1.4%
tpch_q03/duckdb:parquet	119552998 / 120255378 / -0.6%	143743601 / 148936619 / -3.5%	0.83 / 0.81 / +3.0%
tpch_q04/duckdb:parquet	76087278 / 75542161 / +0.7%	95585014 / 90196247 / +6.0%	0.80 / 0.84 / -5.0%
tpch_q05/duckdb:parquet	129458558 / 130311445 / -0.7%	170387453 / 190149004 / -10.4% 🟢	0.76 / 0.69 / +10.9%
tpch_q06/duckdb:parquet	34032122 / 34730611 / -2.0%	46928732 / 50897327 / -7.8%	0.73 / 0.68 / +6.3%
tpch_q07/duckdb:parquet	93733190 / 94053992 / -0.3%	127461725 / 127251732 / +0.2%	0.74 / 0.74 / -0.5%
tpch_q08/duckdb:parquet	150240084 / 150698280 / -0.3%	198301889 / 198136217 / +0.1%	0.76 / 0.76 / -0.4%
tpch_q09/duckdb:parquet	228612945 / 227941121 / +0.3%	260163274 / 284196009 / -8.5%	0.88 / 0.80 / +9.6%
tpch_q10/duckdb:parquet	513562530 / 519412347 / -1.1%	561183001 / 540162283 / +3.9%	0.92 / 0.96 / -4.8%
tpch_q11/duckdb:parquet	33954578 / 33701450 / +0.8%	39361102 / 38670455 / +1.8%	0.86 / 0.87 / -1.0%
tpch_q12/duckdb:parquet	76761771 / 77579591 / -1.1%	91807353 / 88801489 / +3.4%	0.84 / 0.87 / -4.3%
tpch_q13/duckdb:parquet	324221584 / 324830782 / -0.2%	335404966 / 334643742 / +0.2%	0.97 / 0.97 / -0.4%
tpch_q14/duckdb:parquet	112230784 / 108704330 / +3.2%	133194725 / 134746084 / -1.2%	0.84 / 0.81 / +4.4%
tpch_q15/duckdb:parquet	43456548 / 44837406 / -3.1%	66799336 / 65967406 / +1.3%	0.65 / 0.68 / -4.3%
tpch_q16/duckdb:parquet	117883207 / 119040451 / -1.0%	129278040 / 132784949 / -2.6%	0.91 / 0.90 / +1.7%
tpch_q17/duckdb:parquet	80380239 / 84075622 / -4.4%	108171073 / 113246033 / -4.5%	0.74 / 0.74 / +0.1%
tpch_q18/duckdb:parquet	216302620 / 217370138 / -0.5%	171321666 / 191532016 / -10.6% 🟢	1.26 / 1.13 / +11.2%
tpch_q19/duckdb:parquet	166234431 / 166341849 / -0.1%	199058080 / 193869382 / +2.7%	0.84 / 0.86 / -2.7%
tpch_q20/duckdb:parquet	135825126 / 136025838 / -0.1%	166815277 / 169315322 / -1.5%	0.81 / 0.80 / +1.3%
tpch_q21/duckdb:parquet	281226742 / 283388759 / -0.8%	286822273 / 288418630 / -0.6%	0.98 / 0.98 / -0.2%
tpch_q22/duckdb:parquet	268402701 / 267556637 / +0.3%	279710505 / 280261495 / -0.2%	0.96 / 0.95 / +0.5%

No file size changes detected.

github-actions · 2026-09-09T18:40:32Z

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 2ae4de65 vs base 2a5b1a79
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 1.026x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed	262837724 / 249498942 / +5.3%	742176305 / 515990911 / +43.8% 🔴	0.35 / 0.48 / -26.8%
clickbench-sorted_q24/datafusion:vortex-file-compressed	13070741 / 13884355 / -5.9%	49587073 / 51784935 / -4.2%	0.26 / 0.27 / -1.7%
clickbench-sorted_q26/datafusion:vortex-file-compressed	14178795 / 14334882 / -1.1%	47682534 / 48783451 / -2.3%	0.30 / 0.29 / +1.2%
clickbench-sorted_q36/datafusion:vortex-file-compressed	29952384 / 29985038 / -0.1%	64795838 / 67330879 / -3.8%	0.46 / 0.45 / +3.8%
clickbench-sorted_q37/datafusion:vortex-file-compressed	25245966 / 24145302 / +4.6%	55901989 / 57688786 / -3.1%	0.45 / 0.42 / +7.9%
clickbench-sorted_q38/datafusion:vortex-file-compressed	35835241 / 36641794 / -2.2%	68733788 / 75604819 / -9.1%	0.52 / 0.48 / +7.6%
clickbench-sorted_q39/datafusion:vortex-file-compressed	89389638 / 91906712 / -2.7%	116190442 / 119643054 / -2.9%	0.77 / 0.77 / +0.2%
clickbench-sorted_q40/datafusion:vortex-file-compressed	16279766 / 16181415 / +0.6%	44965951 / 44027903 / +2.1%	0.36 / 0.37 / -1.5%
clickbench-sorted_q41/datafusion:vortex-file-compressed	15461532 / 15369861 / +0.6%	45972488 / 43136040 / +6.6%	0.34 / 0.36 / -5.6%
clickbench-sorted_q42/datafusion:vortex-file-compressed	14041986 / 13493904 / +4.1%	38586956 / 37780443 / +2.1%	0.36 / 0.36 / +1.9%

datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet	756825852 / 761990374 / -0.7%	951032885 / 969886246 / -1.9%	0.80 / 0.79 / +1.3%
clickbench-sorted_q24/datafusion:parquet	8547198 / 8907641 / -4.0%	72033658 / 70856288 / +1.7%	0.12 / 0.13 / -5.6%
clickbench-sorted_q26/datafusion:parquet	8785247 / 9348132 / -6.0%	72527499 / 71242467 / +1.8%	0.12 / 0.13 / -7.7%
clickbench-sorted_q36/datafusion:parquet	94489912 / 94134458 / +0.4%	167473641 / 167352243 / +0.1%	0.56 / 0.56 / +0.3%
clickbench-sorted_q37/datafusion:parquet	65050695 / 64475246 / +0.9%	131125430 / 130056495 / +0.8%	0.50 / 0.50 / +0.1%
clickbench-sorted_q38/datafusion:parquet	88246485 / 87461466 / +0.9%	159515364 / 158106256 / +0.9%	0.55 / 0.55 / +0.0%
clickbench-sorted_q39/datafusion:parquet	160036722 / 160330758 / -0.2%	235515537 / 233976032 / +0.7%	0.68 / 0.69 / -0.8%
clickbench-sorted_q40/datafusion:parquet	44803779 / 43995372 / +1.8%	109159652 / 109620597 / -0.4%	0.41 / 0.40 / +2.3%
clickbench-sorted_q41/datafusion:parquet	42626754 / 42205100 / +1.0%	108345645 / 109321187 / -0.9%	0.39 / 0.39 / +1.9%
clickbench-sorted_q42/datafusion:parquet	26218612 / 26250616 / -0.1%	86462471 / 87353613 / -1.0%	0.30 / 0.30 / +0.9%

duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed	69218148 / 67643839 / +2.3%	99272518 / 85743339 / +15.8% 🔴	0.70 / 0.79 / -11.6%
clickbench-sorted_q24/duckdb:vortex-file-compressed	18685426 / 20433666 / -8.6%	30450235 / 32011270 / -4.9%	0.61 / 0.64 / -3.9%
clickbench-sorted_q26/duckdb:vortex-file-compressed	17666872 / 16424112 / +7.6%	26667535 / 27420330 / -2.7%	0.66 / 0.60 / +10.6%
clickbench-sorted_q36/duckdb:vortex-file-compressed	45578841 / 45765086 / -0.4%	78547618 / 73338353 / +7.1%	0.58 / 0.62 / -7.0%
clickbench-sorted_q37/duckdb:vortex-file-compressed	37525691 / 38052044 / -1.4%	62037095 / 61262652 / +1.3%	0.60 / 0.62 / -2.6%
clickbench-sorted_q38/duckdb:vortex-file-compressed	52498157 / 47973684 / +9.4%	78201277 / 76535332 / +2.2%	0.67 / 0.63 / +7.1%
clickbench-sorted_q39/duckdb:vortex-file-compressed	111146693 / 116500514 / -4.6%	146507642 / 146528570 / -0.0%	0.76 / 0.80 / -4.6%
clickbench-sorted_q40/duckdb:vortex-file-compressed	21597415 / 21302020 / +1.4%	42161148 / 39804172 / +5.9%	0.51 / 0.54 / -4.3%
clickbench-sorted_q41/duckdb:vortex-file-compressed	21244148 / 21257965 / -0.1%	44381268 / 40789430 / +8.8%	0.48 / 0.52 / -8.2%
clickbench-sorted_q42/duckdb:vortex-file-compressed	19099182 / 18668936 / +2.3%	33953892 / 34362327 / -1.2%	0.56 / 0.54 / +3.5%

duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet	126633010 / 126962143 / -0.3%	142502225 / 154210535 / -7.6%	0.89 / 0.82 / +7.9%
clickbench-sorted_q24/duckdb:parquet	18349462 / 18822656 / -2.5%	28391839 / 25805314 / +10.0% 🔴	0.65 / 0.73 / -11.4%
clickbench-sorted_q26/duckdb:parquet	12076948 / 12771545 / -5.4%	23501542 / 23946939 / -1.9%	0.51 / 0.53 / -3.6%
clickbench-sorted_q36/duckdb:parquet	44017843 / 42629350 / +3.3%	60458257 / 59103779 / +2.3%	0.73 / 0.72 / +0.9%
clickbench-sorted_q37/duckdb:parquet	30985968 / 31341916 / -1.1%	46194737 / 47869397 / -3.5%	0.67 / 0.65 / +2.4%
clickbench-sorted_q38/duckdb:parquet	38752022 / 38713509 / +0.1%	56180738 / 55725147 / +0.8%	0.69 / 0.69 / -0.7%
clickbench-sorted_q39/duckdb:parquet	74543194 / 72032032 / +3.5%	86514736 / 87443673 / -1.1%	0.86 / 0.82 / +4.6%
clickbench-sorted_q40/duckdb:parquet	17266264 / 16600297 / +4.0%	35021084 / 36698950 / -4.6%	0.49 / 0.45 / +9.0%
clickbench-sorted_q41/duckdb:parquet	17372282 / 17035162 / +2.0%	35992274 / 34886237 / +3.2%	0.48 / 0.49 / -1.2%
clickbench-sorted_q42/duckdb:parquet	10996580 / 11507854 / -4.4%	23581351 / 26312566 / -10.4% 🟢	0.47 / 0.44 / +6.6%

File Size Changes (100 files changed, -0.0% overall, 44↑ 56↓)

File	Scale	Format	Base	HEAD	Change	%
hits_001.vortex	1.0	vortex-file-compressed	190.42 MB	192.44 MB	+2.02 MB	+1.1%
hits_033.vortex	1.0	vortex-file-compressed	198.57 MB	200.05 MB	+1.49 MB	+0.7%
hits_081.vortex	1.0	vortex-file-compressed	198.19 MB	199.55 MB	+1.36 MB	+0.7%
hits_044.vortex	1.0	vortex-file-compressed	198.08 MB	199.31 MB	+1.23 MB	+0.6%
hits_074.vortex	1.0	vortex-file-compressed	197.56 MB	198.63 MB	+1.06 MB	+0.5%
hits_007.vortex	1.0	vortex-file-compressed	198.55 MB	199.49 MB	+969.07 KB	+0.5%
hits_049.vortex	1.0	vortex-file-compressed	190.55 MB	191.36 MB	+832.66 KB	+0.4%
hits_085.vortex	1.0	vortex-file-compressed	198.24 MB	199.02 MB	+795.89 KB	+0.4%
hits_058.vortex	1.0	vortex-file-compressed	154.10 MB	154.58 MB	+488.46 KB	+0.3%
hits_067.vortex	1.0	vortex-file-compressed	130.77 MB	131.16 MB	+394.33 KB	+0.3%
hits_024.vortex	1.0	vortex-file-compressed	159.63 MB	160.09 MB	+470.16 KB	+0.3%
hits_014.vortex	1.0	vortex-file-compressed	171.53 MB	172.00 MB	+486.78 KB	+0.3%
hits_088.vortex	1.0	vortex-file-compressed	171.40 MB	171.86 MB	+467.69 KB	+0.3%
hits_031.vortex	1.0	vortex-file-compressed	158.53 MB	158.89 MB	+369.84 KB	+0.2%
hits_046.vortex	1.0	vortex-file-compressed	100.51 MB	100.67 MB	+169.70 KB	+0.2%
hits_092.vortex	1.0	vortex-file-compressed	199.09 MB	199.35 MB	+270.65 KB	+0.1%
hits_017.vortex	1.0	vortex-file-compressed	145.75 MB	145.94 MB	+191.85 KB	+0.1%
hits_012.vortex	1.0	vortex-file-compressed	189.81 MB	190.03 MB	+228.15 KB	+0.1%
hits_097.vortex	1.0	vortex-file-compressed	191.74 MB	191.95 MB	+211.15 KB	+0.1%
hits_089.vortex	1.0	vortex-file-compressed	130.50 MB	130.63 MB	+134.51 KB	+0.1%
hits_070.vortex	1.0	vortex-file-compressed	199.67 MB	199.85 MB	+184.70 KB	+0.1%
hits_022.vortex	1.0	vortex-file-compressed	198.44 MB	198.60 MB	+157.86 KB	+0.1%
hits_056.vortex	1.0	vortex-file-compressed	134.46 MB	134.55 MB	+92.95 KB	+0.1%
hits_098.vortex	1.0	vortex-file-compressed	136.68 MB	136.77 MB	+90.01 KB	+0.1%
hits_064.vortex	1.0	vortex-file-compressed	189.77 MB	189.89 MB	+123.58 KB	+0.1%
hits_018.vortex	1.0	vortex-file-compressed	199.03 MB	199.14 MB	+112.25 KB	+0.1%
hits_072.vortex	1.0	vortex-file-compressed	101.91 MB	101.95 MB	+48.68 KB	+0.0%
hits_061.vortex	1.0	vortex-file-compressed	159.87 MB	159.94 MB	+74.88 KB	+0.0%
hits_041.vortex	1.0	vortex-file-compressed	130.25 MB	130.30 MB	+52.46 KB	+0.0%
hits_060.vortex	1.0	vortex-file-compressed	192.09 MB	192.16 MB	+75.37 KB	+0.0%
hits_019.vortex	1.0	vortex-file-compressed	139.61 MB	139.66 MB	+41.44 KB	+0.0%
hits_027.vortex	1.0	vortex-file-compressed	188.80 MB	188.85 MB	+53.89 KB	+0.0%
hits_030.vortex	1.0	vortex-file-compressed	131.05 MB	131.08 MB	+33.27 KB	+0.0%
hits_052.vortex	1.0	vortex-file-compressed	130.02 MB	130.04 MB	+29.32 KB	+0.0%
hits_066.vortex	1.0	vortex-file-compressed	162.36 MB	162.40 MB	+33.27 KB	+0.0%
hits_035.vortex	1.0	vortex-file-compressed	102.24 MB	102.26 MB	+18.52 KB	+0.0%
hits_071.vortex	1.0	vortex-file-compressed	139.25 MB	139.27 MB	+24.38 KB	+0.0%
hits_034.vortex	1.0	vortex-file-compressed	182.84 MB	182.87 MB	+30.92 KB	+0.0%
hits_021.vortex	1.0	vortex-file-compressed	153.39 MB	153.41 MB	+25.28 KB	+0.0%
hits_013.vortex	1.0	vortex-file-compressed	160.19 MB	160.21 MB	+18.22 KB	+0.0%
hits_087.vortex	1.0	vortex-file-compressed	159.96 MB	159.97 MB	+15.02 KB	+0.0%
hits_045.vortex	1.0	vortex-file-compressed	138.64 MB	138.65 MB	+11.15 KB	+0.0%
hits_028.vortex	1.0	vortex-file-compressed	150.82 MB	150.83 MB	+11.55 KB	+0.0%
hits_003.vortex	1.0	vortex-file-compressed	135.69 MB	135.70 MB	+7.70 KB	+0.0%
hits_006.vortex	1.0	vortex-file-compressed	125.65 MB	125.65 MB	1.42 KB	-0.0%
hits_042.vortex	1.0	vortex-file-compressed	200.46 MB	200.45 MB	7.78 KB	-0.0%
hits_037.vortex	1.0	vortex-file-compressed	176.40 MB	176.39 MB	16.45 KB	-0.0%
hits_047.vortex	1.0	vortex-file-compressed	153.56 MB	153.54 MB	14.95 KB	-0.0%
hits_048.vortex	1.0	vortex-file-compressed	198.83 MB	198.81 MB	19.91 KB	-0.0%
hits_015.vortex	1.0	vortex-file-compressed	130.23 MB	130.22 MB	13.63 KB	-0.0%
hits_063.vortex	1.0	vortex-file-compressed	130.83 MB	130.81 MB	15.88 KB	-0.0%
hits_062.vortex	1.0	vortex-file-compressed	170.05 MB	170.02 MB	35.88 KB	-0.0%
hits_082.vortex	1.0	vortex-file-compressed	138.66 MB	138.62 MB	45.16 KB	-0.0%
hits_069.vortex	1.0	vortex-file-compressed	141.66 MB	141.61 MB	52.15 KB	-0.0%
hits_025.vortex	1.0	vortex-file-compressed	171.23 MB	171.17 MB	63.59 KB	-0.0%
hits_026.vortex	1.0	vortex-file-compressed	130.52 MB	130.48 MB	48.70 KB	-0.0%
hits_086.vortex	1.0	vortex-file-compressed	191.16 MB	191.09 MB	73.99 KB	-0.0%
hits_054.vortex	1.0	vortex-file-compressed	146.13 MB	146.07 MB	61.18 KB	-0.0%
hits_078.vortex	1.0	vortex-file-compressed	130.02 MB	129.96 MB	56.29 KB	-0.0%
hits_032.vortex	1.0	vortex-file-compressed	153.84 MB	153.77 MB	69.59 KB	-0.0%
hits_080.vortex	1.0	vortex-file-compressed	126.24 MB	126.17 MB	67.19 KB	-0.1%
hits_057.vortex	1.0	vortex-file-compressed	159.23 MB	159.15 MB	86.11 KB	-0.1%
hits_011.vortex	1.0	vortex-file-compressed	198.69 MB	198.58 MB	112.49 KB	-0.1%
hits_023.vortex	1.0	vortex-file-compressed	194.44 MB	194.33 MB	120.65 KB	-0.1%
hits_000.vortex	1.0	vortex-file-compressed	130.60 MB	130.52 MB	83.93 KB	-0.1%
hits_009.vortex	1.0	vortex-file-compressed	100.73 MB	100.67 MB	67.70 KB	-0.1%
hits_043.vortex	1.0	vortex-file-compressed	125.90 MB	125.82 MB	88.30 KB	-0.1%
hits_083.vortex	1.0	vortex-file-compressed	156.17 MB	156.05 MB	113.57 KB	-0.1%
hits_039.vortex	1.0	vortex-file-compressed	160.13 MB	160.01 MB	118.98 KB	-0.1%
hits_068.vortex	1.0	vortex-file-compressed	159.49 MB	159.37 MB	125.27 KB	-0.1%
hits_084.vortex	1.0	vortex-file-compressed	153.70 MB	153.58 MB	124.19 KB	-0.1%
hits_053.vortex	1.0	vortex-file-compressed	188.95 MB	188.79 MB	159.46 KB	-0.1%
hits_093.vortex	1.0	vortex-file-compressed	130.75 MB	130.64 MB	113.85 KB	-0.1%
hits_038.vortex	1.0	vortex-file-compressed	189.05 MB	188.89 MB	165.28 KB	-0.1%
hits_002.vortex	1.0	vortex-file-compressed	160.19 MB	160.05 MB	145.75 KB	-0.1%
hits_077.vortex	1.0	vortex-file-compressed	171.66 MB	171.49 MB	168.23 KB	-0.1%
hits_075.vortex	1.0	vortex-file-compressed	188.68 MB	188.50 MB	188.02 KB	-0.1%
hits_079.vortex	1.0	vortex-file-compressed	180.01 MB	179.82 MB	200.33 KB	-0.1%
hits_036.vortex	1.0	vortex-file-compressed	170.93 MB	170.73 MB	201.45 KB	-0.1%
hits_073.vortex	1.0	vortex-file-compressed	172.03 MB	171.83 MB	206.32 KB	-0.1%
hits_010.vortex	1.0	vortex-file-compressed	168.25 MB	168.00 MB	254.85 KB	-0.1%
hits_050.vortex	1.0	vortex-file-compressed	160.19 MB	159.94 MB	256.99 KB	-0.2%
hits_005.vortex	1.0	vortex-file-compressed	166.73 MB	166.45 MB	278.48 KB	-0.2%
hits_099.vortex	1.0	vortex-file-compressed	170.89 MB	170.61 MB	291.12 KB	-0.2%
hits_008.vortex	1.0	vortex-file-compressed	139.04 MB	138.80 MB	248.24 KB	-0.2%
hits_004.vortex	1.0	vortex-file-compressed	130.87 MB	130.64 MB	235.08 KB	-0.2%
hits_091.vortex	1.0	vortex-file-compressed	146.44 MB	146.11 MB	338.87 KB	-0.2%
hits_020.vortex	1.0	vortex-file-compressed	159.54 MB	159.14 MB	409.09 KB	-0.3%
hits_094.vortex	1.0	vortex-file-compressed	157.79 MB	157.36 MB	438.05 KB	-0.3%
hits_095.vortex	1.0	vortex-file-compressed	153.84 MB	153.38 MB	472.19 KB	-0.3%
hits_016.vortex	1.0	vortex-file-compressed	180.04 MB	179.47 MB	576.50 KB	-0.3%
hits_029.vortex	1.0	vortex-file-compressed	198.95 MB	198.31 MB	655.98 KB	-0.3%
hits_065.vortex	1.0	vortex-file-compressed	160.72 MB	160.16 MB	579.41 KB	-0.4%
hits_059.vortex	1.0	vortex-file-compressed	198.29 MB	197.38 MB	930.18 KB	-0.5%
hits_090.vortex	1.0	vortex-file-compressed	194.37 MB	193.36 MB	1.01 MB	-0.5%
hits_096.vortex	1.0	vortex-file-compressed	198.77 MB	197.61 MB	1.16 MB	-0.6%
hits_040.vortex	1.0	vortex-file-compressed	143.02 MB	142.13 MB	915.45 KB	-0.6%
hits_055.vortex	1.0	vortex-file-compressed	199.03 MB	197.63 MB	1.41 MB	-0.7%
hits_051.vortex	1.0	vortex-file-compressed	172.98 MB	171.71 MB	1.27 MB	-0.7%
hits_076.vortex	1.0	vortex-file-compressed	159.95 MB	158.59 MB	1.36 MB	-0.9%

Totals:

vortex-file-compressed: 15.88 GB → 15.88 GB (-0.0%)

github-actions · 2026-09-09T18:40:35Z

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 2ae4de65 vs base 2a5b1a79
Verdict: Likely regression (low confidence)
Attributed Vortex impact: +20.2%
Engines: DuckDB Likely regression (+20.2%, low confidence)
Vortex (geomean): hot 1.212x ❌ · cold 1.204x ❌
Parquet (geomean): hot 1.009x ➖ · cold 1.020x ➖
Shifts: Parquet (control) +0.9% · Median polish +1.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.212x ❌, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed	8998948 / 8975234 / +0.3%	9519789 / 9441941 / +0.8%	0.95 / 0.95 / -0.6%
statpopgen_q01/duckdb:vortex-file-compressed	10547808 / 10360788 / +1.8%	16545001 / 16073639 / +2.9%	0.64 / 0.64 / -1.1%
statpopgen_q02/duckdb:vortex-file-compressed	381083881 / 378367276 / +0.7%	400340951 / 392775972 / +1.9%	0.95 / 0.96 / -1.2%
statpopgen_q03/duckdb:vortex-file-compressed	892453588 / 896984627 / -0.5%	896643751 / 904291836 / -0.8%	1.00 / 0.99 / +0.3%
statpopgen_q04/duckdb:vortex-file-compressed	898667570 / 892750499 / +0.7%	910649319 / 891043166 / +2.2%	0.99 / 1.00 / -1.5%
statpopgen_q05/duckdb:vortex-file-compressed	423293071 / 423819106 / -0.1%	439299641 / 436046273 / +0.7%	0.96 / 0.97 / -0.9%
statpopgen_q06/duckdb:vortex-file-compressed	1169977146 / 1172577476 / -0.2%	1174878742 / 1169346814 / +0.5%	1.00 / 1.00 / -0.7%
statpopgen_q07/duckdb:vortex-file-compressed	547579302 / 184397934 / +197.0% 🔴	563179975 / 200793956 / +180.5% 🔴	0.97 / 0.92 / +5.9%
statpopgen_q08/duckdb:vortex-file-compressed	559483685 / 203515113 / +174.9% 🔴	598565152 / 241982650 / +147.4% 🔴	0.93 / 0.84 / +11.1%
statpopgen_q09/duckdb:vortex-file-compressed	708141132 / 711248740 / -0.4%	752328276 / 732523098 / +2.7%	0.94 / 0.97 / -3.1%
statpopgen_q10/duckdb:vortex-file-compressed	1998367746 / 2010496259 / -0.6%	1975576223 / 1976905747 / -0.1%	1.01 / 1.02 / -0.5%

duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet	245925802 / 247047211 / -0.5%	246275024 / 248521027 / -0.9%	1.00 / 0.99 / +0.5%
statpopgen_q01/duckdb:parquet	301324478 / 307038943 / -1.9%	304651754 / 307529089 / -0.9%	0.99 / 1.00 / -0.9%
statpopgen_q02/duckdb:parquet	566783640 / 528424200 / +7.3%	573459532 / 552660500 / +3.8%	0.99 / 0.96 / +3.4%
statpopgen_q03/duckdb:parquet	835283120 / 845032199 / -1.2%	875083847 / 852801130 / +2.6%	0.95 / 0.99 / -3.7%
statpopgen_q04/duckdb:parquet	882821248 / 817311144 / +8.0%	894550252 / 829362038 / +7.9%	0.99 / 0.99 / +0.1%
statpopgen_q05/duckdb:parquet	580303118 / 587778152 / -1.3%	581639202 / 589297522 / -1.3%	1.00 / 1.00 / +0.0%
statpopgen_q06/duckdb:parquet	742170804 / 720766509 / +3.0%	747125630 / 716917039 / +4.2%	0.99 / 1.01 / -1.2%
statpopgen_q07/duckdb:parquet	611268436 / 621871870 / -1.7%	699743446 / 663361652 / +5.5%	0.87 / 0.94 / -6.8%
statpopgen_q08/duckdb:parquet	617598018 / 624055728 / -1.0%	722094212 / 700821413 / +3.0%	0.86 / 0.89 / -4.0%
statpopgen_q09/duckdb:parquet	807681974 / 774726169 / +4.3%	832459809 / 819230006 / +1.6%	0.97 / 0.95 / +2.6%
statpopgen_q10/duckdb:parquet	1523110542 / 1596718321 / -4.6%	1288294338 / 1329428363 / -3.1%	1.18 / 1.20 / -1.6%

No file size changes detected.

github-actions · 2026-09-09T18:40:36Z

Benchmarks: Clickbench on NVME 📖

Commits: PR f83e38f5 vs base 1ee4e3a5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+1.0%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 1.008x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.7%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1268409 / 1234190 / +2.8%	21731014 / 21188085 / +2.6%	0.06 / 0.06 / +0.2%
clickbench_q01/datafusion:vortex-file-compressed	5703366 / 5838156 / -2.3%	34151866 / 30854110 / +10.7% 🔴	0.17 / 0.19 / -11.7%
clickbench_q02/datafusion:vortex-file-compressed	9883584 / 9943054 / -0.6%	40166548 / 35753560 / +12.3% 🔴	0.25 / 0.28 / -11.5%
clickbench_q03/datafusion:vortex-file-compressed	12285126 / 11772371 / +4.4%	51280518 / 55687982 / -7.9%	0.24 / 0.21 / +13.3%
clickbench_q04/datafusion:vortex-file-compressed	56631223 / 56360237 / +0.5%	93503828 / 92551801 / +1.0%	0.61 / 0.61 / -0.5%
clickbench_q05/datafusion:vortex-file-compressed	72697900 / 73789782 / -1.5%	116695313 / 119063543 / -2.0%	0.62 / 0.62 / +0.5%
clickbench_q06/datafusion:vortex-file-compressed	1247375 / 1224848 / +1.8%	21203668 / 20129094 / +5.3%	0.06 / 0.06 / -3.3%
clickbench_q07/datafusion:vortex-file-compressed	10028786 / 9730590 / +3.1%	36049837 / 33288032 / +8.3%	0.28 / 0.29 / -4.8%
clickbench_q08/datafusion:vortex-file-compressed	76707911 / 75445500 / +1.7%	114273882 / 115352674 / -0.9%	0.67 / 0.65 / +2.6%
clickbench_q09/datafusion:vortex-file-compressed	174412542 / 174053872 / +0.2%	208225083 / 209487802 / -0.6%	0.84 / 0.83 / +0.8%
clickbench_q10/datafusion:vortex-file-compressed	24045248 / 23473963 / +2.4%	69883388 / 65165160 / +7.2%	0.34 / 0.36 / -4.5%
clickbench_q11/datafusion:vortex-file-compressed	25969844 / 25570096 / +1.6%	70117077 / 70013724 / +0.1%	0.37 / 0.37 / +1.4%
clickbench_q12/datafusion:vortex-file-compressed	72045908 / 71827082 / +0.3%	121574022 / 113024820 / +7.6%	0.59 / 0.64 / -6.7%
clickbench_q13/datafusion:vortex-file-compressed	118113716 / 117451774 / +0.6%	180467352 / 178723863 / +1.0%	0.65 / 0.66 / -0.4%
clickbench_q14/datafusion:vortex-file-compressed	74391946 / 73446342 / +1.3%	122045492 / 118406318 / +3.1%	0.61 / 0.62 / -1.7%
clickbench_q15/datafusion:vortex-file-compressed	61163796 / 61555935 / -0.6%	97693899 / 99669740 / -2.0%	0.63 / 0.62 / +1.4%
clickbench_q16/datafusion:vortex-file-compressed	150657826 / 148628586 / +1.4%	206506182 / 207599956 / -0.5%	0.73 / 0.72 / +1.9%
clickbench_q17/datafusion:vortex-file-compressed	150749924 / 149771748 / +0.7%	210067604 / 211601177 / -0.7%	0.72 / 0.71 / +1.4%
clickbench_q18/datafusion:vortex-file-compressed	295801551 / 292387289 / +1.2%	374947758 / 374222279 / +0.2%	0.79 / 0.78 / +1.0%
clickbench_q19/datafusion:vortex-file-compressed	7481030 / 7225079 / +3.5%	49413147 / 51134919 / -3.4%	0.15 / 0.14 / +7.2%
clickbench_q20/datafusion:vortex-file-compressed	62137210 / 62343854 / -0.3%	230903984 / 230225506 / +0.3%	0.27 / 0.27 / -0.6%
clickbench_q21/datafusion:vortex-file-compressed	88435156 / 89972455 / -1.7%	269546426 / 272604036 / -1.1%	0.33 / 0.33 / -0.6%
clickbench_q22/datafusion:vortex-file-compressed	100083158 / 99669012 / +0.4%	349513293 / 347808414 / +0.5%	0.29 / 0.29 / -0.1%
clickbench_q23/datafusion:vortex-file-compressed	183915620 / 198066100 / -7.1%	520131209 / 530971605 / -2.0%	0.35 / 0.37 / -5.2%
clickbench_q24/datafusion:vortex-file-compressed	16531334 / 15913282 / +3.9%	64989304 / 66394743 / -2.1%	0.25 / 0.24 / +6.1%
clickbench_q25/datafusion:vortex-file-compressed	17229934 / 17194940 / +0.2%	58784405 / 55185624 / +6.5%	0.29 / 0.31 / -5.9%
clickbench_q26/datafusion:vortex-file-compressed	16378200 / 16513788 / -0.8%	68330710 / 68488111 / -0.2%	0.24 / 0.24 / -0.6%
clickbench_q27/datafusion:vortex-file-compressed	97944468 / 98206358 / -0.3%	246161129 / 242010224 / +1.7%	0.40 / 0.41 / -1.9%
clickbench_q28/datafusion:vortex-file-compressed	565166908 / 560402392 / +0.9%	629605877 / 620303191 / +1.5%	0.90 / 0.90 / -0.6%
clickbench_q29/datafusion:vortex-file-compressed	22735955 / 22649548 / +0.4%	50195911 / 50437244 / -0.5%	0.45 / 0.45 / +0.9%
clickbench_q30/datafusion:vortex-file-compressed	59454553 / 57549879 / +3.3%	104945346 / 106008498 / -1.0%	0.57 / 0.54 / +4.4%
clickbench_q31/datafusion:vortex-file-compressed	70645007 / 68164090 / +3.6%	156708318 / 153498278 / +2.1%	0.45 / 0.44 / +1.5%
clickbench_q32/datafusion:vortex-file-compressed	305961884 / 292864124 / +4.5%	385102369 / 379699762 / +1.4%	0.79 / 0.77 / +3.0%
clickbench_q33/datafusion:vortex-file-compressed	327574342 / 330864076 / -1.0%	427361637 / 432578367 / -1.2%	0.77 / 0.76 / +0.2%
clickbench_q34/datafusion:vortex-file-compressed	328841622 / 333001021 / -1.2%	443887980 / 425768243 / +4.3%	0.74 / 0.78 / -5.3%
clickbench_q35/datafusion:vortex-file-compressed	56564849 / 54973444 / +2.9%	87949548 / 88915075 / -1.1%	0.64 / 0.62 / +4.0%
clickbench_q36/datafusion:vortex-file-compressed	37623260 / 37009244 / +1.7%	65736805 / 65014672 / +1.1%	0.57 / 0.57 / +0.5%
clickbench_q37/datafusion:vortex-file-compressed	21765544 / 21509818 / +1.2%	48270280 / 47161632 / +2.4%	0.45 / 0.46 / -1.1%
clickbench_q38/datafusion:vortex-file-compressed	11574493 / 11753530 / -1.5%	39954226 / 39114364 / +2.1%	0.29 / 0.30 / -3.6%
clickbench_q39/datafusion:vortex-file-compressed	77438972 / 77840152 / -0.5%	110408831 / 109476013 / +0.9%	0.70 / 0.71 / -1.4%
clickbench_q40/datafusion:vortex-file-compressed	11217701 / 11333608 / -1.0%	37042346 / 36470806 / +1.6%	0.30 / 0.31 / -2.5%
clickbench_q41/datafusion:vortex-file-compressed	10500804 / 10506053 / -0.0%	35958366 / 36053495 / -0.3%	0.29 / 0.29 / +0.2%
clickbench_q42/datafusion:vortex-file-compressed	11202711 / 10936831 / +2.4%	36328577 / 35853057 / +1.3%	0.31 / 0.31 / +1.1%

datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1267486 / 1260556 / +0.5%	49431432 / 49565112 / -0.3%	0.03 / 0.03 / +0.8%
clickbench_q01/datafusion:parquet	15795346 / 16393462 / -3.6%	68730265 / 72725471 / -5.5%	0.23 / 0.23 / +2.0%
clickbench_q02/datafusion:parquet	20244632 / 19723850 / +2.6%	83417744 / 82768311 / +0.8%	0.24 / 0.24 / +1.8%
clickbench_q03/datafusion:parquet	17077409 / 16707672 / +2.2%	80019435 / 82354731 / -2.8%	0.21 / 0.20 / +5.2%
clickbench_q04/datafusion:parquet	63381975 / 64473014 / -1.7%	129402672 / 127230498 / +1.7%	0.49 / 0.51 / -3.3%
clickbench_q05/datafusion:parquet	89231366 / 88380676 / +1.0%	161530776 / 159529360 / +1.3%	0.55 / 0.55 / -0.3%
clickbench_q06/datafusion:parquet	1264324 / 1296288 / -2.5%	49810623 / 49315736 / +1.0%	0.03 / 0.03 / -3.4%
clickbench_q07/datafusion:parquet	16678336 / 16705090 / -0.2%	67985650 / 68523940 / -0.8%	0.25 / 0.24 / +0.6%
clickbench_q08/datafusion:parquet	85310190 / 86479885 / -1.4%	161759648 / 164639981 / -1.7%	0.53 / 0.53 / +0.4%
clickbench_q09/datafusion:parquet	187720934 / 190234190 / -1.3%	265257027 / 267430476 / -0.8%	0.71 / 0.71 / -0.5%
clickbench_q10/datafusion:parquet	36236256 / 36655157 / -1.1%	101922323 / 101324712 / +0.6%	0.36 / 0.36 / -1.7%
clickbench_q11/datafusion:parquet	44093744 / 44220246 / -0.3%	111949206 / 110379063 / +1.4%	0.39 / 0.40 / -1.7%
clickbench_q12/datafusion:parquet	97030876 / 95946030 / +1.1%	167950935 / 163046900 / +3.0%	0.58 / 0.59 / -1.8%
clickbench_q13/datafusion:parquet	148201638 / 149399062 / -0.8%	228640201 / 227208868 / +0.6%	0.65 / 0.66 / -1.4%
clickbench_q14/datafusion:parquet	102248920 / 101858303 / +0.4%	174581868 / 176165258 / -0.9%	0.59 / 0.58 / +1.3%
clickbench_q15/datafusion:parquet	72789408 / 72672851 / +0.2%	130447125 / 134423618 / -3.0%	0.56 / 0.54 / +3.2%
clickbench_q16/datafusion:parquet	156179936 / 157810032 / -1.0%	240661707 / 239725985 / +0.4%	0.65 / 0.66 / -1.4%
clickbench_q17/datafusion:parquet	154720544 / 156265400 / -1.0%	239534151 / 236984605 / +1.1%	0.65 / 0.66 / -2.0%
clickbench_q18/datafusion:parquet	312707551 / 313195483 / -0.2%	422357238 / 420168546 / +0.5%	0.74 / 0.75 / -0.7%
clickbench_q19/datafusion:parquet	18638256 / 19024392 / -2.0%	76907249 / 77539215 / -0.8%	0.24 / 0.25 / -1.2%
clickbench_q20/datafusion:parquet	177675410 / 179178022 / -0.8%	287202708 / 285913289 / +0.5%	0.62 / 0.63 / -1.3%
clickbench_q21/datafusion:parquet	174562903 / 174392794 / +0.1%	303249219 / 301180743 / +0.7%	0.58 / 0.58 / -0.6%
clickbench_q22/datafusion:parquet	263366526 / 260681822 / +1.0%	426546846 / 431126135 / -1.1%	0.62 / 0.60 / +2.1%
clickbench_q23/datafusion:parquet	1117787297 / 1124117806 / -0.6%	1242182711 / 1237459155 / +0.4%	0.90 / 0.91 / -0.9%
clickbench_q24/datafusion:parquet	29932869 / 30375919 / -1.5%	90921788 / 88717476 / +2.5%	0.33 / 0.34 / -3.8%
clickbench_q25/datafusion:parquet	37206170 / 36766498 / +1.2%	104076715 / 104912782 / -0.8%	0.36 / 0.35 / +2.0%
clickbench_q26/datafusion:parquet	30968178 / 30858774 / +0.4%	89936326 / 89910131 / +0.0%	0.34 / 0.34 / +0.3%
clickbench_q27/datafusion:parquet	194546860 / 195745822 / -0.6%	293224164 / 290170569 / +1.1%	0.66 / 0.67 / -1.6%
clickbench_q28/datafusion:parquet	624326658 / 621401598 / +0.5%	718352512 / 704451242 / +2.0%	0.87 / 0.88 / -1.5%
clickbench_q29/datafusion:parquet	28807910 / 29064041 / -0.9%	91600783 / 92651152 / -1.1%	0.31 / 0.31 / +0.3%
clickbench_q30/datafusion:parquet	90862928 / 90800092 / +0.1%	176440166 / 176603137 / -0.1%	0.51 / 0.51 / +0.2%
clickbench_q31/datafusion:parquet	102909641 / 102565887 / +0.3%	199248701 / 201789287 / -1.3%	0.52 / 0.51 / +1.6%
clickbench_q32/datafusion:parquet	325041662 / 329913489 / -1.5%	424975127 / 431002439 / -1.4%	0.76 / 0.77 / -0.1%
clickbench_q33/datafusion:parquet	382934432 / 382161571 / +0.2%	488618291 / 478223975 / +2.2%	0.78 / 0.80 / -1.9%
clickbench_q34/datafusion:parquet	382086882 / 379343225 / +0.7%	482234563 / 480579105 / +0.3%	0.79 / 0.79 / +0.4%
clickbench_q35/datafusion:parquet	63985024 / 64542868 / -0.9%	126057606 / 130196799 / -3.2%	0.51 / 0.50 / +2.4%
clickbench_q36/datafusion:parquet	73509718 / 73447406 / +0.1%	136775777 / 136592209 / +0.1%	0.54 / 0.54 / -0.0%
clickbench_q37/datafusion:parquet	35715029 / 35637842 / +0.2%	91771405 / 91655026 / +0.1%	0.39 / 0.39 / +0.1%
clickbench_q38/datafusion:parquet	47448452 / 47603802 / -0.3%	109874001 / 110508755 / -0.6%	0.43 / 0.43 / +0.2%
clickbench_q39/datafusion:parquet	143426816 / 142660758 / +0.5%	212188153 / 211552015 / +0.3%	0.68 / 0.67 / +0.2%
clickbench_q40/datafusion:parquet	20077107 / 20096392 / -0.1%	79836358 / 78117025 / +2.2%	0.25 / 0.26 / -2.2%
clickbench_q41/datafusion:parquet	18669726 / 19050624 / -2.0%	77114076 / 75638056 / +2.0%	0.24 / 0.25 / -3.9%
clickbench_q42/datafusion:parquet	19461319 / 19411959 / +0.3%	75529619 / 75485047 / +0.1%	0.26 / 0.26 / +0.2%

duckdb / vortex-file-compressed / ns (1.006x ➖, 1↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	1568652 / 1546012 / +1.5%	22966852 / 23013744 / -0.2%	0.07 / 0.07 / +1.7%
clickbench_q01/duckdb:vortex-file-compressed	11844563 / 11788770 / +0.5%	29206462 / 32707082 / -10.7% 🟢	0.41 / 0.36 / +12.5%
clickbench_q02/duckdb:vortex-file-compressed	12942985 / 15965090 / -18.9% 🟢	35735723 / 37683950 / -5.2%	0.36 / 0.42 / -14.5%
clickbench_q03/duckdb:vortex-file-compressed	18350149 / 19573800 / -6.3%	51677186 / 52331728 / -1.3%	0.36 / 0.37 / -5.1%
clickbench_q04/duckdb:vortex-file-compressed	69103074 / 66622826 / +3.7%	109466871 / 108952980 / +0.5%	0.63 / 0.61 / +3.2%
clickbench_q05/duckdb:vortex-file-compressed	68831500 / 67638726 / +1.8%	97529108 / 96380620 / +1.2%	0.71 / 0.70 / +0.6%
clickbench_q06/duckdb:vortex-file-compressed	1791222 / 1823818 / -1.8%	32034278 / 31543565 / +1.6%	0.06 / 0.06 / -3.3%
clickbench_q07/duckdb:vortex-file-compressed	16602424 / 13987221 / +18.7% 🔴	33403751 / 34157303 / -2.2%	0.50 / 0.41 / +21.4%
clickbench_q08/duckdb:vortex-file-compressed	84955072 / 88728789 / -4.3%	125970554 / 124500669 / +1.2%	0.67 / 0.71 / -5.4%
clickbench_q09/duckdb:vortex-file-compressed	106764688 / 113325800 / -5.8%	147386993 / 147701196 / -0.2%	0.72 / 0.77 / -5.6%
clickbench_q10/duckdb:vortex-file-compressed	31747530 / 32707314 / -2.9%	72431404 / 71327724 / +1.5%	0.44 / 0.46 / -4.4%
clickbench_q11/duckdb:vortex-file-compressed	34884850 / 37463138 / -6.9%	75822871 / 75033418 / +1.1%	0.46 / 0.50 / -7.9%
clickbench_q12/duckdb:vortex-file-compressed	74311269 / 76144766 / -2.4%	105406960 / 106243614 / -0.8%	0.70 / 0.72 / -1.6%
clickbench_q13/duckdb:vortex-file-compressed	139081886 / 132927226 / +4.6%	184687424 / 183460671 / +0.7%	0.75 / 0.72 / +3.9%
clickbench_q14/duckdb:vortex-file-compressed	79480796 / 77157532 / +3.0%	111417029 / 110354461 / +1.0%	0.71 / 0.70 / +2.0%
clickbench_q15/duckdb:vortex-file-compressed	90445914 / 91209685 / -0.8%	133449554 / 131665332 / +1.4%	0.68 / 0.69 / -2.2%
clickbench_q16/duckdb:vortex-file-compressed	162272867 / 159347852 / +1.8%	233586234 / 238343105 / -2.0%	0.69 / 0.67 / +3.9%
clickbench_q17/duckdb:vortex-file-compressed	163559552 / 161157960 / +1.5%	234317044 / 207572496 / +12.9% 🔴	0.70 / 0.78 / -10.1%
clickbench_q18/duckdb:vortex-file-compressed	325029554 / 319476776 / +1.7%	376700945 / 380873961 / -1.1%	0.86 / 0.84 / +2.9%
clickbench_q19/duckdb:vortex-file-compressed	18920856 / 16470016 / +14.9% 🔴	40984996 / 42647932 / -3.9%	0.46 / 0.39 / +19.5%
clickbench_q20/duckdb:vortex-file-compressed	109440963 / 110822508 / -1.2%	192842238 / 196699176 / -2.0%	0.57 / 0.56 / +0.7%
clickbench_q21/duckdb:vortex-file-compressed	157474758 / 157469413 / +0.0%	306119353 / 306081385 / +0.0%	0.51 / 0.51 / -0.0%
clickbench_q22/duckdb:vortex-file-compressed	235259115 / 233911787 / +0.6%	459949039 / 466061441 / -1.3%	0.51 / 0.50 / +1.9%
clickbench_q23/duckdb:vortex-file-compressed	59407861 / 59748716 / -0.6%	97711436 / 100323722 / -2.6%	0.61 / 0.60 / +2.1%
clickbench_q24/duckdb:vortex-file-compressed	28121122 / 25930587 / +8.4%	49170039 / 41753555 / +17.8% 🔴	0.57 / 0.62 / -7.9%
clickbench_q25/duckdb:vortex-file-compressed	32757294 / 31393554 / +4.3%	55101901 / 54756595 / +0.6%	0.59 / 0.57 / +3.7%
clickbench_q26/duckdb:vortex-file-compressed	21291734 / 20131345 / +5.8%	37593610 / 40347461 / -6.8%	0.57 / 0.50 / +13.5%
clickbench_q27/duckdb:vortex-file-compressed	133077914 / 133175008 / -0.1%	247776022 / 244619727 / +1.3%	0.54 / 0.54 / -1.3%
clickbench_q28/duckdb:vortex-file-compressed	774348998 / 757698416 / +2.2%	686625406 / 717548073 / -4.3%	1.13 / 1.06 / +6.8%
clickbench_q29/duckdb:vortex-file-compressed	19064057 / 18416324 / +3.5%	36758288 / 40652840 / -9.6%	0.52 / 0.45 / +14.5%
clickbench_q30/duckdb:vortex-file-compressed	64626347 / 66724558 / -3.1%	115361511 / 113105843 / +2.0%	0.56 / 0.59 / -5.0%
clickbench_q31/duckdb:vortex-file-compressed	124082462 / 122503118 / +1.3%	213216380 / 209515367 / +1.8%	0.58 / 0.58 / -0.5%
clickbench_q32/duckdb:vortex-file-compressed	449441866 / 480475124 / -6.5%	483991326 / 534205976 / -9.4%	0.93 / 0.90 / +3.2%
clickbench_q33/duckdb:vortex-file-compressed	394855330 / 387943310 / +1.8%	500843979 / 498848644 / +0.4%	0.79 / 0.78 / +1.4%
clickbench_q34/duckdb:vortex-file-compressed	413331396 / 403484788 / +2.4%	515404693 / 526533125 / -2.1%	0.80 / 0.77 / +4.7%
clickbench_q35/duckdb:vortex-file-compressed	103165796 / 104517113 / -1.3%	145045479 / 134937173 / +7.5%	0.71 / 0.77 / -8.2%
clickbench_q36/duckdb:vortex-file-compressed	15520082 / 15675590 / -1.0%	33734998 / 32210778 / +4.7%	0.46 / 0.49 / -5.5%
clickbench_q37/duckdb:vortex-file-compressed	12038044 / 11577304 / +4.0%	30740024 / 26836265 / +14.5% 🔴	0.39 / 0.43 / -9.2%
clickbench_q38/duckdb:vortex-file-compressed	13385182 / 12891878 / +3.8%	28745086 / 28399385 / +1.2%	0.47 / 0.45 / +2.6%
clickbench_q39/duckdb:vortex-file-compressed	22813188 / 22627898 / +0.8%	42970828 / 40518153 / +6.1%	0.53 / 0.56 / -4.9%
clickbench_q40/duckdb:vortex-file-compressed	11988150 / 11906006 / +0.7%	28289745 / 29915868 / -5.4%	0.42 / 0.40 / +6.5%
clickbench_q41/duckdb:vortex-file-compressed	12016604 / 10887366 / +10.4% 🔴	28431466 / 26368243 / +7.8%	0.42 / 0.41 / +2.4%
clickbench_q42/duckdb:vortex-file-compressed	11605434 / 12194338 / -4.8%	27592732 / 27522900 / +0.3%	0.42 / 0.44 / -5.1%

duckdb / parquet / ns (1.005x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	9273666 / 10536835 / -12.0% 🟢	22785797 / 18759933 / +21.5% 🔴	0.41 / 0.56 / -27.5%
clickbench_q01/duckdb:parquet	9064090 / 9416458 / -3.7%	19362664 / 18822615 / +2.9%	0.47 / 0.50 / -6.4%
clickbench_q02/duckdb:parquet	15799470 / 14964256 / +5.6%	35248674 / 33733127 / +4.5%	0.45 / 0.44 / +1.0%
clickbench_q03/duckdb:parquet	16247454 / 16290708 / -0.3%	54584246 / 53074024 / +2.8%	0.30 / 0.31 / -3.0%
clickbench_q04/duckdb:parquet	70415640 / 70108798 / +0.4%	96740017 / 105819919 / -8.6%	0.73 / 0.66 / +9.9%
clickbench_q05/duckdb:parquet	83863981 / 80854558 / +3.7%	129498954 / 118483587 / +9.3%	0.65 / 0.68 / -5.1%
clickbench_q06/duckdb:parquet	14449196 / 15453160 / -6.5%	24211656 / 23831547 / +1.6%	0.60 / 0.65 / -8.0%
clickbench_q07/duckdb:parquet	10878982 / 11468407 / -5.1%	26761711 / 26850551 / -0.3%	0.41 / 0.43 / -4.8%
clickbench_q08/duckdb:parquet	84396367 / 83237666 / +1.4%	126312176 / 123340766 / +2.4%	0.67 / 0.67 / -1.0%
clickbench_q09/duckdb:parquet	118693435 / 116346710 / +2.0%	173899175 / 160682640 / +8.2%	0.68 / 0.72 / -5.7%
clickbench_q10/duckdb:parquet	32915294 / 32678752 / +0.7%	71397492 / 68650862 / +4.0%	0.46 / 0.48 / -3.2%
clickbench_q11/duckdb:parquet	35747656 / 35801380 / -0.2%	76149058 / 75735750 / +0.5%	0.47 / 0.47 / -0.7%
clickbench_q12/duckdb:parquet	91674049 / 91116506 / +0.6%	132116886 / 133996613 / -1.4%	0.69 / 0.68 / +2.0%
clickbench_q13/duckdb:parquet	147747116 / 143139408 / +3.2%	206238552 / 206209202 / +0.0%	0.72 / 0.69 / +3.2%
clickbench_q14/duckdb:parquet	95912548 / 95693002 / +0.2%	152973812 / 144353244 / +6.0%	0.63 / 0.66 / -5.4%
clickbench_q15/duckdb:parquet	95059789 / 93302684 / +1.9%	125935936 / 127316794 / -1.1%	0.75 / 0.73 / +3.0%
clickbench_q16/duckdb:parquet	172182228 / 171679054 / +0.3%	238782752 / 227158260 / +5.1%	0.72 / 0.76 / -4.6%
clickbench_q17/duckdb:parquet	177927338 / 176166976 / +1.0%	237095649 / 253941066 / -6.6%	0.75 / 0.69 / +8.2%
clickbench_q18/duckdb:parquet	330799773 / 328187110 / +0.8%	405777537 / 408292997 / -0.6%	0.82 / 0.80 / +1.4%
clickbench_q19/duckdb:parquet	12989046 / 13493432 / -3.7%	43429404 / 42853880 / +1.3%	0.30 / 0.31 / -5.0%
clickbench_q20/duckdb:parquet	133601688 / 129788506 / +2.9%	244268332 / 245479089 / -0.5%	0.55 / 0.53 / +3.4%
clickbench_q21/duckdb:parquet	179647346 / 177159608 / +1.4%	321998771 / 323821472 / -0.6%	0.56 / 0.55 / +2.0%
clickbench_q22/duckdb:parquet	241211424 / 232747570 / +3.6%	411005174 / 415605190 / -1.1%	0.59 / 0.56 / +4.8%
clickbench_q23/duckdb:parquet	145798617 / 149365329 / -2.4%	168188888 / 168469991 / -0.2%	0.87 / 0.89 / -2.2%
clickbench_q24/duckdb:parquet	43774410 / 42498490 / +3.0%	65185344 / 62204838 / +4.8%	0.67 / 0.68 / -1.7%
clickbench_q25/duckdb:parquet	40662296 / 39692683 / +2.4%	90946128 / 92588155 / -1.8%	0.45 / 0.43 / +4.3%
clickbench_q26/duckdb:parquet	30648524 / 31568114 / -2.9%	49233524 / 45313739 / +8.7%	0.62 / 0.70 / -10.6%
clickbench_q27/duckdb:parquet	150554004 / 145874855 / +3.2%	258228661 / 264395081 / -2.3%	0.58 / 0.55 / +5.7%
clickbench_q28/duckdb:parquet	900040207 / 905740036 / -0.6%	990966662 / 1035198234 / -4.3%	0.91 / 0.87 / +3.8%
clickbench_q29/duckdb:parquet	17440457 / 16658200 / +4.7%	29969198 / 31839602 / -5.9%	0.58 / 0.52 / +11.2%
clickbench_q30/duckdb:parquet	91506156 / 91068563 / +0.5%	172777238 / 174534392 / -1.0%	0.53 / 0.52 / +1.5%
clickbench_q31/duckdb:parquet	145573839 / 143254375 / +1.6%	289294726 / 290726416 / -0.5%	0.50 / 0.49 / +2.1%
clickbench_q32/duckdb:parquet	455259876 / 460465862 / -1.1%	487163357 / 539101113 / -9.6%	0.93 / 0.85 / +9.4%
clickbench_q33/duckdb:parquet	478239370 / 448353744 / +6.7%	479498536 / 473575896 / +1.3%	1.00 / 0.95 / +5.3%
clickbench_q34/duckdb:parquet	456958185 / 460843101 / -0.8%	483354413 / 529922915 / -8.8%	0.95 / 0.87 / +8.7%
clickbench_q35/duckdb:parquet	110757736 / 100081672 / +10.7% 🔴	129486245 / 134686448 / -3.9%	0.86 / 0.74 / +15.1%
clickbench_q36/duckdb:parquet	31089478 / 30808174 / +0.9%	42239218 / 40973474 / +3.1%	0.74 / 0.75 / -2.1%
clickbench_q37/duckdb:parquet	23340566 / 22719226 / +2.7%	31440110 / 33906161 / -7.3%	0.74 / 0.67 / +10.8%
clickbench_q38/duckdb:parquet	23664852 / 24333395 / -2.7%	32799732 / 34318454 / -4.4%	0.72 / 0.71 / +1.8%
clickbench_q39/duckdb:parquet	57268700 / 56806620 / +0.8%	66487637 / 66319633 / +0.3%	0.86 / 0.86 / +0.6%
clickbench_q40/duckdb:parquet	12937788 / 12937876 / -0.0%	22730217 / 23734760 / -4.2%	0.57 / 0.55 / +4.4%
clickbench_q41/duckdb:parquet	12923047 / 13143245 / -1.7%	22951663 / 22141699 / +3.7%	0.56 / 0.59 / -5.1%
clickbench_q42/duckdb:parquet	14480772 / 14624454 / -1.0%	24283219 / 24007869 / +1.1%	0.60 / 0.61 / -2.1%

No file size changes detected.

github-actions · 2026-09-09T18:40:37Z

Benchmarks: FineWeb S3 📖

Commits: PR 2ae4de65 vs base 2a5b1a79
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.8%
Engines: DataFusion No clear signal (-6.6%, environment too noisy confidence) · DuckDB No clear signal (+19.9%, environment too noisy confidence)
Vortex (geomean): hot 1.063x ➖ · cold 1.132x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.023x ➖
Shifts: Parquet (control) +0.5% · Median polish -0.8%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.942x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	52717770 / 57651351 / -8.6%	203771758 / 130316290 / +56.4% 🔴	0.26 / 0.44 / -41.5%
fineweb_q01/datafusion:vortex-file-compressed	379684766 / 388897790 / -2.4%	630748951 / 728350131 / -13.4%	0.60 / 0.53 / +12.7%
fineweb_q02/datafusion:vortex-file-compressed	380462118 / 393955692 / -3.4%	610137448 / 571668181 / +6.7%	0.62 / 0.69 / -9.5%
fineweb_q03/datafusion:vortex-file-compressed	499616651 / 523751784 / -4.6%	945156818 / 1086577602 / -13.0%	0.53 / 0.48 / +9.7%
fineweb_q04/datafusion:vortex-file-compressed	438294404 / 655187228 / -33.1% 🟢	459193490 / 499662182 / -8.1%	0.95 / 1.31 / -27.2%
fineweb_q05/datafusion:vortex-file-compressed	539615864 / 598380320 / -9.8%	1294559407 / 632487010 / +104.7% 🔴	0.42 / 0.95 / -55.9%
fineweb_q06/datafusion:vortex-file-compressed	836983954 / 732409192 / +14.3%	799860269 / 694670620 / +15.1%	1.05 / 1.05 / -0.8%
fineweb_q07/datafusion:vortex-file-compressed	454348914 / 493647857 / -8.0%	460326811 / 458522260 / +0.4%	0.99 / 1.08 / -8.3%
fineweb_q08/datafusion:vortex-file-compressed	198339651 / 176754571 / +12.2%	244876849 / 206735558 / +18.4%	0.81 / 0.85 / -5.3%

datafusion / parquet / ns (1.009x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	537186119 / 496010417 / +8.3%	869810987 / 738025355 / +17.9%	0.62 / 0.67 / -8.1%
fineweb_q01/datafusion:parquet	936947473 / 789262210 / +18.7%	844851551 / 751202949 / +12.5%	1.11 / 1.05 / +5.6%
fineweb_q02/datafusion:parquet	736493122 / 768704039 / -4.2%	704385708 / 863087003 / -18.4%	1.05 / 0.89 / +17.4%
fineweb_q03/datafusion:parquet	886597359 / 835029594 / +6.2%	1082845083 / 877757460 / +23.4%	0.82 / 0.95 / -13.9%
fineweb_q04/datafusion:parquet	726277220 / 782264563 / -7.2%	709352905 / 760561941 / -6.7%	1.02 / 1.03 / -0.5%
fineweb_q05/datafusion:parquet	831423565 / 741129776 / +12.2%	1398375332 / 779298688 / +79.4% 🔴	0.59 / 0.95 / -37.5%
fineweb_q06/datafusion:parquet	742148232 / 781198476 / -5.0%	599819738 / 790697996 / -24.1%	1.24 / 0.99 / +25.2%
fineweb_q07/datafusion:parquet	707772852 / 798645210 / -11.4%	659520767 / 800838893 / -17.6%	1.07 / 1.00 / +7.6%
fineweb_q08/datafusion:parquet	729169392 / 772525348 / -5.6%	646129607 / 924129730 / -30.1% 🟢	1.13 / 0.84 / +35.0%

duckdb / vortex-file-compressed / ns (1.200x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	74287112 / 49681347 / +49.5% 🔴	65681202 / 103367157 / -36.5% 🟢	1.13 / 0.48 / +135.3%
fineweb_q01/duckdb:vortex-file-compressed	489906252 / 408362198 / +20.0%	599573902 / 429351740 / +39.6% 🔴	0.82 / 0.95 / -14.1%
fineweb_q02/duckdb:vortex-file-compressed	735712966 / 569162411 / +29.3%	669187079 / 600167207 / +11.5%	1.10 / 0.95 / +15.9%
fineweb_q03/duckdb:vortex-file-compressed	2203706100 / 943601460 / +133.5% 🔴	2122782581 / 1073978171 / +97.7% 🔴	1.04 / 0.88 / +18.2%
fineweb_q04/duckdb:vortex-file-compressed	971661882 / 941085170 / +3.2%	957433855 / 943297888 / +1.5%	1.01 / 1.00 / +1.7%
fineweb_q05/duckdb:vortex-file-compressed	974100746 / 885138505 / +10.1%	1396034420 / 993551717 / +40.5% 🔴	0.70 / 0.89 / -21.7%
fineweb_q06/duckdb:vortex-file-compressed	1217089034 / 1147442254 / +6.1%	1317587298 / 1177992433 / +11.9%	0.92 / 0.97 / -5.2%
fineweb_q07/duckdb:vortex-file-compressed	985071822 / 961160437 / +2.5%	999560191 / 984675849 / +1.5%	0.99 / 0.98 / +1.0%
fineweb_q08/duckdb:vortex-file-compressed	382889117 / 496262677 / -22.8%	484854152 / 533924425 / -9.2%	0.79 / 0.93 / -15.0%

duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	535323789 / 498965111 / +7.3%	689920100 / 510877839 / +35.0% 🔴	0.78 / 0.98 / -20.6%
fineweb_q01/duckdb:parquet	694530612 / 577296244 / +20.3%	804397369 / 552359869 / +45.6% 🔴	0.86 / 1.05 / -17.4%
fineweb_q02/duckdb:parquet	595671603 / 548350210 / +8.6%	585079428 / 562065291 / +4.1%	1.02 / 0.98 / +4.4%
fineweb_q03/duckdb:parquet	1391530938 / 1409886794 / -1.3%	1298562754 / 1652539191 / -21.4%	1.07 / 0.85 / +25.6%
fineweb_q04/duckdb:parquet	718925195 / 761604591 / -5.6%	848916056 / 779616871 / +8.9%	0.85 / 0.98 / -13.3%
fineweb_q05/duckdb:parquet	880039242 / 898241544 / -2.0%	968644706 / 802049591 / +20.8%	0.91 / 1.12 / -18.9%
fineweb_q06/duckdb:parquet	1595129817 / 1829217174 / -12.8%	1592471870 / 1756686653 / -9.3%	1.00 / 1.04 / -3.8%
fineweb_q07/duckdb:parquet	1020393584 / 1143542220 / -10.8%	980815437 / 1195319605 / -17.9%	1.04 / 0.96 / +8.7%
fineweb_q08/duckdb:parquet	496007876 / 491173509 / +1.0%	501485528 / 509509296 / -1.6%	0.99 / 0.96 / +2.6%

github-actions · 2026-09-09T18:40:38Z

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR f83e38f5 vs base 1ee4e3a5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 0.974x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.986x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	16742376 / 16329961 / +2.5%	46169209 / 48250384 / -4.3%	0.36 / 0.34 / +7.1%
tpch_q02/datafusion:vortex-file-compressed	17600013 / 16972122 / +3.7%	36318186 / 36595447 / -0.8%	0.48 / 0.46 / +4.5%
tpch_q03/datafusion:vortex-file-compressed	19361288 / 19167906 / +1.0%	48868188 / 49036440 / -0.3%	0.40 / 0.39 / +1.4%
tpch_q04/datafusion:vortex-file-compressed	9982999 / 9990990 / -0.1%	31908700 / 31444231 / +1.5%	0.31 / 0.32 / -1.5%
tpch_q05/datafusion:vortex-file-compressed	36952035 / 37059171 / -0.3%	64453133 / 64965619 / -0.8%	0.57 / 0.57 / +0.5%
tpch_q06/datafusion:vortex-file-compressed	6065888 / 6274719 / -3.3%	27954423 / 29119427 / -4.0%	0.22 / 0.22 / +0.7%
tpch_q07/datafusion:vortex-file-compressed	51816012 / 52230621 / -0.8%	79288663 / 81969464 / -3.3%	0.65 / 0.64 / +2.6%
tpch_q08/datafusion:vortex-file-compressed	51401122 / 51754731 / -0.7%	80853766 / 82520398 / -2.0%	0.64 / 0.63 / +1.4%
tpch_q09/datafusion:vortex-file-compressed	49111132 / 49617980 / -1.0%	76604632 / 77287703 / -0.9%	0.64 / 0.64 / -0.1%
tpch_q10/datafusion:vortex-file-compressed	17378901 / 16889082 / +2.9%	49595833 / 51093429 / -2.9%	0.35 / 0.33 / +6.0%
tpch_q11/datafusion:vortex-file-compressed	15016760 / 15040993 / -0.2%	32989383 / 34794411 / -5.2%	0.46 / 0.43 / +5.3%
tpch_q12/datafusion:vortex-file-compressed	22603865 / 22215152 / +1.7%	44907586 / 46283792 / -3.0%	0.50 / 0.48 / +4.9%
tpch_q13/datafusion:vortex-file-compressed	19870183 / 20203267 / -1.6%	38618003 / 40360138 / -4.3%	0.51 / 0.50 / +2.8%
tpch_q14/datafusion:vortex-file-compressed	15215047 / 15006025 / +1.4%	39848325 / 41707426 / -4.5%	0.38 / 0.36 / +6.1%
tpch_q15/datafusion:vortex-file-compressed	18287479 / 18519915 / -1.3%	44023734 / 46691786 / -5.7%	0.42 / 0.40 / +4.7%
tpch_q16/datafusion:vortex-file-compressed	18617718 / 18996380 / -2.0%	37276171 / 37200353 / +0.2%	0.50 / 0.51 / -2.2%
tpch_q17/datafusion:vortex-file-compressed	28338526 / 28485968 / -0.5%	58882920 / 58453350 / +0.7%	0.48 / 0.49 / -1.2%
tpch_q18/datafusion:vortex-file-compressed	37551233 / 36816497 / +2.0%	55975966 / 57969561 / -3.4%	0.67 / 0.64 / +5.6%
tpch_q19/datafusion:vortex-file-compressed	13410737 / 13496643 / -0.6%	36549943 / 40743062 / -10.3% 🟢	0.37 / 0.33 / +10.8%
tpch_q20/datafusion:vortex-file-compressed	20975874 / 20894042 / +0.4%	43460228 / 45275623 / -4.0%	0.48 / 0.46 / +4.6%
tpch_q21/datafusion:vortex-file-compressed	38814273 / 39046502 / -0.6%	65209816 / 66729144 / -2.3%	0.60 / 0.59 / +1.7%
tpch_q22/datafusion:vortex-file-compressed	11052195 / 11094466 / -0.4%	31902304 / 33208735 / -3.9%	0.35 / 0.33 / +3.7%

datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	72141859 / 72209383 / -0.1%	90273029 / 91184813 / -1.0%	0.80 / 0.79 / +0.9%
tpch_q02/datafusion:parquet	57327638 / 57371996 / -0.1%	75521937 / 78879842 / -4.3%	0.76 / 0.73 / +4.4%
tpch_q03/datafusion:parquet	83639791 / 84246797 / -0.7%	108319370 / 110436783 / -1.9%	0.77 / 0.76 / +1.2%
tpch_q04/datafusion:parquet	46507934 / 46804033 / -0.6%	65836927 / 66585193 / -1.1%	0.71 / 0.70 / +0.5%
tpch_q05/datafusion:parquet	98737495 / 99737330 / -1.0%	129000961 / 127466119 / +1.2%	0.77 / 0.78 / -2.2%
tpch_q06/datafusion:parquet	31812572 / 32104921 / -0.9%	51801364 / 52413883 / -1.2%	0.61 / 0.61 / +0.3%
tpch_q07/datafusion:parquet	104544973 / 107813619 / -3.0%	131951921 / 136175307 / -3.1%	0.79 / 0.79 / +0.1%
tpch_q08/datafusion:parquet	113049507 / 112489297 / +0.5%	136693802 / 143785003 / -4.9%	0.83 / 0.78 / +5.7%
tpch_q09/datafusion:parquet	131844737 / 131279860 / +0.4%	160723220 / 165587878 / -2.9%	0.82 / 0.79 / +3.5%
tpch_q10/datafusion:parquet	104711198 / 104233197 / +0.5%	133803041 / 133913185 / -0.1%	0.78 / 0.78 / +0.5%
tpch_q11/datafusion:parquet	41532397 / 40973383 / +1.4%	64455097 / 66839709 / -3.6%	0.64 / 0.61 / +5.1%
tpch_q12/datafusion:parquet	69375569 / 68813947 / +0.8%	90939988 / 92935018 / -2.1%	0.76 / 0.74 / +3.0%
tpch_q13/datafusion:parquet	187318357 / 187176349 / +0.1%	207177678 / 212542411 / -2.5%	0.90 / 0.88 / +2.7%
tpch_q14/datafusion:parquet	48120045 / 47954212 / +0.3%	72948821 / 80503867 / -9.4%	0.66 / 0.60 / +10.7%
tpch_q15/datafusion:parquet	54307410 / 54854332 / -1.0%	74423922 / 81413563 / -8.6%	0.73 / 0.67 / +8.3%
tpch_q16/datafusion:parquet	41333824 / 41312533 / +0.1%	57458748 / 61078287 / -5.9%	0.72 / 0.68 / +6.4%
tpch_q17/datafusion:parquet	128948442 / 128390484 / +0.4%	153835142 / 155923435 / -1.3%	0.84 / 0.82 / +1.8%
tpch_q18/datafusion:parquet	129527049 / 131060085 / -1.2%	152390952 / 152384452 / +0.0%	0.85 / 0.86 / -1.2%
tpch_q19/datafusion:parquet	59110525 / 58975453 / +0.2%	85497328 / 88561686 / -3.5%	0.69 / 0.67 / +3.8%
tpch_q20/datafusion:parquet	67854890 / 67990192 / -0.2%	88462728 / 94873268 / -6.8%	0.77 / 0.72 / +7.0%
tpch_q21/datafusion:parquet	107052284 / 108421054 / -1.3%	131213673 / 133306159 / -1.6%	0.82 / 0.81 / +0.3%
tpch_q22/datafusion:parquet	46600585 / 47165896 / -1.2%	63547016 / 65956986 / -3.7%	0.73 / 0.72 / +2.5%

duckdb / vortex-file-compressed / ns (1.009x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	10740064 / 11036582 / -2.7%	19860102 / 21828526 / -9.0%	0.54 / 0.51 / +7.0%
tpch_q02/duckdb:vortex-file-compressed	17212316 / 17296711 / -0.5%	26004874 / 25821863 / +0.7%	0.66 / 0.67 / -1.2%
tpch_q03/duckdb:vortex-file-compressed	18628379 / 18658319 / -0.2%	35360700 / 35596954 / -0.7%	0.53 / 0.52 / +0.5%
tpch_q04/duckdb:vortex-file-compressed	17428822 / 17381923 / +0.3%	29559375 / 31464140 / -6.1%	0.59 / 0.55 / +6.7%
tpch_q05/duckdb:vortex-file-compressed	22262975 / 22110906 / +0.7%	38716657 / 36079301 / +7.3%	0.58 / 0.61 / -6.2%
tpch_q06/duckdb:vortex-file-compressed	5629839 / 5813968 / -3.2%	15598982 / 16040637 / -2.8%	0.36 / 0.36 / -0.4%
tpch_q07/duckdb:vortex-file-compressed	20645035 / 20372850 / +1.3%	37332592 / 36106723 / +3.4%	0.55 / 0.56 / -2.0%
tpch_q08/duckdb:vortex-file-compressed	23484615 / 22890580 / +2.6%	39080253 / 37716963 / +3.6%	0.60 / 0.61 / -1.0%
tpch_q09/duckdb:vortex-file-compressed	30019670 / 30211265 / -0.6%	53284692 / 52299569 / +1.9%	0.56 / 0.58 / -2.5%
tpch_q10/duckdb:vortex-file-compressed	27516699 / 27716763 / -0.7%	41206556 / 44833570 / -8.1%	0.67 / 0.62 / +8.0%
tpch_q11/duckdb:vortex-file-compressed	8839246 / 8710066 / +1.5%	14273642 / 14255564 / +0.1%	0.62 / 0.61 / +1.4%
tpch_q12/duckdb:vortex-file-compressed	15755819 / 16288526 / -3.3%	30259236 / 33001329 / -8.3%	0.52 / 0.49 / +5.5%
tpch_q13/duckdb:vortex-file-compressed	22485817 / 22193569 / +1.3%	39300885 / 41393569 / -5.1%	0.57 / 0.54 / +6.7%
tpch_q14/duckdb:vortex-file-compressed	14163130 / 13051851 / +8.5%	24963424 / 27732071 / -10.0%	0.57 / 0.47 / +20.5%
tpch_q15/duckdb:vortex-file-compressed	9606712 / 8672577 / +10.8% 🔴	20075464 / 20299139 / -1.1%	0.48 / 0.43 / +12.0%
tpch_q16/duckdb:vortex-file-compressed	18227859 / 18471821 / -1.3%	24302688 / 23649314 / +2.8%	0.75 / 0.78 / -4.0%
tpch_q17/duckdb:vortex-file-compressed	15368961 / 14773696 / +4.0%	29201310 / 33184295 / -12.0% 🟢	0.53 / 0.45 / +18.2%
tpch_q18/duckdb:vortex-file-compressed	24402276 / 25026378 / -2.5%	37654336 / 35410112 / +6.3%	0.65 / 0.71 / -8.3%
tpch_q19/duckdb:vortex-file-compressed	23257052 / 22879311 / +1.7%	34262075 / 35858984 / -4.5%	0.68 / 0.64 / +6.4%
tpch_q20/duckdb:vortex-file-compressed	17471878 / 16961252 / +3.0%	31481084 / 33785725 / -6.8%	0.55 / 0.50 / +10.6%
tpch_q21/duckdb:vortex-file-compressed	66904091 / 67684169 / -1.2%	87336826 / 85016725 / +2.7%	0.77 / 0.80 / -3.8%
tpch_q22/duckdb:vortex-file-compressed	12297525 / 12032391 / +2.2%	20107037 / 20570196 / -2.3%	0.61 / 0.58 / +4.6%

duckdb / parquet / ns (1.008x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	63452219 / 63149098 / +0.5%	69583461 / 69582127 / +0.0%	0.91 / 0.91 / +0.5%
tpch_q02/duckdb:parquet	37860546 / 38058428 / -0.5%	47574887 / 45629474 / +4.3%	0.80 / 0.83 / -4.6%
tpch_q03/duckdb:parquet	68440035 / 67968974 / +0.7%	79185888 / 78878646 / +0.4%	0.86 / 0.86 / +0.3%
tpch_q04/duckdb:parquet	47273582 / 47208709 / +0.1%	57997337 / 58781492 / -1.3%	0.82 / 0.80 / +1.5%
tpch_q05/duckdb:parquet	66445247 / 66413247 / +0.0%	80650565 / 78306353 / +3.0%	0.82 / 0.85 / -2.9%
tpch_q06/duckdb:parquet	22244084 / 22009519 / +1.1%	27147624 / 27820983 / -2.4%	0.82 / 0.79 / +3.6%
tpch_q07/duckdb:parquet	65651420 / 65410441 / +0.4%	75688468 / 75630219 / +0.1%	0.87 / 0.86 / +0.3%
tpch_q08/duckdb:parquet	80875681 / 80549827 / +0.4%	93258079 / 93172701 / +0.1%	0.87 / 0.86 / +0.3%
tpch_q09/duckdb:parquet	120647364 / 120291609 / +0.3%	132905634 / 134307608 / -1.0%	0.91 / 0.90 / +1.4%
tpch_q10/duckdb:parquet	120071972 / 119607941 / +0.4%	131173315 / 134115868 / -2.2%	0.92 / 0.89 / +2.6%
tpch_q11/duckdb:parquet	21632479 / 21472004 / +0.7%	25856153 / 25157074 / +2.8%	0.84 / 0.85 / -2.0%
tpch_q12/duckdb:parquet	44963239 / 44523822 / +1.0%	52270046 / 52003111 / +0.5%	0.86 / 0.86 / +0.5%
tpch_q13/duckdb:parquet	245513163 / 242021004 / +1.4%	253630187 / 255302258 / -0.7%	0.97 / 0.95 / +2.1%
tpch_q14/duckdb:parquet	47524474 / 47568667 / -0.1%	56178882 / 56153940 / +0.0%	0.85 / 0.85 / -0.1%
tpch_q15/duckdb:parquet	27112408 / 26606748 / +1.9%	33408833 / 33812478 / -1.2%	0.81 / 0.79 / +3.1%
tpch_q16/duckdb:parquet	52710285 / 51371799 / +2.6%	59957841 / 58185263 / +3.0%	0.88 / 0.88 / -0.4%
tpch_q17/duckdb:parquet	49578754 / 49260264 / +0.6%	59196450 / 59199849 / -0.0%	0.84 / 0.83 / +0.7%
tpch_q18/duckdb:parquet	99367625 / 96003977 / +3.5%	105004138 / 104996202 / +0.0%	0.95 / 0.91 / +3.5%
tpch_q19/duckdb:parquet	65567504 / 65357233 / +0.3%	75413396 / 75559182 / -0.2%	0.87 / 0.86 / +0.5%
tpch_q20/duckdb:parquet	62675176 / 61650481 / +1.7%	73853878 / 73797358 / +0.1%	0.85 / 0.84 / +1.6%
tpch_q21/duckdb:parquet	143389198 / 142548270 / +0.6%	154073794 / 153333860 / +0.5%	0.93 / 0.93 / +0.1%
tpch_q22/duckdb:parquet	51727184 / 51848062 / -0.2%	59418939 / 59127648 / +0.5%	0.87 / 0.88 / -0.7%

No file size changes detected.

github-actions · 2026-09-09T18:40:39Z

Benchmarks: PolarSignals Profiling 📖

Commits: PR f83e38f5 vs base 1ee4e3a5
Vortex (geomean): hot 0.998x ➖ · cold 1.123x ❌

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed	57404008 / 57113671 / +0.5%	113312323 / 100089449 / +13.2% 🔴	0.51 / 0.57 / -11.2%
polarsignals_q01/datafusion:vortex-file-compressed	63675090 / 63912705 / -0.4%	140092207 / 126132910 / +11.1% 🔴	0.45 / 0.51 / -10.3%
polarsignals_q02/datafusion:vortex-file-compressed	75647252 / 75153348 / +0.7%	121589426 / 112929209 / +7.7%	0.62 / 0.67 / -6.5%
polarsignals_q03/datafusion:vortex-file-compressed	78780206 / 79653351 / -1.1%	151984368 / 140617460 / +8.1%	0.52 / 0.57 / -8.5%
polarsignals_q04/datafusion:vortex-file-compressed	9558128 / 9539606 / +0.2%	57797583 / 49653755 / +16.4% 🔴	0.17 / 0.19 / -13.9%
polarsignals_q05/datafusion:vortex-file-compressed	24598462 / 24392830 / +0.8%	76837806 / 66106895 / +16.2% 🔴	0.32 / 0.37 / -13.2%
polarsignals_q06/datafusion:vortex-file-compressed	21657915 / 21539524 / +0.5%	76464007 / 63237523 / +20.9% 🔴	0.28 / 0.34 / -16.8%
polarsignals_q07/datafusion:vortex-file-compressed	39829000 / 39886086 / -0.1%	88673216 / 79847639 / +11.1% 🔴	0.45 / 0.50 / -10.1%
polarsignals_q08/datafusion:vortex-file-compressed	97238414 / 97974864 / -0.8%	169879144 / 165650608 / +2.6%	0.57 / 0.59 / -3.2%
polarsignals_q09/datafusion:vortex-file-compressed	9981014 / 10194488 / -2.1%	57801559 / 49520930 / +16.7% 🔴	0.17 / 0.21 / -16.1%

No file size changes detected.

github-actions · 2026-09-09T18:40:46Z

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR f83e38f5 vs base 1ee4e3a5
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -29.1%
Engines: DataFusion Likely improvement (-42.0%, environment too noisy confidence) · DuckDB No clear signal (-13.4%, environment too noisy confidence)
Vortex (geomean): hot 0.668x ✅ · cold 0.565x ✅
Parquet (geomean): hot 0.942x ➖ · cold 0.922x ➖
Shifts: Parquet (control) -5.8% · Median polish -10.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.585x ✅, 7↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	230191327 / 264803584 / -13.1%	892035106 / 841979582 / +5.9%	0.26 / 0.31 / -17.9%
tpch_q02/datafusion:vortex-file-compressed	333433755 / 329368333 / +1.2%	634016166 / 635648538 / -0.3%	0.53 / 0.52 / +1.5%
tpch_q03/datafusion:vortex-file-compressed	396503581 / 438921288 / -9.7%	1100471799 / 1846494637 / -40.4% 🟢	0.36 / 0.24 / +51.6%
tpch_q04/datafusion:vortex-file-compressed	196958262 / 202979876 / -3.0%	394948699 / 2875188991 / -86.3% 🟢	0.50 / 0.07 / +606.4%
tpch_q05/datafusion:vortex-file-compressed	414061448 / 435840250 / -5.0%	714609506 / 655838856 / +9.0%	0.58 / 0.66 / -12.8%
tpch_q06/datafusion:vortex-file-compressed	310523425 / 330037556 / -5.9%	542755147 / 691035758 / -21.5%	0.57 / 0.48 / +19.8%
tpch_q07/datafusion:vortex-file-compressed	430367974 / 1470782764 / -70.7% 🟢	561167587 / 3004630424 / -81.3% 🟢	0.77 / 0.49 / +56.7%
tpch_q08/datafusion:vortex-file-compressed	458349861 / 1396229218 / -67.2% 🟢	569088478 / 3845324555 / -85.2% 🟢	0.81 / 0.36 / +121.8%
tpch_q09/datafusion:vortex-file-compressed	472065519 / 1694825575 / -72.1% 🟢	512585378 / 1694796274 / -69.8% 🟢	0.92 / 1.00 / -7.9%
tpch_q10/datafusion:vortex-file-compressed	389344570 / 545268673 / -28.6%	576254994 / 724984911 / -20.5%	0.68 / 0.75 / -10.2%
tpch_q11/datafusion:vortex-file-compressed	324025860 / 333543129 / -2.9%	440156277 / 708415112 / -37.9% 🟢	0.74 / 0.47 / +56.4%
tpch_q12/datafusion:vortex-file-compressed	318487248 / 2039838993 / -84.4% 🟢	477282097 / 3007203466 / -84.1% 🟢	0.67 / 0.68 / -1.6%
tpch_q13/datafusion:vortex-file-compressed	146602664 / 1659825453 / -91.2% 🟢	393987268 / 3155970882 / -87.5% 🟢	0.37 / 0.53 / -29.2%
tpch_q14/datafusion:vortex-file-compressed	218592697 / 240868725 / -9.2%	606089095 / 809714601 / -25.1%	0.36 / 0.30 / +21.2%
tpch_q15/datafusion:vortex-file-compressed	473809741 / 465622113 / +1.8%	725978747 / 615905548 / +17.9%	0.65 / 0.76 / -13.7%
tpch_q16/datafusion:vortex-file-compressed	189661730 / 212830175 / -10.9%	294064491 / 365008496 / -19.4%	0.64 / 0.58 / +10.6%
tpch_q17/datafusion:vortex-file-compressed	689473245 / 360553544 / +91.2% 🔴	666394141 / 567856130 / +17.4%	1.03 / 0.63 / +63.0%
tpch_q18/datafusion:vortex-file-compressed	288280965 / 1369458747 / -78.9% 🟢	594361536 / 2079178547 / -71.4% 🟢	0.49 / 0.66 / -26.4%
tpch_q19/datafusion:vortex-file-compressed	398415958 / 431987062 / -7.8%	569384835 / 551743010 / +3.2%	0.70 / 0.78 / -10.6%
tpch_q20/datafusion:vortex-file-compressed	328017125 / 314443053 / +4.3%	582957928 / 529603129 / +10.1%	0.56 / 0.59 / -5.2%
tpch_q21/datafusion:vortex-file-compressed	530831851 / 599028264 / -11.4%	930641715 / 1093718095 / -14.9%	0.57 / 0.55 / +4.1%
tpch_q22/datafusion:vortex-file-compressed	175121495 / 1176243124 / -85.1% 🟢	405293773 / 1576082904 / -74.3% 🟢	0.43 / 0.75 / -42.1%

datafusion / parquet / ns (1.008x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	166433712 / 200311076 / -16.9%	548355261 / 523293769 / +4.8%	0.30 / 0.38 / -20.7%
tpch_q02/datafusion:parquet	304804733 / 272961538 / +11.7%	538355558 / 483959420 / +11.2%	0.57 / 0.56 / +0.4%
tpch_q03/datafusion:parquet	277078790 / 272232092 / +1.8%	718878980 / 804765217 / -10.7%	0.39 / 0.34 / +13.9%
tpch_q04/datafusion:parquet	200222108 / 162842877 / +23.0%	474669836 / 324379097 / +46.3% 🔴	0.42 / 0.50 / -16.0%
tpch_q05/datafusion:parquet	350146451 / 353235939 / -0.9%	462365203 / 483063406 / -4.3%	0.76 / 0.73 / +3.6%
tpch_q06/datafusion:parquet	140830103 / 125946186 / +11.8%	235520125 / 223696155 / +5.3%	0.60 / 0.56 / +6.2%
tpch_q07/datafusion:parquet	360950148 / 359628865 / +0.4%	622708338 / 463171406 / +34.4% 🔴	0.58 / 0.78 / -25.3%
tpch_q08/datafusion:parquet	459581432 / 433120380 / +6.1%	600813641 / 548573538 / +9.5%	0.76 / 0.79 / -3.1%
tpch_q09/datafusion:parquet	454145714 / 398443095 / +14.0%	535171917 / 586693683 / -8.8%	0.85 / 0.68 / +25.0%
tpch_q10/datafusion:parquet	349148616 / 366419546 / -4.7%	462158626 / 519021330 / -11.0%	0.76 / 0.71 / +7.0%
tpch_q11/datafusion:parquet	286229030 / 271130035 / +5.6%	403190499 / 603571205 / -33.2% 🟢	0.71 / 0.45 / +58.0%
tpch_q12/datafusion:parquet	174168725 / 221145979 / -21.2%	374601009 / 321279896 / +16.6%	0.46 / 0.69 / -32.5%
tpch_q13/datafusion:parquet	365140535 / 372606178 / -2.0%	555796277 / 514396800 / +8.0%	0.66 / 0.72 / -9.3%
tpch_q14/datafusion:parquet	165006687 / 200513941 / -17.7%	287590270 / 362565274 / -20.7%	0.57 / 0.55 / +3.7%
tpch_q15/datafusion:parquet	324204024 / 318644759 / +1.7%	599777849 / 448525108 / +33.7% 🔴	0.54 / 0.71 / -23.9%
tpch_q16/datafusion:parquet	115448168 / 130203124 / -11.3%	220538728 / 257613512 / -14.4%	0.52 / 0.51 / +3.6%
tpch_q17/datafusion:parquet	321846121 / 339684804 / -5.3%	428507551 / 588802910 / -27.2%	0.75 / 0.58 / +30.2%
tpch_q18/datafusion:parquet	361123899 / 389059356 / -7.2%	482662145 / 567936899 / -15.0%	0.75 / 0.69 / +9.2%
tpch_q19/datafusion:parquet	204059875 / 205909633 / -0.9%	286371911 / 329026806 / -13.0%	0.71 / 0.63 / +13.9%
tpch_q20/datafusion:parquet	259588888 / 279136234 / -7.0%	436709994 / 476721586 / -8.4%	0.59 / 0.59 / +1.5%
tpch_q21/datafusion:parquet	495220122 / 324902919 / +52.4% 🔴	609360009 / 464733121 / +31.1% 🔴	0.81 / 0.70 / +16.2%
tpch_q22/datafusion:parquet	162831785 / 151202820 / +7.7%	443469871 / 330076998 / +34.4% 🔴	0.37 / 0.46 / -19.8%

duckdb / vortex-file-compressed / ns (0.763x ➖, 4↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	201087676 / 202005245 / -0.5%	268764248 / 393006208 / -31.6% 🟢	0.75 / 0.51 / +45.6%
tpch_q02/duckdb:vortex-file-compressed	405889546 / 408413553 / -0.6%	396907272 / 513114796 / -22.6%	1.02 / 0.80 / +28.5%
tpch_q03/duckdb:vortex-file-compressed	519262779 / 628742455 / -17.4%	637291142 / 709883237 / -10.2%	0.81 / 0.89 / -8.0%
tpch_q04/duckdb:vortex-file-compressed	280415481 / 353692506 / -20.7%	344271741 / 369157990 / -6.7%	0.81 / 0.96 / -15.0%
tpch_q05/duckdb:vortex-file-compressed	448519291 / 1066827637 / -58.0% 🟢	498067007 / 1908067064 / -73.9% 🟢	0.90 / 0.56 / +61.1%
tpch_q06/duckdb:vortex-file-compressed	364342434 / 352576517 / +3.3%	346085929 / 336238241 / +2.9%	1.05 / 1.05 / +0.4%
tpch_q07/duckdb:vortex-file-compressed	453120369 / 542768031 / -16.5%	496832195 / 603308253 / -17.6%	0.91 / 0.90 / +1.4%
tpch_q08/duckdb:vortex-file-compressed	673594364 / 677095380 / -0.5%	725679895 / 1712622337 / -57.6% 🟢	0.93 / 0.40 / +134.8%
tpch_q09/duckdb:vortex-file-compressed	498939859 / 540366249 / -7.7%	449378491 / 697823286 / -35.6% 🟢	1.11 / 0.77 / +43.4%
tpch_q10/duckdb:vortex-file-compressed	478071320 / 1694751165 / -71.8% 🟢	465838665 / 2089400627 / -77.7% 🟢	1.03 / 0.81 / +26.5%
tpch_q11/duckdb:vortex-file-compressed	205006986 / 196563046 / +4.3%	216913014 / 218082510 / -0.5%	0.95 / 0.90 / +4.9%
tpch_q12/duckdb:vortex-file-compressed	434263739 / 458816382 / -5.4%	514166240 / 558666321 / -8.0%	0.84 / 0.82 / +2.8%
tpch_q13/duckdb:vortex-file-compressed	324909563 / 1817849932 / -82.1% 🟢	322964379 / 1927481884 / -83.2% 🟢	1.01 / 0.94 / +6.7%
tpch_q14/duckdb:vortex-file-compressed	241444917 / 340022320 / -29.0%	356207365 / 441259641 / -19.3%	0.68 / 0.77 / -12.0%
tpch_q15/duckdb:vortex-file-compressed	191944828 / 196197866 / -2.2%	169260700 / 270308727 / -37.4% 🟢	1.13 / 0.73 / +56.2%
tpch_q16/duckdb:vortex-file-compressed	191009275 / 206514200 / -7.5%	223215887 / 242034188 / -7.8%	0.86 / 0.85 / +0.3%
tpch_q17/duckdb:vortex-file-compressed	444966568 / 661454220 / -32.7% 🟢	476534280 / 541178796 / -11.9%	0.93 / 1.22 / -23.6%
tpch_q18/duckdb:vortex-file-compressed	398539660 / 393532009 / +1.3%	458945986 / 609695608 / -24.7%	0.87 / 0.65 / +34.5%
tpch_q19/duckdb:vortex-file-compressed	332257870 / 453822170 / -26.8%	394066583 / 422655786 / -6.8%	0.84 / 1.07 / -21.5%
tpch_q20/duckdb:vortex-file-compressed	391862491 / 486903601 / -19.5%	414106144 / 484201482 / -14.5%	0.95 / 1.01 / -5.9%
tpch_q21/duckdb:vortex-file-compressed	681509398 / 813849673 / -16.3%	773751425 / 634527308 / +21.9%	0.88 / 1.28 / -31.3%
tpch_q22/duckdb:vortex-file-compressed	218054656 / 196901379 / +10.7%	221827081 / 1752876732 / -87.3% 🟢	0.98 / 0.11 / +775.1%

duckdb / parquet / ns (0.880x ➖, 3↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	297950282 / 415117803 / -28.2%	306998477 / 643455220 / -52.3% 🟢	0.97 / 0.65 / +50.4%
tpch_q02/duckdb:parquet	714396718 / 987628346 / -27.7%	616561102 / 977920142 / -37.0% 🟢	1.16 / 1.01 / +14.7%
tpch_q03/duckdb:parquet	735520101 / 844654183 / -12.9%	801516286 / 1156538637 / -30.7% 🟢	0.92 / 0.73 / +25.7%
tpch_q04/duckdb:parquet	488474289 / 469278521 / +4.1%	493092853 / 510173977 / -3.3%	0.99 / 0.92 / +7.7%
tpch_q05/duckdb:parquet	928911639 / 908686977 / +2.2%	892748626 / 988465293 / -9.7%	1.04 / 0.92 / +13.2%
tpch_q06/duckdb:parquet	307318402 / 288801915 / +6.4%	337147202 / 301278443 / +11.9%	0.91 / 0.96 / -4.9%
tpch_q07/duckdb:parquet	867941754 / 916845794 / -5.3%	790714035 / 743357302 / +6.4%	1.10 / 1.23 / -11.0%
tpch_q08/duckdb:parquet	1118414848 / 1175890133 / -4.9%	1002311260 / 992390079 / +1.0%	1.12 / 1.18 / -5.8%
tpch_q09/duckdb:parquet	1115955068 / 1130435152 / -1.3%	1802791831 / 1258122630 / +43.3% 🔴	0.62 / 0.90 / -31.1%
tpch_q10/duckdb:parquet	927344756 / 1015633624 / -8.7%	918987696 / 1427273807 / -35.6% 🟢	1.01 / 0.71 / +41.8%
tpch_q11/duckdb:parquet	436861338 / 458838245 / -4.8%	453174301 / 451433816 / +0.4%	0.96 / 1.02 / -5.2%
tpch_q12/duckdb:parquet	547926574 / 562498821 / -2.6%	626182016 / 623596904 / +0.4%	0.88 / 0.90 / -3.0%
tpch_q13/duckdb:parquet	704485494 / 723548989 / -2.6%	797431804 / 969090041 / -17.7%	0.88 / 0.75 / +18.3%
tpch_q14/duckdb:parquet	522522744 / 709157132 / -26.3%	417839187 / 784061022 / -46.7% 🟢	1.25 / 0.90 / +38.3%
tpch_q15/duckdb:parquet	374308119 / 361703069 / +3.5%	359426335 / 337825217 / +6.4%	1.04 / 1.07 / -2.7%
tpch_q16/duckdb:parquet	523403780 / 835022726 / -37.3% 🟢	454159974 / 635892545 / -28.6%	1.15 / 1.31 / -12.2%
tpch_q17/duckdb:parquet	466892829 / 682662152 / -31.6% 🟢	473940898 / 701450338 / -32.4% 🟢	0.99 / 0.97 / +1.2%
tpch_q18/duckdb:parquet	658758838 / 576096123 / +14.3%	608590074 / 717971017 / -15.2%	1.08 / 0.80 / +34.9%
tpch_q19/duckdb:parquet	539437690 / 922666857 / -41.5% 🟢	640850217 / 796490593 / -19.5%	0.84 / 1.16 / -27.3%
tpch_q20/duckdb:parquet	865028151 / 1043402988 / -17.1%	961899960 / 1461479158 / -34.2% 🟢	0.90 / 0.71 / +26.0%
tpch_q21/duckdb:parquet	701999010 / 742585005 / -5.5%	777971074 / 651235435 / +19.5%	0.90 / 1.14 / -20.9%
tpch_q22/duckdb:parquet	418470791 / 442519543 / -5.4%	376706590 / 396884125 / -5.1%	1.11 / 1.11 / -0.4%

github-actions · 2026-09-09T18:40:46Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR f83e38f5 vs base 1ee4e3a5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.010x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.998x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed	24136820 / 24153223 / -0.1%	44287493 / 44421329 / -0.3%	0.55 / 0.54 / +0.2%
tpcds_q02/datafusion:vortex-file-compressed	44596804 / 45425928 / -1.8%	62814392 / 61027475 / +2.9%	0.71 / 0.74 / -4.6%
tpcds_q03/datafusion:vortex-file-compressed	12113512 / 11726494 / +3.3%	28842677 / 28932054 / -0.3%	0.42 / 0.41 / +3.6%
tpcds_q04/datafusion:vortex-file-compressed	112892486 / 112728042 / +0.1%	142866594 / 145080668 / -1.5%	0.79 / 0.78 / +1.7%
tpcds_q05/datafusion:vortex-file-compressed	59988148 / 60516982 / -0.9%	81755912 / 82324169 / -0.7%	0.73 / 0.74 / -0.2%
tpcds_q06/datafusion:vortex-file-compressed	23736434 / 24125517 / -1.6%	47165358 / 45762810 / +3.1%	0.50 / 0.53 / -4.5%
tpcds_q07/datafusion:vortex-file-compressed	32767104 / 32419942 / +1.1%	57065441 / 56938852 / +0.2%	0.57 / 0.57 / +0.8%
tpcds_q08/datafusion:vortex-file-compressed	25391626 / 25520786 / -0.5%	45006394 / 46995286 / -4.2%	0.56 / 0.54 / +3.9%
tpcds_q09/datafusion:vortex-file-compressed	16953105 / 17019564 / -0.4%	33887136 / 34144910 / -0.8%	0.50 / 0.50 / +0.4%
tpcds_q10/datafusion:vortex-file-compressed	28506066 / 29395290 / -3.0%	51794536 / 49338833 / +5.0%	0.55 / 0.60 / -7.6%
tpcds_q11/datafusion:vortex-file-compressed	62221778 / 62812985 / -0.9%	90547136 / 91196519 / -0.7%	0.69 / 0.69 / -0.2%
tpcds_q12/datafusion:vortex-file-compressed	16543009 / 16348048 / +1.2%	33674119 / 32720818 / +2.9%	0.49 / 0.50 / -1.7%
tpcds_q13/datafusion:vortex-file-compressed	33448968 / 33699776 / -0.7%	53795280 / 54135889 / -0.6%	0.62 / 0.62 / -0.1%
tpcds_q14/datafusion:vortex-file-compressed	92283440 / 92424964 / -0.2%	119438811 / 121228594 / -1.5%	0.77 / 0.76 / +1.3%
tpcds_q15/datafusion:vortex-file-compressed	23916681 / 23714308 / +0.9%	43537916 / 43783266 / -0.6%	0.55 / 0.54 / +1.4%
tpcds_q16/datafusion:vortex-file-compressed	20371130 / 20664102 / -1.4%	41464530 / 41382415 / +0.2%	0.49 / 0.50 / -1.6%
tpcds_q17/datafusion:vortex-file-compressed	58106368 / 61344360 / -5.3%	89528237 / 75167405 / +19.1% 🔴	0.65 / 0.82 / -20.5%
tpcds_q18/datafusion:vortex-file-compressed	68119594 / 68432764 / -0.5%	97708351 / 94653112 / +3.2%	0.70 / 0.72 / -3.6%
tpcds_q19/datafusion:vortex-file-compressed	18615737 / 18642088 / -0.1%	39370500 / 40085069 / -1.8%	0.47 / 0.47 / +1.7%
tpcds_q20/datafusion:vortex-file-compressed	17860919 / 17802688 / +0.3%	36003193 / 34305399 / +4.9%	0.50 / 0.52 / -4.4%
tpcds_q21/datafusion:vortex-file-compressed	17621430 / 17827708 / -1.2%	38126050 / 40121544 / -5.0%	0.46 / 0.44 / +4.0%
tpcds_q22/datafusion:vortex-file-compressed	49836710 / 49835686 / +0.0%	72835727 / 72692763 / +0.2%	0.68 / 0.69 / -0.2%
tpcds_q23/datafusion:vortex-file-compressed	72112276 / 73719098 / -2.2%	102643286 / 99158461 / +3.5%	0.70 / 0.74 / -5.5%
tpcds_q24/datafusion:vortex-file-compressed	70219810 / 70292092 / -0.1%	94516969 / 95863797 / -1.4%	0.74 / 0.73 / +1.3%
tpcds_q25/datafusion:vortex-file-compressed	54806532 / 52204692 / +5.0%	79752483 / 82593498 / -3.4%	0.69 / 0.63 / +8.7%
tpcds_q26/datafusion:vortex-file-compressed	30309245 / 30356420 / -0.2%	51019783 / 50537376 / +1.0%	0.59 / 0.60 / -1.1%
tpcds_q27/datafusion:vortex-file-compressed	63765598 / 63518357 / +0.4%	83707201 / 91037911 / -8.1%	0.76 / 0.70 / +9.2%
tpcds_q28/datafusion:vortex-file-compressed	17812142 / 18034923 / -1.2%	37580430 / 36033106 / +4.3%	0.47 / 0.50 / -5.3%
tpcds_q29/datafusion:vortex-file-compressed	57670266 / 61155687 / -5.7%	77582411 / 84967842 / -8.7%	0.74 / 0.72 / +3.3%
tpcds_q30/datafusion:vortex-file-compressed	27425361 / 27401448 / +0.1%	46248847 / 45474660 / +1.7%	0.59 / 0.60 / -1.6%
tpcds_q31/datafusion:vortex-file-compressed	64120078 / 64342592 / -0.3%	95347964 / 92885699 / +2.7%	0.67 / 0.69 / -2.9%
tpcds_q32/datafusion:vortex-file-compressed	13708132 / 13579156 / +0.9%	31764268 / 31600691 / +0.5%	0.43 / 0.43 / +0.4%
tpcds_q33/datafusion:vortex-file-compressed	27308651 / 26767910 / +2.0%	49648457 / 49536591 / +0.2%	0.55 / 0.54 / +1.8%
tpcds_q34/datafusion:vortex-file-compressed	18244508 / 18809141 / -3.0%	38349451 / 39341086 / -2.5%	0.48 / 0.48 / -0.5%
tpcds_q35/datafusion:vortex-file-compressed	35655464 / 35788946 / -0.4%	57610918 / 59379615 / -3.0%	0.62 / 0.60 / +2.7%
tpcds_q36/datafusion:vortex-file-compressed	48268670 / 49380568 / -2.3%	71623714 / 74726546 / -4.2%	0.67 / 0.66 / +2.0%
tpcds_q37/datafusion:vortex-file-compressed	13870046 / 13780094 / +0.7%	36966144 / 34598892 / +6.8%	0.38 / 0.40 / -5.8%
tpcds_q38/datafusion:vortex-file-compressed	29565358 / 29714566 / -0.5%	52135797 / 53639924 / -2.8%	0.57 / 0.55 / +2.4%
tpcds_q39/datafusion:vortex-file-compressed	64937345 / 65135836 / -0.3%	92423350 / 92784125 / -0.4%	0.70 / 0.70 / +0.1%
tpcds_q40/datafusion:vortex-file-compressed	25022670 / 25114907 / -0.4%	45939544 / 44472348 / +3.3%	0.54 / 0.56 / -3.5%
tpcds_q41/datafusion:vortex-file-compressed	16745711 / 16441088 / +1.9%	30829687 / 31728226 / -2.8%	0.54 / 0.52 / +4.8%
tpcds_q42/datafusion:vortex-file-compressed	11553732 / 11253114 / +2.7%	27859568 / 28470868 / -2.1%	0.41 / 0.40 / +4.9%
tpcds_q43/datafusion:vortex-file-compressed	13470828 / 13717938 / -1.8%	32671241 / 32281834 / +1.2%	0.41 / 0.42 / -3.0%
tpcds_q44/datafusion:vortex-file-compressed	26310667 / 26182736 / +0.5%	51727783 / 50621579 / +2.2%	0.51 / 0.52 / -1.7%
tpcds_q45/datafusion:vortex-file-compressed	27823116 / 27318003 / +1.8%	48634274 / 47550075 / +2.3%	0.57 / 0.57 / -0.4%
tpcds_q46/datafusion:vortex-file-compressed	24534858 / 24874815 / -1.4%	48723937 / 47204314 / +3.2%	0.50 / 0.53 / -4.4%
tpcds_q47/datafusion:vortex-file-compressed	78262995 / 77943122 / +0.4%	107572427 / 106457022 / +1.0%	0.73 / 0.73 / -0.6%
tpcds_q48/datafusion:vortex-file-compressed	31089750 / 31193800 / -0.3%	51246057 / 53692653 / -4.6%	0.61 / 0.58 / +4.4%
tpcds_q49/datafusion:vortex-file-compressed	59753494 / 59645938 / +0.2%	86151942 / 82001163 / +5.1%	0.69 / 0.73 / -4.6%
tpcds_q50/datafusion:vortex-file-compressed	34029116 / 34517244 / -1.4%	54564959 / 57114429 / -4.5%	0.62 / 0.60 / +3.2%
tpcds_q51/datafusion:vortex-file-compressed	61205206 / 61370890 / -0.3%	86844467 / 81951668 / +6.0%	0.70 / 0.75 / -5.9%
tpcds_q52/datafusion:vortex-file-compressed	11584624 / 11945055 / -3.0%	29170232 / 30454421 / -4.2%	0.40 / 0.39 / +1.3%
tpcds_q53/datafusion:vortex-file-compressed	18629154 / 18219193 / +2.3%	39410874 / 36981260 / +6.6%	0.47 / 0.49 / -4.1%
tpcds_q54/datafusion:vortex-file-compressed	33703998 / 33962811 / -0.8%	60912021 / 59325645 / +2.7%	0.55 / 0.57 / -3.3%
tpcds_q55/datafusion:vortex-file-compressed	11258554 / 11447977 / -1.7%	27218435 / 28251392 / -3.7%	0.41 / 0.41 / +2.1%
tpcds_q56/datafusion:vortex-file-compressed	26925675 / 26502830 / +1.6%	48963349 / 47176874 / +3.8%	0.55 / 0.56 / -2.1%
tpcds_q57/datafusion:vortex-file-compressed	73693390 / 72990770 / +1.0%	96653052 / 95241751 / +1.5%	0.76 / 0.77 / -0.5%
tpcds_q58/datafusion:vortex-file-compressed	40680861 / 41289491 / -1.5%	69407820 / 67806892 / +2.4%	0.59 / 0.61 / -3.7%
tpcds_q59/datafusion:vortex-file-compressed	32194364 / 32729188 / -1.6%	54151919 / 52482364 / +3.2%	0.59 / 0.62 / -4.7%
tpcds_q60/datafusion:vortex-file-compressed	27481776 / 27230165 / +0.9%	48662724 / 48810772 / -0.3%	0.56 / 0.56 / +1.2%
tpcds_q61/datafusion:vortex-file-compressed	23898154 / 24022706 / -0.5%	47530446 / 46803369 / +1.6%	0.50 / 0.51 / -2.0%
tpcds_q62/datafusion:vortex-file-compressed	17260936 / 17556596 / -1.7%	36088309 / 35957847 / +0.4%	0.48 / 0.49 / -2.0%
tpcds_q63/datafusion:vortex-file-compressed	18278396 / 18545706 / -1.4%	39357970 / 38167344 / +3.1%	0.46 / 0.49 / -4.4%
tpcds_q64/datafusion:vortex-file-compressed	325939988 / 328182042 / -0.7%	353389204 / 352976329 / +0.1%	0.92 / 0.93 / -0.8%
tpcds_q65/datafusion:vortex-file-compressed	75194048 / 75260730 / -0.1%	97922448 / 96523182 / +1.4%	0.77 / 0.78 / -1.5%
tpcds_q66/datafusion:vortex-file-compressed	52663524 / 52662204 / +0.0%	75184601 / 74678601 / +0.7%	0.70 / 0.71 / -0.7%
tpcds_q67/datafusion:vortex-file-compressed	55731040 / 55596206 / +0.2%	84585880 / 86020502 / -1.7%	0.66 / 0.65 / +1.9%
tpcds_q68/datafusion:vortex-file-compressed	23549636 / 23995596 / -1.9%	49271532 / 48454555 / +1.7%	0.48 / 0.50 / -3.5%
tpcds_q69/datafusion:vortex-file-compressed	27790588 / 28389881 / -2.1%	48236230 / 49198412 / -2.0%	0.58 / 0.58 / -0.2%
tpcds_q70/datafusion:vortex-file-compressed	71065132 / 72037498 / -1.3%	94112566 / 93110350 / +1.1%	0.76 / 0.77 / -2.4%
tpcds_q71/datafusion:vortex-file-compressed	20092388 / 19273671 / +4.2%	38227977 / 38700889 / -1.2%	0.53 / 0.50 / +5.5%
tpcds_q72/datafusion:vortex-file-compressed	488358127 / 461548382 / +5.8%	514729260 / 481551378 / +6.9%	0.95 / 0.96 / -1.0%
tpcds_q73/datafusion:vortex-file-compressed	16716266 / 17302320 / -3.4%	39142623 / 36423013 / +7.5%	0.43 / 0.48 / -10.1%
tpcds_q74/datafusion:vortex-file-compressed	45494421 / 44755220 / +1.7%	71009154 / 69376133 / +2.4%	0.64 / 0.65 / -0.7%
tpcds_q75/datafusion:vortex-file-compressed	133205380 / 135049165 / -1.4%	162273851 / 164216864 / -1.2%	0.82 / 0.82 / -0.2%
tpcds_q76/datafusion:vortex-file-compressed	43028566 / 43030882 / -0.0%	70925763 / 61977229 / +14.4% 🔴	0.61 / 0.69 / -12.6%
tpcds_q77/datafusion:vortex-file-compressed	35381573 / 34898481 / +1.4%	58795645 / 60310699 / -2.5%	0.60 / 0.58 / +4.0%
tpcds_q78/datafusion:vortex-file-compressed	80302194 / 79841832 / +0.6%	112696212 / 109522188 / +2.9%	0.71 / 0.73 / -2.3%
tpcds_q79/datafusion:vortex-file-compressed	21692314 / 20588202 / +5.4%	43764840 / 45308945 / -3.4%	0.50 / 0.45 / +9.1%
tpcds_q80/datafusion:vortex-file-compressed	76314512 / 75885610 / +0.6%	111091290 / 106265037 / +4.5%	0.69 / 0.71 / -3.8%
tpcds_q81/datafusion:vortex-file-compressed	27854586 / 27780408 / +0.3%	47846212 / 44521159 / +7.5%	0.58 / 0.62 / -6.7%
tpcds_q82/datafusion:vortex-file-compressed	14011178 / 13739326 / +2.0%	35313810 / 34266281 / +3.1%	0.40 / 0.40 / -1.0%
tpcds_q83/datafusion:vortex-file-compressed	35703602 / 36301902 / -1.6%	58931132 / 58881422 / +0.1%	0.61 / 0.62 / -1.7%
tpcds_q84/datafusion:vortex-file-compressed	11644050 / 11907596 / -2.2%	30553368 / 28507167 / +7.2%	0.38 / 0.42 / -8.8%
tpcds_q85/datafusion:vortex-file-compressed	58902906 / 59286756 / -0.6%	83181017 / 83765342 / -0.7%	0.71 / 0.71 / +0.1%
tpcds_q86/datafusion:vortex-file-compressed	16258280 / 16479012 / -1.3%	33338346 / 32704432 / +1.9%	0.49 / 0.50 / -3.2%
tpcds_q87/datafusion:vortex-file-compressed	29675748 / 29534944 / +0.5%	52499443 / 51615033 / +1.7%	0.57 / 0.57 / -1.2%
tpcds_q88/datafusion:vortex-file-compressed	34448106 / 34439540 / +0.0%	66182623 / 62540564 / +5.8%	0.52 / 0.55 / -5.5%
tpcds_q89/datafusion:vortex-file-compressed	20932056 / 21745972 / -3.7%	41960536 / 41196882 / +1.9%	0.50 / 0.53 / -5.5%
tpcds_q90/datafusion:vortex-file-compressed	10026394 / 10127540 / -1.0%	27100244 / 26845387 / +0.9%	0.37 / 0.38 / -1.9%
tpcds_q91/datafusion:vortex-file-compressed	16957414 / 17279286 / -1.9%	35766773 / 36866301 / -3.0%	0.47 / 0.47 / +1.2%
tpcds_q92/datafusion:vortex-file-compressed	13445050 / 13506752 / -0.5%	31605755 / 31270674 / +1.1%	0.43 / 0.43 / -1.5%
tpcds_q93/datafusion:vortex-file-compressed	23603381 / 24407800 / -3.3%	44997768 / 45481119 / -1.1%	0.52 / 0.54 / -2.3%
tpcds_q94/datafusion:vortex-file-compressed	19245278 / 19430993 / -1.0%	39309877 / 39233374 / +0.2%	0.49 / 0.50 / -1.1%
tpcds_q95/datafusion:vortex-file-compressed	45973405 / 46110997 / -0.3%	67989647 / 69994547 / -2.9%	0.68 / 0.66 / +2.6%
tpcds_q96/datafusion:vortex-file-compressed	9619009 / 9478522 / +1.5%	26455905 / 24889419 / +6.3%	0.36 / 0.38 / -4.5%
tpcds_q97/datafusion:vortex-file-compressed	21015424 / 21324418 / -1.4%	44140858 / 42406270 / +4.1%	0.48 / 0.50 / -5.3%
tpcds_q98/datafusion:vortex-file-compressed	16798553 / 17016169 / -1.3%	36277060 / 35952625 / +0.9%	0.46 / 0.47 / -2.2%
tpcds_q99/datafusion:vortex-file-compressed	19328203 / 19265950 / +0.3%	38747600 / 37993551 / +2.0%	0.50 / 0.51 / -1.6%

datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet	31005416 / 30415150 / +1.9%	51932025 / 58366251 / -11.0% 🟢	0.60 / 0.52 / +14.6%
tpcds_q02/datafusion:parquet	39356228 / 40244350 / -2.2%	58193399 / 58373160 / -0.3%	0.68 / 0.69 / -1.9%
tpcds_q03/datafusion:parquet	16394754 / 16215122 / +1.1%	31846506 / 31907817 / -0.2%	0.51 / 0.51 / +1.3%
tpcds_q04/datafusion:parquet	201612023 / 201163844 / +0.2%	229071578 / 229200822 / -0.1%	0.88 / 0.88 / +0.3%
tpcds_q05/datafusion:parquet	72700620 / 72600828 / +0.1%	95775933 / 94034587 / +1.9%	0.76 / 0.77 / -1.7%
tpcds_q06/datafusion:parquet	28231379 / 28389507 / -0.6%	49810881 / 47106406 / +5.7%	0.57 / 0.60 / -6.0%
tpcds_q07/datafusion:parquet	46688187 / 46977419 / -0.6%	70242574 / 69941237 / +0.4%	0.66 / 0.67 / -1.0%
tpcds_q08/datafusion:parquet	31633145 / 31533316 / +0.3%	50440199 / 49631828 / +1.6%	0.63 / 0.64 / -1.3%
tpcds_q09/datafusion:parquet	30475588 / 31554789 / -3.4%	45416298 / 47017592 / -3.4%	0.67 / 0.67 / -0.0%
tpcds_q10/datafusion:parquet	41900869 / 42070788 / -0.4%	60601004 / 62825734 / -3.5%	0.69 / 0.67 / +3.3%
tpcds_q11/datafusion:parquet	94850524 / 94856833 / -0.0%	117122568 / 120833561 / -3.1%	0.81 / 0.79 / +3.2%
tpcds_q12/datafusion:parquet	21540470 / 21592943 / -0.2%	35973862 / 36561652 / -1.6%	0.60 / 0.59 / +1.4%
tpcds_q13/datafusion:parquet	43126259 / 41818052 / +3.1%	67361906 / 68880114 / -2.2%	0.64 / 0.61 / +5.5%
tpcds_q14/datafusion:parquet	126241446 / 126596480 / -0.3%	150340564 / 152092579 / -1.2%	0.84 / 0.83 / +0.9%
tpcds_q15/datafusion:parquet	32062142 / 33238324 / -3.5%	51602379 / 49697696 / +3.8%	0.62 / 0.67 / -7.1%
tpcds_q16/datafusion:parquet	37437890 / 37191399 / +0.7%	54944928 / 55190412 / -0.4%	0.68 / 0.67 / +1.1%
tpcds_q17/datafusion:parquet	80205754 / 79466002 / +0.9%	104650289 / 103686985 / +0.9%	0.77 / 0.77 / +0.0%
tpcds_q18/datafusion:parquet	61815968 / 60906134 / +1.5%	85305821 / 86265873 / -1.1%	0.72 / 0.71 / +2.6%
tpcds_q19/datafusion:parquet	25853068 / 26230797 / -1.4%	45110406 / 46385596 / -2.7%	0.57 / 0.57 / +1.3%
tpcds_q20/datafusion:parquet	22907312 / 22778424 / +0.6%	37315661 / 38479169 / -3.0%	0.61 / 0.59 / +3.7%
tpcds_q21/datafusion:parquet	18086628 / 18218738 / -0.7%	32692500 / 33109490 / -1.3%	0.55 / 0.55 / +0.5%
tpcds_q22/datafusion:parquet	76083596 / 75439168 / +0.9%	91612662 / 90280548 / +1.5%	0.83 / 0.84 / -0.6%
tpcds_q23/datafusion:parquet	110999206 / 107561666 / +3.2%	135453365 / 145938576 / -7.2%	0.82 / 0.74 / +11.2%
tpcds_q24/datafusion:parquet	95720947 / 97381092 / -1.7%	123568991 / 124419179 / -0.7%	0.77 / 0.78 / -1.0%
tpcds_q25/datafusion:parquet	78141350 / 78149248 / -0.0%	104899229 / 109818487 / -4.5%	0.74 / 0.71 / +4.7%
tpcds_q26/datafusion:parquet	43914551 / 44379604 / -1.0%	64118502 / 64103204 / +0.0%	0.68 / 0.69 / -1.1%
tpcds_q27/datafusion:parquet	74697191 / 74791052 / -0.1%	99779089 / 100955966 / -1.2%	0.75 / 0.74 / +1.1%
tpcds_q28/datafusion:parquet	27510414 / 27440246 / +0.3%	45024510 / 46994393 / -4.2%	0.61 / 0.58 / +4.6%
tpcds_q29/datafusion:parquet	78281096 / 78915774 / -0.8%	106766578 / 105628977 / +1.1%	0.73 / 0.75 / -1.9%
tpcds_q30/datafusion:parquet	45494412 / 44577404 / +2.1%	68178012 / 64714366 / +5.4%	0.67 / 0.69 / -3.1%
tpcds_q31/datafusion:parquet	80915389 / 79863576 / +1.3%	102431126 / 102768060 / -0.3%	0.79 / 0.78 / +1.7%
tpcds_q32/datafusion:parquet	23622012 / 23516543 / +0.4%	40830688 / 40727032 / +0.3%	0.58 / 0.58 / +0.2%
tpcds_q33/datafusion:parquet	33883312 / 33466988 / +1.2%	52909419 / 53735914 / -1.5%	0.64 / 0.62 / +2.8%
tpcds_q34/datafusion:parquet	23223164 / 22950506 / +1.2%	38848779 / 38988776 / -0.4%	0.60 / 0.59 / +1.6%
tpcds_q35/datafusion:parquet	49391718 / 48856590 / +1.1%	68734619 / 69805239 / -1.5%	0.72 / 0.70 / +2.7%
tpcds_q36/datafusion:parquet	53052030 / 53853132 / -1.5%	75374532 / 75202900 / +0.2%	0.70 / 0.72 / -1.7%
tpcds_q37/datafusion:parquet	22938022 / 22508996 / +1.9%	38738074 / 38248431 / +1.3%	0.59 / 0.59 / +0.6%
tpcds_q38/datafusion:parquet	44295870 / 43655757 / +1.5%	64888116 / 64470947 / +0.6%	0.68 / 0.68 / +0.8%
tpcds_q39/datafusion:parquet	72300172 / 71731549 / +0.8%	91684136 / 90185767 / +1.7%	0.79 / 0.80 / -0.9%
tpcds_q40/datafusion:parquet	29255528 / 30713988 / -4.7%	51379679 / 50591755 / +1.6%	0.57 / 0.61 / -6.2%
tpcds_q41/datafusion:parquet	17449262 / 17225981 / +1.3%	29494237 / 29485944 / +0.0%	0.59 / 0.58 / +1.3%
tpcds_q42/datafusion:parquet	15365578 / 15850654 / -3.1%	29697668 / 31000206 / -4.2%	0.52 / 0.51 / +1.2%
tpcds_q43/datafusion:parquet	17567929 / 17471484 / +0.6%	32634007 / 33550696 / -2.7%	0.54 / 0.52 / +3.4%
tpcds_q44/datafusion:parquet	33025878 / 32974500 / +0.2%	54122988 / 51322862 / +5.5%	0.61 / 0.64 / -5.0%
tpcds_q45/datafusion:parquet	37002936 / 36933535 / +0.2%	55219411 / 56696215 / -2.6%	0.67 / 0.65 / +2.9%
tpcds_q46/datafusion:parquet	28801418 / 29285283 / -1.7%	51129397 / 50483391 / +1.3%	0.56 / 0.58 / -2.9%
tpcds_q47/datafusion:parquet	96828968 / 96064894 / +0.8%	123446422 / 124772115 / -1.1%	0.78 / 0.77 / +1.9%
tpcds_q48/datafusion:parquet	38581605 / 39184082 / -1.5%	58849523 / 59428619 / -1.0%	0.66 / 0.66 / -0.6%
tpcds_q49/datafusion:parquet	74343987 / 75742571 / -1.8%	98814217 / 100779523 / -2.0%	0.75 / 0.75 / +0.1%
tpcds_q50/datafusion:parquet	49296286 / 49725453 / -0.9%	71142517 / 71986210 / -1.2%	0.69 / 0.69 / +0.3%
tpcds_q51/datafusion:parquet	68343610 / 67377716 / +1.4%	93164165 / 91845516 / +1.4%	0.73 / 0.73 / -0.0%
tpcds_q52/datafusion:parquet	15939708 / 16125732 / -1.2%	30771371 / 32017585 / -3.9%	0.52 / 0.50 / +2.8%
tpcds_q53/datafusion:parquet	21997995 / 21807609 / +0.9%	39044492 / 39526855 / -1.2%	0.56 / 0.55 / +2.1%
tpcds_q54/datafusion:parquet	45182346 / 46215392 / -2.2%	63160757 / 73212580 / -13.7% 🟢	0.72 / 0.63 / +13.3%
tpcds_q55/datafusion:parquet	15197834 / 15474708 / -1.8%	29475892 / 31363333 / -6.0%	0.52 / 0.49 / +4.5%
tpcds_q56/datafusion:parquet	31950545 / 31365942 / +1.9%	54508833 / 54923595 / -0.8%	0.59 / 0.57 / +2.6%
tpcds_q57/datafusion:parquet	98800236 / 98006640 / +0.8%	124048333 / 122670250 / +1.1%	0.80 / 0.80 / -0.3%
tpcds_q58/datafusion:parquet	64942240 / 65033637 / -0.1%	88504634 / 88151966 / +0.4%	0.73 / 0.74 / -0.5%
tpcds_q59/datafusion:parquet	42617026 / 43108228 / -1.1%	62416169 / 62974999 / -0.9%	0.68 / 0.68 / -0.3%
tpcds_q60/datafusion:parquet	31846866 / 31793662 / +0.2%	54492634 / 53658979 / +1.6%	0.58 / 0.59 / -1.4%
tpcds_q61/datafusion:parquet	34650556 / 33768030 / +2.6%	56575200 / 57247632 / -1.2%	0.61 / 0.59 / +3.8%
tpcds_q62/datafusion:parquet	24369728 / 24306398 / +0.3%	39332401 / 38325516 / +2.6%	0.62 / 0.63 / -2.3%
tpcds_q63/datafusion:parquet	22016690 / 22030706 / -0.1%	39764283 / 39255228 / +1.3%	0.55 / 0.56 / -1.3%
tpcds_q64/datafusion:parquet	209532724 / 204023590 / +2.7%	240534024 / 231346958 / +4.0%	0.87 / 0.88 / -1.2%
tpcds_q65/datafusion:parquet	38462150 / 38711588 / -0.6%	60508653 / 61900080 / -2.2%	0.64 / 0.63 / +1.6%
tpcds_q66/datafusion:parquet	62042764 / 62323432 / -0.5%	79892167 / 81639476 / -2.1%	0.78 / 0.76 / +1.7%
tpcds_q67/datafusion:parquet	70692509 / 69595706 / +1.6%	97866231 / 96974307 / +0.9%	0.72 / 0.72 / +0.7%
tpcds_q68/datafusion:parquet	29108127 / 29072096 / +0.1%	52867762 / 52032623 / +1.6%	0.55 / 0.56 / -1.5%
tpcds_q69/datafusion:parquet	41683735 / 42367724 / -1.6%	60869746 / 60706338 / +0.3%	0.68 / 0.70 / -1.9%
tpcds_q70/datafusion:parquet	32970122 / 32359241 / +1.9%	55592004 / 55110066 / +0.9%	0.59 / 0.59 / +1.0%
tpcds_q71/datafusion:parquet	23318700 / 23331948 / -0.1%	39773275 / 39567860 / +0.5%	0.59 / 0.59 / -0.6%
tpcds_q72/datafusion:parquet	550928576 / 543049072 / +1.5%	576302090 / 578032573 / -0.3%	0.96 / 0.94 / +1.8%
tpcds_q73/datafusion:parquet	22260688 / 21979588 / +1.3%	38940059 / 38473831 / +1.2%	0.57 / 0.57 / +0.1%
tpcds_q74/datafusion:parquet	67243158 / 66506028 / +1.1%	89935664 / 88387743 / +1.8%	0.75 / 0.75 / -0.6%
tpcds_q75/datafusion:parquet	149105484 / 149677034 / -0.4%	179364120 / 176523900 / +1.6%	0.83 / 0.85 / -2.0%
tpcds_q76/datafusion:parquet	47296366 / 48362237 / -2.2%	67551096 / 69261901 / -2.5%	0.70 / 0.70 / +0.3%
tpcds_q77/datafusion:parquet	51936688 / 53875350 / -3.6%	78444882 / 76638587 / +2.4%	0.66 / 0.70 / -5.8%
tpcds_q78/datafusion:parquet	92255424 / 93947298 / -1.8%	125980032 / 129317837 / -2.6%	0.73 / 0.73 / +0.8%
tpcds_q79/datafusion:parquet	25868505 / 25931262 / -0.2%	46426488 / 45687797 / +1.6%	0.56 / 0.57 / -1.8%
tpcds_q80/datafusion:parquet	82993192 / 81565048 / +1.8%	116193459 / 112947286 / +2.9%	0.71 / 0.72 / -1.1%
tpcds_q81/datafusion:parquet	38892467 / 38609454 / +0.7%	63985375 / 65832578 / -2.8%	0.61 / 0.59 / +3.6%
tpcds_q82/datafusion:parquet	25148956 / 25233106 / -0.3%	41257646 / 41273086 / -0.0%	0.61 / 0.61 / -0.3%
tpcds_q83/datafusion:parquet	47710359 / 48232414 / -1.1%	66903868 / 68293205 / -2.0%	0.71 / 0.71 / +1.0%
tpcds_q84/datafusion:parquet	28952850 / 29137260 / -0.6%	46474587 / 46871082 / -0.8%	0.62 / 0.62 / +0.2%
tpcds_q85/datafusion:parquet	86760916 / 86349040 / +0.5%	109836712 / 109795627 / +0.0%	0.79 / 0.79 / +0.4%
tpcds_q86/datafusion:parquet	20552200 / 20789744 / -1.1%	34636311 / 33918160 / +2.1%	0.59 / 0.61 / -3.2%
tpcds_q87/datafusion:parquet	43014363 / 43756394 / -1.7%	63069766 / 60757574 / +3.8%	0.68 / 0.72 / -5.3%
tpcds_q88/datafusion:parquet	39364527 / 38790937 / +1.5%	56678189 / 58777120 / -3.6%	0.69 / 0.66 / +5.2%
tpcds_q89/datafusion:parquet	25288862 / 25001790 / +1.1%	43353403 / 42628760 / +1.7%	0.58 / 0.59 / -0.5%
tpcds_q90/datafusion:parquet	15499360 / 16223661 / -4.5%	31172107 / 29751981 / +4.8%	0.50 / 0.55 / -8.8%
tpcds_q91/datafusion:parquet	31989163 / 31828924 / +0.5%	50265465 / 50934427 / -1.3%	0.64 / 0.62 / +1.8%
tpcds_q92/datafusion:parquet	23897296 / 23634697 / +1.1%	41303316 / 41176496 / +0.3%	0.58 / 0.57 / +0.8%
tpcds_q93/datafusion:parquet	27713712 / 28145666 / -1.5%	47775417 / 49000451 / -2.5%	0.58 / 0.57 / +1.0%
tpcds_q94/datafusion:parquet	32083802 / 32434936 / -1.1%	48951070 / 48033513 / +1.9%	0.66 / 0.68 / -2.9%
tpcds_q95/datafusion:parquet	65973529 / 65119122 / +1.3%	80940861 / 83797379 / -3.4%	0.82 / 0.78 / +4.9%
tpcds_q96/datafusion:parquet	12798458 / 13107111 / -2.4%	28411882 / 28101602 / +1.1%	0.45 / 0.47 / -3.4%
tpcds_q97/datafusion:parquet	31920180 / 32002645 / -0.3%	51683326 / 51314658 / +0.7%	0.62 / 0.62 / -1.0%
tpcds_q98/datafusion:parquet	22533998 / 22509651 / +0.1%	40028636 / 39200069 / +2.1%	0.56 / 0.57 / -2.0%
tpcds_q99/datafusion:parquet	28352283 / 28461048 / -0.4%	43004162 / 42675787 / +0.8%	0.66 / 0.67 / -1.1%

duckdb / vortex-file-compressed / ns (0.997x ➖, 3↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed	15194994 / 15109992 / +0.6%	25782573 / 22555174 / +14.3% 🔴	0.59 / 0.67 / -12.0%
tpcds_q02/duckdb:vortex-file-compressed	15162548 / 14877733 / +1.9%	20100238 / 19610158 / +2.5%	0.75 / 0.76 / -0.6%
tpcds_q03/duckdb:vortex-file-compressed	11138028 / 10709041 / +4.0%	19990388 / 19996485 / -0.0%	0.56 / 0.54 / +4.0%
tpcds_q04/duckdb:vortex-file-compressed	49806894 / 50583137 / -1.5%	59114891 / 58985333 / +0.2%	0.84 / 0.86 / -1.8%
tpcds_q05/duckdb:vortex-file-compressed	18554761 / 18871223 / -1.7%	25555518 / 27227074 / -6.1%	0.73 / 0.69 / +4.8%
tpcds_q06/duckdb:vortex-file-compressed	26725212 / 26720255 / +0.0%	40069395 / 40191246 / -0.3%	0.67 / 0.66 / +0.3%
tpcds_q07/duckdb:vortex-file-compressed	15968787 / 15848842 / +0.8%	31696675 / 32000017 / -0.9%	0.50 / 0.50 / +1.7%
tpcds_q08/duckdb:vortex-file-compressed	18735073 / 19256016 / -2.7%	27275560 / 31243171 / -12.7% 🟢	0.69 / 0.62 / +11.4%
tpcds_q09/duckdb:vortex-file-compressed	13988530 / 13521268 / +3.5%	21615754 / 23346928 / -7.4%	0.65 / 0.58 / +11.7%
tpcds_q10/duckdb:vortex-file-compressed	27391022 / 27559704 / -0.6%	42472368 / 42727724 / -0.6%	0.64 / 0.65 / -0.0%
tpcds_q11/duckdb:vortex-file-compressed	40392628 / 40659500 / -0.7%	50193601 / 50683961 / -1.0%	0.80 / 0.80 / +0.3%
tpcds_q12/duckdb:vortex-file-compressed	10350886 / 11175422 / -7.4%	15899018 / 18655031 / -14.8% 🟢	0.65 / 0.60 / +8.7%
tpcds_q13/duckdb:vortex-file-compressed	21172268 / 22072865 / -4.1%	34189611 / 34637527 / -1.3%	0.62 / 0.64 / -2.8%
tpcds_q14/duckdb:vortex-file-compressed	60527786 / 57798928 / +4.7%	69962389 / 71931567 / -2.7%	0.87 / 0.80 / +7.7%
tpcds_q15/duckdb:vortex-file-compressed	20887552 / 20643422 / +1.2%	30006473 / 26832028 / +11.8% 🔴	0.70 / 0.77 / -9.5%
tpcds_q16/duckdb:vortex-file-compressed	17517254 / 17169531 / +2.0%	25980048 / 31052660 / -16.3% 🟢	0.67 / 0.55 / +21.9%
tpcds_q17/duckdb:vortex-file-compressed	30268469 / 29697766 / +1.9%	45157153 / 44634052 / +1.2%	0.67 / 0.67 / +0.7%
tpcds_q18/duckdb:vortex-file-compressed	27977726 / 27914590 / +0.2%	37984768 / 38146841 / -0.4%	0.74 / 0.73 / +0.7%
tpcds_q19/duckdb:vortex-file-compressed	24091164 / 23551805 / +2.3%	39382459 / 36587160 / +7.6%	0.61 / 0.64 / -5.0%
tpcds_q20/duckdb:vortex-file-compressed	10681250 / 10423579 / +2.5%	14753200 / 14974406 / -1.5%	0.72 / 0.70 / +4.0%
tpcds_q21/duckdb:vortex-file-compressed	9967048 / 9732644 / +2.4%	23616493 / 20869458 / +13.2% 🔴	0.42 / 0.47 / -9.5%
tpcds_q22/duckdb:vortex-file-compressed	30278644 / 28934613 / +4.6%	39517852 / 45328840 / -12.8% 🟢	0.77 / 0.64 / +20.0%
tpcds_q23/duckdb:vortex-file-compressed	36977486 / 37345084 / -1.0%	47820823 / 46539001 / +2.8%	0.77 / 0.80 / -3.6%
tpcds_q24/duckdb:vortex-file-compressed	28281198 / 27597522 / +2.5%	39773201 / 38939335 / +2.1%	0.71 / 0.71 / +0.3%
tpcds_q25/duckdb:vortex-file-compressed	26285061 / 25087966 / +4.8%	40392451 / 41739004 / -3.2%	0.65 / 0.60 / +8.3%
tpcds_q26/duckdb:vortex-file-compressed	13495821 / 13474533 / +0.2%	20797012 / 20742055 / +0.3%	0.65 / 0.65 / -0.1%
tpcds_q27/duckdb:vortex-file-compressed	17422593 / 17791639 / -2.1%	32099716 / 32810185 / -2.2%	0.54 / 0.54 / +0.1%
tpcds_q28/duckdb:vortex-file-compressed	12997498 / 13400955 / -3.0%	21643693 / 21193670 / +2.1%	0.60 / 0.63 / -5.0%
tpcds_q29/duckdb:vortex-file-compressed	28467844 / 28604788 / -0.5%	45267371 / 44837382 / +1.0%	0.63 / 0.64 / -1.4%
tpcds_q30/duckdb:vortex-file-compressed	19399298 / 19247509 / +0.8%	28100964 / 30515438 / -7.9%	0.69 / 0.63 / +9.4%
tpcds_q31/duckdb:vortex-file-compressed	19277386 / 19561454 / -1.5%	27161618 / 27764728 / -2.2%	0.71 / 0.70 / +0.7%
tpcds_q32/duckdb:vortex-file-compressed	9742856 / 9934880 / -1.9%	15650649 / 15394661 / +1.7%	0.62 / 0.65 / -3.5%
tpcds_q33/duckdb:vortex-file-compressed	16906998 / 16818074 / +0.5%	27630895 / 28530966 / -3.2%	0.61 / 0.59 / +3.8%
tpcds_q34/duckdb:vortex-file-compressed	15296921 / 15540835 / -1.6%	21937848 / 21381467 / +2.6%	0.70 / 0.73 / -4.1%
tpcds_q35/duckdb:vortex-file-compressed	45960587 / 45673800 / +0.6%	60369273 / 59707152 / +1.1%	0.76 / 0.76 / -0.5%
tpcds_q36/duckdb:vortex-file-compressed	15419462 / 14566752 / +5.9%	27985031 / 27849212 / +0.5%	0.55 / 0.52 / +5.3%
tpcds_q37/duckdb:vortex-file-compressed	14067678 / 13765446 / +2.2%	22764616 / 21879522 / +4.0%	0.62 / 0.63 / -1.8%
tpcds_q38/duckdb:vortex-file-compressed	22153643 / 22286050 / -0.6%	28101276 / 27971885 / +0.5%	0.79 / 0.80 / -1.1%
tpcds_q39/duckdb:vortex-file-compressed	18163090 / 18166399 / -0.0%	28511551 / 26828764 / +6.3%	0.64 / 0.68 / -5.9%
tpcds_q40/duckdb:vortex-file-compressed	13126715 / 12910519 / +1.7%	18457344 / 18094140 / +2.0%	0.71 / 0.71 / -0.3%
tpcds_q41/duckdb:vortex-file-compressed	6280326 / 6199719 / +1.3%	12855709 / 8763798 / +46.7% 🔴	0.49 / 0.71 / -30.9%
tpcds_q42/duckdb:vortex-file-compressed	9438780 / 9386284 / +0.6%	21294014 / 20518528 / +3.8%	0.44 / 0.46 / -3.1%
tpcds_q43/duckdb:vortex-file-compressed	11139918 / 10010021 / +11.3% 🔴	17999559 / 17823876 / +1.0%	0.62 / 0.56 / +10.2%
tpcds_q44/duckdb:vortex-file-compressed	15557816 / 15364102 / +1.3%	24032988 / 25418031 / -5.4%	0.65 / 0.60 / +7.1%
tpcds_q45/duckdb:vortex-file-compressed	22177192 / 22125568 / +0.2%	29810598 / 28461078 / +4.7%	0.74 / 0.78 / -4.3%
tpcds_q46/duckdb:vortex-file-compressed	18729518 / 18533222 / +1.1%	30122844 / 30378536 / -0.8%	0.62 / 0.61 / +1.9%
tpcds_q47/duckdb:vortex-file-compressed	30389626 / 30621538 / -0.8%	42883584 / 44512844 / -3.7%	0.71 / 0.69 / +3.0%
tpcds_q48/duckdb:vortex-file-compressed	19309462 / 19309910 / -0.0%	30477741 / 34522536 / -11.7% 🟢	0.63 / 0.56 / +13.3%
tpcds_q49/duckdb:vortex-file-compressed	16400612 / 16747347 / -2.1%	29877286 / 29142215 / +2.5%	0.55 / 0.57 / -4.5%
tpcds_q50/duckdb:vortex-file-compressed	16238181 / 16152882 / +0.5%	27465088 / 27830657 / -1.3%	0.59 / 0.58 / +1.9%
tpcds_q51/duckdb:vortex-file-compressed	76605290 / 76142440 / +0.6%	65364714 / 61442945 / +6.4%	1.17 / 1.24 / -5.4%
tpcds_q52/duckdb:vortex-file-compressed	8173113 / 10011842 / -18.4% 🟢	18429071 / 22600345 / -18.5% 🟢	0.44 / 0.44 / +0.1%
tpcds_q53/duckdb:vortex-file-compressed	14001198 / 14245230 / -1.7%	24880995 / 24662192 / +0.9%	0.56 / 0.58 / -2.6%
tpcds_q54/duckdb:vortex-file-compressed	20753215 / 20718012 / +0.2%	33573119 / 30241826 / +11.0% 🔴	0.62 / 0.69 / -9.8%
tpcds_q55/duckdb:vortex-file-compressed	8745192 / 9891560 / -11.6% 🟢	19993433 / 19897219 / +0.5%	0.44 / 0.50 / -12.0%
tpcds_q56/duckdb:vortex-file-compressed	17568994 / 17023802 / +3.2%	28724858 / 28504035 / +0.8%	0.61 / 0.60 / +2.4%
tpcds_q57/duckdb:vortex-file-compressed	24078594 / 23970705 / +0.5%	31245352 / 31052325 / +0.6%	0.77 / 0.77 / -0.2%
tpcds_q58/duckdb:vortex-file-compressed	18225466 / 17541122 / +3.9%	28633735 / 29725685 / -3.7%	0.64 / 0.59 / +7.9%
tpcds_q59/duckdb:vortex-file-compressed	18702768 / 18456122 / +1.3%	26117322 / 26723164 / -2.3%	0.72 / 0.69 / +3.7%
tpcds_q60/duckdb:vortex-file-compressed	17744934 / 18313052 / -3.1%	31939320 / 29591153 / +7.9%	0.56 / 0.62 / -10.2%
tpcds_q61/duckdb:vortex-file-compressed	20188672 / 19060392 / +5.9%	31718325 / 32856256 / -3.5%	0.64 / 0.58 / +9.7%
tpcds_q62/duckdb:vortex-file-compressed	10231970 / 10155522 / +0.8%	18497121 / 15849977 / +16.7% 🔴	0.55 / 0.64 / -13.7%
tpcds_q63/duckdb:vortex-file-compressed	13740618 / 13378280 / +2.7%	26644788 / 24732601 / +7.7%	0.52 / 0.54 / -4.7%
tpcds_q64/duckdb:vortex-file-compressed	62190578 / 62124183 / +0.1%	77807943 / 81817087 / -4.9%	0.80 / 0.76 / +5.3%
tpcds_q65/duckdb:vortex-file-compressed	14783962 / 15433653 / -4.2%	25881083 / 25182422 / +2.8%	0.57 / 0.61 / -6.8%
tpcds_q66/duckdb:vortex-file-compressed	21069722 / 20860232 / +1.0%	31972622 / 28622511 / +11.7% 🔴	0.66 / 0.73 / -9.6%
tpcds_q67/duckdb:vortex-file-compressed	65202520 / 66273308 / -1.6%	82991718 / 81052944 / +2.4%	0.79 / 0.82 / -3.9%
tpcds_q68/duckdb:vortex-file-compressed	18350024 / 18108900 / +1.3%	30810695 / 28885227 / +6.7%	0.60 / 0.63 / -5.0%
tpcds_q69/duckdb:vortex-file-compressed	28881999 / 28544807 / +1.2%	45444460 / 42854744 / +6.0%	0.64 / 0.67 / -4.6%
tpcds_q70/duckdb:vortex-file-compressed	18715168 / 19742232 / -5.2%	31629977 / 28816082 / +9.8%	0.59 / 0.69 / -13.6%
tpcds_q71/duckdb:vortex-file-compressed	12930220 / 12610391 / +2.5%	24467905 / 24341365 / +0.5%	0.53 / 0.52 / +2.0%
tpcds_q72/duckdb:vortex-file-compressed	61809398 / 61615280 / +0.3%	77780846 / 78195916 / -0.5%	0.79 / 0.79 / +0.9%
tpcds_q73/duckdb:vortex-file-compressed	15061782 / 15098730 / -0.2%	20433289 / 20498943 / -0.3%	0.74 / 0.74 / +0.1%
tpcds_q74/duckdb:vortex-file-compressed	27737439 / 27470449 / +1.0%	35928786 / 38598222 / -6.9%	0.77 / 0.71 / +8.5%
tpcds_q75/duckdb:vortex-file-compressed	28313443 / 28163060 / +0.5%	40222291 / 43083136 / -6.6%	0.70 / 0.65 / +7.7%
tpcds_q76/duckdb:vortex-file-compressed	12351257 / 12183152 / +1.4%	24301576 / 24669583 / -1.5%	0.51 / 0.49 / +2.9%
tpcds_q77/duckdb:vortex-file-compressed	16163052 / 15888722 / +1.7%	27900442 / 24824297 / +12.4% 🔴	0.58 / 0.64 / -9.5%
tpcds_q78/duckdb:vortex-file-compressed	37107554 / 36951866 / +0.4%	45671349 / 46890419 / -2.6%	0.81 / 0.79 / +3.1%
tpcds_q79/duckdb:vortex-file-compressed	14608541 / 15601516 / -6.4%	29685692 / 24630061 / +20.5% 🔴	0.49 / 0.63 / -22.3%
tpcds_q80/duckdb:vortex-file-compressed	28479134 / 27379068 / +4.0%	45490068 / 42431948 / +7.2%	0.63 / 0.65 / -3.0%
tpcds_q81/duckdb:vortex-file-compressed	22458932 / 22456538 / +0.0%	30718132 / 30400913 / +1.0%	0.73 / 0.74 / -1.0%
tpcds_q82/duckdb:vortex-file-compressed	32176319 / 33295286 / -3.4%	40549881 / 39549875 / +2.5%	0.79 / 0.84 / -5.7%
tpcds_q83/duckdb:vortex-file-compressed	19291649 / 19505349 / -1.1%	25835008 / 24310270 / +6.3%	0.75 / 0.80 / -6.9%
tpcds_q84/duckdb:vortex-file-compressed	12582810 / 15513996 / -18.9% 🟢	21750899 / 17546700 / +24.0% 🔴	0.58 / 0.88 / -34.6%
tpcds_q85/duckdb:vortex-file-compressed	30800186 / 31335026 / -1.7%	40168913 / 41453455 / -3.1%	0.77 / 0.76 / +1.4%
tpcds_q86/duckdb:vortex-file-compressed	10817174 / 10660657 / +1.5%	21018845 / 18068784 / +16.3% 🔴	0.51 / 0.59 / -12.8%
tpcds_q87/duckdb:vortex-file-compressed	24395152 / 23923098 / +2.0%	29909732 / 30093097 / -0.6%	0.82 / 0.79 / +2.6%
tpcds_q88/duckdb:vortex-file-compressed	31681826 / 32105716 / -1.3%	44913846 / 47173735 / -4.8%	0.71 / 0.68 / +3.6%
tpcds_q89/duckdb:vortex-file-compressed	13707855 / 13729194 / -0.2%	24183729 / 25175417 / -3.9%	0.57 / 0.55 / +3.9%
tpcds_q90/duckdb:vortex-file-compressed	8029498 / 8555997 / -6.2%	15173684 / 12691981 / +19.6% 🔴	0.53 / 0.67 / -21.5%
tpcds_q91/duckdb:vortex-file-compressed	15484906 / 17083202 / -9.4%	21716242 / 22550961 / -3.7%	0.71 / 0.76 / -5.9%
tpcds_q92/duckdb:vortex-file-compressed	12627400 / 12610630 / +0.1%	19743075 / 20136026 / -2.0%	0.64 / 0.63 / +2.1%
tpcds_q93/duckdb:vortex-file-compressed	17089096 / 17035598 / +0.3%	26708722 / 25900534 / +3.1%	0.64 / 0.66 / -2.7%
tpcds_q94/duckdb:vortex-file-compressed	16220996 / 16180826 / +0.2%	26033013 / 25338832 / +2.7%	0.62 / 0.64 / -2.4%
tpcds_q95/duckdb:vortex-file-compressed	43962484 / 44211612 / -0.6%	54309653 / 54655590 / -0.6%	0.81 / 0.81 / +0.1%
tpcds_q96/duckdb:vortex-file-compressed	7164951 / 7014884 / +2.1%	14727932 / 15030542 / -2.0%	0.49 / 0.47 / +4.2%
tpcds_q97/duckdb:vortex-file-compressed	22264401 / 24121952 / -7.7%	29472771 / 30144060 / -2.2%	0.76 / 0.80 / -5.6%
tpcds_q98/duckdb:vortex-file-compressed	14078180 / 12983938 / +8.4%	24682843 / 24877075 / -0.8%	0.57 / 0.52 / +9.3%
tpcds_q99/duckdb:vortex-file-compressed	13460589 / 13425544 / +0.3%	18489266 / 22434336 / -17.6% 🟢	0.73 / 0.60 / +21.7%

duckdb / parquet / ns (0.999x ➖, 2↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet	27115156 / 25032765 / +8.3%	31371986 / 32284052 / -2.8%	0.86 / 0.78 / +11.5%
tpcds_q02/duckdb:parquet	15889231 / 15473360 / +2.7%	21419983 / 20962426 / +2.2%	0.74 / 0.74 / +0.5%
tpcds_q03/duckdb:parquet	9261089 / 9198957 / +0.7%	15873539 / 15618029 / +1.6%	0.58 / 0.59 / -0.9%
tpcds_q04/duckdb:parquet	129813746 / 129869422 / -0.0%	135855716 / 137083258 / -0.9%	0.96 / 0.95 / +0.9%
tpcds_q05/duckdb:parquet	22482894 / 23595243 / -4.7%	33801262 / 25787740 / +31.1% 🔴	0.67 / 0.91 / -27.3%
tpcds_q06/duckdb:parquet	29985750 / 27588629 / +8.7%	36518108 / 36116247 / +1.1%	0.82 / 0.76 / +7.5%
tpcds_q07/duckdb:parquet	15758799 / 15770005 / -0.1%	29135698 / 27008794 / +7.9%	0.54 / 0.58 / -7.4%
tpcds_q08/duckdb:parquet	29396797 / 25973440 / +13.2% 🔴	36804547 / 33117789 / +11.1% 🔴	0.80 / 0.78 / +1.8%
tpcds_q09/duckdb:parquet	19346481 / 18850589 / +2.6%	23698531 / 22828033 / +3.8%	0.82 / 0.83 / -1.1%
tpcds_q10/duckdb:parquet	30028730 / 28014204 / +7.2%	41164880 / 37224192 / +10.6% 🔴	0.73 / 0.75 / -3.1%
tpcds_q11/duckdb:parquet	73395796 / 73127976 / +0.4%	79186182 / 78068892 / +1.4%	0.93 / 0.94 / -1.0%
tpcds_q12/duckdb:parquet	12989398 / 13033152 / -0.3%	18703966 / 18018750 / +3.8%	0.69 / 0.72 / -4.0%
tpcds_q13/duckdb:parquet	24371904 / 24336272 / +0.1%	36748591 / 30681048 / +19.8% 🔴	0.66 / 0.79 / -16.4%
tpcds_q14/duckdb:parquet	61448316 / 62129036 / -1.1%	67698437 / 68811211 / -1.6%	0.91 / 0.90 / +0.5%
tpcds_q15/duckdb:parquet	25627594 / 25144445 / +1.9%	30559157 / 30176939 / +1.3%	0.84 / 0.83 / +0.6%
tpcds_q16/duckdb:parquet	21255685 / 20953178 / +1.4%	28515919 / 28582596 / -0.2%	0.75 / 0.73 / +1.7%
tpcds_q17/duckdb:parquet	33114950 / 33010142 / +0.3%	41251154 / 40775842 / +1.2%	0.80 / 0.81 / -0.8%
tpcds_q18/duckdb:parquet	40907654 / 40153588 / +1.9%	50062057 / 49480447 / +1.2%	0.82 / 0.81 / +0.7%
tpcds_q19/duckdb:parquet	26780583 / 25031546 / +7.0%	34273936 / 32310579 / +6.1%	0.78 / 0.77 / +0.9%
tpcds_q20/duckdb:parquet	15701424 / 13893262 / +13.0% 🔴	18779066 / 18424158 / +1.9%	0.84 / 0.75 / +10.9%
tpcds_q21/duckdb:parquet	9702434 / 9440514 / +2.8%	12301334 / 15807491 / -22.2% 🟢	0.79 / 0.60 / +32.1%
tpcds_q22/duckdb:parquet	35540825 / 36707152 / -3.2%	39662086 / 39211374 / +1.1%	0.90 / 0.94 / -4.3%
tpcds_q23/duckdb:parquet	41528183 / 40976479 / +1.3%	48944979 / 48320787 / +1.3%	0.85 / 0.85 / +0.1%
tpcds_q24/duckdb:parquet	34062460 / 33726389 / +1.0%	41566062 / 42376026 / -1.9%	0.82 / 0.80 / +3.0%
tpcds_q25/duckdb:parquet	31945289 / 31548405 / +1.3%	39463885 / 39274094 / +0.5%	0.81 / 0.80 / +0.8%
tpcds_q26/duckdb:parquet	32336102 / 31943624 / +1.2%	38565225 / 41221148 / -6.4%	0.84 / 0.77 / +8.2%
tpcds_q27/duckdb:parquet	32148344 / 33644018 / -4.4%	40484581 / 42575322 / -4.9%	0.79 / 0.79 / +0.5%
tpcds_q28/duckdb:parquet	17741658 / 18191090 / -2.5%	22578168 / 22102189 / +2.2%	0.79 / 0.82 / -4.5%
tpcds_q29/duckdb:parquet	31515770 / 31402191 / +0.4%	39588353 / 39123812 / +1.2%	0.80 / 0.80 / -0.8%
tpcds_q30/duckdb:parquet	34885066 / 37142708 / -6.1%	45899759 / 45897501 / +0.0%	0.76 / 0.81 / -6.1%
tpcds_q31/duckdb:parquet	20784650 / 20936822 / -0.7%	27764695 / 29846721 / -7.0%	0.75 / 0.70 / +6.7%
tpcds_q32/duckdb:parquet	12355425 / 15207210 / -18.8% 🟢	18654488 / 20766533 / -10.2% 🟢	0.66 / 0.73 / -9.6%
tpcds_q33/duckdb:parquet	17965950 / 16386836 / +9.6%	24690133 / 23619303 / +4.5%	0.73 / 0.69 / +4.9%
tpcds_q34/duckdb:parquet	16518793 / 16382676 / +0.8%	22121163 / 21893599 / +1.0%	0.75 / 0.75 / -0.2%
tpcds_q35/duckdb:parquet	47443796 / 46240120 / +2.6%	56328512 / 56766477 / -0.8%	0.84 / 0.81 / +3.4%
tpcds_q36/duckdb:parquet	16117962 / 15876304 / +1.5%	23741338 / 23393646 / +1.5%	0.68 / 0.68 / +0.0%
tpcds_q37/duckdb:parquet	11632348 / 12678188 / -8.2%	17038720 / 19632816 / -13.2% 🟢	0.68 / 0.65 / +5.7%
tpcds_q38/duckdb:parquet	27170822 / 26848844 / +1.2%	30428614 / 30935308 / -1.6%	0.89 / 0.87 / +2.9%
tpcds_q39/duckdb:parquet	24443952 / 24548307 / -0.4%	27522891 / 28872193 / -4.7%	0.89 / 0.85 / +4.5%
tpcds_q40/duckdb:parquet	16612080 / 16536366 / +0.5%	21226562 / 21246312 / -0.1%	0.78 / 0.78 / +0.6%
tpcds_q41/duckdb:parquet	7882283 / 7907663 / -0.3%	13118977 / 15541766 / -15.6% 🟢	0.60 / 0.51 / +18.1%
tpcds_q42/duckdb:parquet	8910814 / 8740484 / +1.9%	16040131 / 14977415 / +7.1%	0.56 / 0.58 / -4.8%
tpcds_q43/duckdb:parquet	10757057 / 10616841 / +1.3%	15099328 / 14919576 / +1.2%	0.71 / 0.71 / +0.1%
tpcds_q44/duckdb:parquet	16198206 / 16013779 / +1.2%	23809195 / 21547938 / +10.5% 🔴	0.68 / 0.74 / -8.5%
tpcds_q45/duckdb:parquet	23957118 / 23775068 / +0.8%	30013555 / 29257077 / +2.6%	0.80 / 0.81 / -1.8%
tpcds_q46/duckdb:parquet	37165019 / 37073662 / +0.2%	45979103 / 45930824 / +0.1%	0.81 / 0.81 / +0.1%
tpcds_q47/duckdb:parquet	34208676 / 34017290 / +0.6%	40585002 / 36378978 / +11.6% 🔴	0.84 / 0.94 / -9.9%
tpcds_q48/duckdb:parquet	21312726 / 21362478 / -0.2%	27759492 / 27675047 / +0.3%	0.77 / 0.77 / -0.5%
tpcds_q49/duckdb:parquet	20329448 / 21129274 / -3.8%	28195948 / 27837348 / +1.3%	0.72 / 0.76 / -5.0%
tpcds_q50/duckdb:parquet	18032916 / 17752619 / +1.6%	23722797 / 23887179 / -0.7%	0.76 / 0.74 / +2.3%
tpcds_q51/duckdb:parquet	54410720 / 54101434 / +0.6%	60748632 / 60237816 / +0.8%	0.90 / 0.90 / -0.3%
tpcds_q52/duckdb:parquet	8900018 / 9022459 / -1.4%	15907654 / 15688051 / +1.4%	0.56 / 0.58 / -2.7%
tpcds_q53/duckdb:parquet	11802182 / 11699200 / +0.9%	16685854 / 16747836 / -0.4%	0.71 / 0.70 / +1.3%
tpcds_q54/duckdb:parquet	20735874 / 21432112 / -3.2%	29892578 / 29731160 / +0.5%	0.69 / 0.72 / -3.8%
tpcds_q55/duckdb:parquet	8901189 / 8923416 / -0.2%	15695139 / 18427884 / -14.8% 🟢	0.57 / 0.48 / +17.1%
tpcds_q56/duckdb:parquet	17486670 / 17282164 / +1.2%	24287886 / 23626155 / +2.8%	0.72 / 0.73 / -1.6%
tpcds_q57/duckdb:parquet	29303923 / 29041296 / +0.9%	34643151 / 35689408 / -2.9%	0.85 / 0.81 / +4.0%
tpcds_q58/duckdb:parquet	19151685 / 19353658 / -1.0%	26674460 / 26626738 / +0.2%	0.72 / 0.73 / -1.2%
tpcds_q59/duckdb:parquet	20383200 / 20086598 / +1.5%	25355983 / 25107040 / +1.0%	0.80 / 0.80 / +0.5%
tpcds_q60/duckdb:parquet	17564335 / 18142084 / -3.2%	27849522 / 25049883 / +11.2% 🔴	0.63 / 0.72 / -12.9%
tpcds_q61/duckdb:parquet	22242946 / 22256192 / -0.1%	32861114 / 28230857 / +16.4% 🔴	0.68 / 0.79 / -14.1%
tpcds_q62/duckdb:parquet	10988895 / 12191050 / -9.9%	15740123 / 14940471 / +5.4%	0.70 / 0.82 / -14.4%
tpcds_q63/duckdb:parquet	11273282 / 11084852 / +1.7%	16288954 / 16355070 / -0.4%	0.69 / 0.68 / +2.1%
tpcds_q64/duckdb:parquet	53900816 / 54404328 / -0.9%	64656999 / 70607579 / -8.4%	0.83 / 0.77 / +8.2%
tpcds_q65/duckdb:parquet	14947250 / 16043660 / -6.8%	20555724 / 20416899 / +0.7%	0.73 / 0.79 / -7.5%
tpcds_q66/duckdb:parquet	24954722 / 25393006 / -1.7%	32203837 / 31294584 / +2.9%	0.77 / 0.81 / -4.5%
tpcds_q67/duckdb:parquet	77133432 / 76828664 / +0.4%	86818425 / 87151039 / -0.4%	0.89 / 0.88 / +0.8%
tpcds_q68/duckdb:parquet	30308734 / 30271823 / +0.1%	39867357 / 39808930 / +0.1%	0.76 / 0.76 / -0.0%
tpcds_q69/duckdb:parquet	29353062 / 29236274 / +0.4%	39252514 / 38226050 / +2.7%	0.75 / 0.76 / -2.2%
tpcds_q70/duckdb:parquet	16304266 / 16490920 / -1.1%	23512021 / 25437253 / -7.6%	0.69 / 0.65 / +7.0%
tpcds_q71/duckdb:parquet	15193942 / 16470892 / -7.8%	21999223 / 22268661 / -1.2%	0.69 / 0.74 / -6.6%
tpcds_q72/duckdb:parquet	85216212 / 81905514 / +4.0%	88853852 / 88753986 / +0.1%	0.96 / 0.92 / +3.9%
tpcds_q73/duckdb:parquet	13905434 / 13981429 / -0.5%	19419745 / 19121666 / +1.6%	0.72 / 0.73 / -2.1%
tpcds_q74/duckdb:parquet	100763851 / 100598416 / +0.2%	110880300 / 110277425 / +0.5%	0.91 / 0.91 / -0.4%
tpcds_q75/duckdb:parquet	41729352 / 40763044 / +2.4%	50753351 / 51721055 / -1.9%	0.82 / 0.79 / +4.3%
tpcds_q76/duckdb:parquet	13823816 / 13872024 / -0.3%	22237970 / 21363764 / +4.1%	0.62 / 0.65 / -4.3%
tpcds_q77/duckdb:parquet	17889416 / 17790820 / +0.6%	26026048 / 28612701 / -9.0%	0.69 / 0.62 / +10.5%
tpcds_q78/duckdb:parquet	48746848 / 48560095 / +0.4%	53663516 / 53862279 / -0.4%	0.91 / 0.90 / +0.8%
tpcds_q79/duckdb:parquet	21351572 / 21213332 / +0.7%	29108370 / 29267424 / -0.5%	0.73 / 0.72 / +1.2%
tpcds_q80/duckdb:parquet	33394353 / 32788134 / +1.8%	42396176 / 40411447 / +4.9%	0.79 / 0.81 / -2.9%
tpcds_q81/duckdb:parquet	31868250 / 31597650 / +0.9%	40633946 / 41690381 / -2.5%	0.78 / 0.76 / +3.5%
tpcds_q82/duckdb:parquet	12596138 / 13323964 / -5.5%	20649274 / 19226163 / +7.4%	0.61 / 0.69 / -12.0%
tpcds_q83/duckdb:parquet	16541641 / 16701858 / -1.0%	21778148 / 21309951 / +2.2%	0.76 / 0.78 / -3.1%
tpcds_q84/duckdb:parquet	18529492 / 18606472 / -0.4%	24134105 / 23418065 / +3.1%	0.77 / 0.79 / -3.4%
tpcds_q85/duckdb:parquet	35597106 / 35720742 / -0.3%	45649828 / 45328165 / +0.7%	0.78 / 0.79 / -1.0%
tpcds_q86/duckdb:parquet	11484544 / 11380962 / +0.9%	16940167 / 19395981 / -12.7% 🟢	0.68 / 0.59 / +15.5%
tpcds_q87/duckdb:parquet	28767100 / 28763213 / +0.0%	32897713 / 35217120 / -6.6%	0.87 / 0.82 / +7.1%
tpcds_q88/duckdb:parquet	26926372 / 27236666 / -1.1%	37756021 / 31771244 / +18.8% 🔴	0.71 / 0.86 / -16.8%
tpcds_q89/duckdb:parquet	13101882 / 14299571 / -8.4%	21224998 / 25191870 / -15.7% 🟢	0.62 / 0.57 / +8.7%
tpcds_q90/duckdb:parquet	7097118 / 7940396 / -10.6% 🟢	11441193 / 13335686 / -14.2% 🟢	0.62 / 0.60 / +4.2%
tpcds_q91/duckdb:parquet	21830960 / 21481024 / +1.6%	28225864 / 28792559 / -2.0%	0.77 / 0.75 / +3.7%
tpcds_q92/duckdb:parquet	12432045 / 12790614 / -2.8%	20111496 / 19530407 / +3.0%	0.62 / 0.65 / -5.6%
tpcds_q93/duckdb:parquet	21781961 / 21955644 / -0.8%	26934607 / 30964375 / -13.0% 🟢	0.81 / 0.71 / +14.1%
tpcds_q94/duckdb:parquet	17068395 / 17216065 / -0.9%	26644978 / 25904685 / +2.9%	0.64 / 0.66 / -3.6%
tpcds_q95/duckdb:parquet	91436050 / 90983534 / +0.5%	99000091 / 98738651 / +0.3%	0.92 / 0.92 / +0.2%
tpcds_q96/duckdb:parquet	7163077 / 6942335 / +3.2%	10910791 / 11092391 / -1.6%	0.66 / 0.63 / +4.9%
tpcds_q97/duckdb:parquet	26216864 / 26027682 / +0.7%	32427985 / 31935948 / +1.5%	0.81 / 0.81 / -0.8%
tpcds_q98/duckdb:parquet	15380616 / 15417780 / -0.2%	22865127 / 22887816 / -0.1%	0.67 / 0.67 / -0.1%
tpcds_q99/duckdb:parquet	17443608 / 17402766 / +0.2%	21269333 / 24231476 / -12.2% 🟢	0.82 / 0.72 / +14.2%

No file size changes detected.

github-actions · 2026-09-25T01:41:00Z

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

…10356) This PR adds benchmarks for CASE WHEN with fragmented branches. It is the first PR in a stack. #9820 changes the CASE WHEN execution on top of it. With the benchmarks merged first, CodSpeed can compare #9820 against a baseline.

…ution Signed-off-by: Nicholas Gates <nick@nickgates.com>

Signed-off-by: Robert Kruszewski <github@robertk.io>

CASE WHEN accepts THEN and ELSE values that differ in nested nullability, but its output dtype only merged the top-level nullability. When a nested field was nullable on one side only, reading a row with a null in that field failed with a cast error. - Merge nullability at every nesting level in `return_dtype`. Use the helper that `zip` already uses. - Give `merge_case_branches` the output dtype and the ELSE mask from `execute`. Do not compute them again. - Cast each value once in `merge_runs`, not once for each span. - Test compact merges with two branches plus ELSE rows. Signed-off-by: Robert Kruszewski <github@robertk.io> Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

github-actions · 2026-10-09T15:15:46Z

Benchmarks: PolarSignals Profiling 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Vortex (geomean): hot 1.000x ➖ · cold 1.035x ➖

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed	57534424 / 57277368 / +0.4%	103627729 / 100972360 / +2.6%	0.56 / 0.57 / -2.1%
polarsignals_q01/datafusion:vortex-file-compressed	63016292 / 63594898 / -0.9%	123502217 / 122472384 / +0.8%	0.51 / 0.52 / -1.7%
polarsignals_q02/datafusion:vortex-file-compressed	74986430 / 73026048 / +2.7%	113912008 / 108707193 / +4.8%	0.66 / 0.67 / -2.0%
polarsignals_q03/datafusion:vortex-file-compressed	79575264 / 79375290 / +0.3%	142290713 / 142858742 / -0.4%	0.56 / 0.56 / +0.7%
polarsignals_q04/datafusion:vortex-file-compressed	9492128 / 9590586 / -1.0%	49802248 / 46856790 / +6.3%	0.19 / 0.20 / -6.9%
polarsignals_q05/datafusion:vortex-file-compressed	24165613 / 24808702 / -2.6%	67661842 / 64348900 / +5.1%	0.36 / 0.39 / -7.4%
polarsignals_q06/datafusion:vortex-file-compressed	21292384 / 21865006 / -2.6%	62627421 / 60949470 / +2.8%	0.34 / 0.36 / -5.2%
polarsignals_q07/datafusion:vortex-file-compressed	39748930 / 39719886 / +0.1%	79832795 / 78595611 / +1.6%	0.50 / 0.51 / -1.5%
polarsignals_q08/datafusion:vortex-file-compressed	98513502 / 98373706 / +0.1%	168914731 / 162036383 / +4.2%	0.58 / 0.61 / -3.9%
polarsignals_q09/datafusion:vortex-file-compressed	10568499 / 10198891 / +3.6%	50851553 / 47193236 / +7.8%	0.21 / 0.22 / -3.8%

No file size changes detected.

github-actions · 2026-10-09T15:16:16Z

Benchmarks: FineWeb NVMe 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-5.0%, low confidence) · DuckDB No clear signal (+3.9%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.051x ➖
Parquet (geomean): hot 1.007x ➖ · cold 0.990x ➖
Shifts: Parquet (control) +0.7% · Median polish +0.9%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	6953906 / 7149346 / -2.7%	21074132 / 20242683 / +4.1%	0.33 / 0.35 / -6.6%
fineweb_q01/datafusion:vortex-file-compressed	12111407 / 12673774 / -4.4%	55149496 / 46397001 / +18.9% 🔴	0.22 / 0.27 / -19.6%
fineweb_q02/datafusion:vortex-file-compressed	12963146 / 13577434 / -4.5%	57700377 / 46147036 / +25.0% 🔴	0.22 / 0.29 / -23.6%
fineweb_q03/datafusion:vortex-file-compressed	22325844 / 22195181 / +0.6%	108707093 / 110590308 / -1.7%	0.21 / 0.20 / +2.3%
fineweb_q04/datafusion:vortex-file-compressed	82194556 / 81290140 / +1.1%	169677127 / 165415538 / +2.6%	0.48 / 0.49 / -1.4%
fineweb_q05/datafusion:vortex-file-compressed	69003126 / 69377657 / -0.5%	152796521 / 146519605 / +4.3%	0.45 / 0.47 / -4.6%
fineweb_q06/datafusion:vortex-file-compressed	20328911 / 20035251 / +1.5%	120611048 / 110678355 / +9.0%	0.17 / 0.18 / -6.9%
fineweb_q07/datafusion:vortex-file-compressed	20071142 / 19634784 / +2.2%	117220342 / 106891387 / +9.7%	0.17 / 0.18 / -6.8%
fineweb_q08/datafusion:vortex-file-compressed	10704808 / 9372819 / +14.2% 🔴	55570266 / 53954720 / +3.0%	0.19 / 0.17 / +10.9%

datafusion / vortex-compact / ns (0.907x ➖, 2↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	6898595 / 7093704 / -2.8%	20918014 / 20555501 / +1.8%	0.33 / 0.35 / -4.4%
fineweb_q01/datafusion:vortex-compact	45046814 / 77264118 / -41.7% 🟢	82017961 / 110749692 / -25.9% 🟢	0.55 / 0.70 / -21.3%
fineweb_q02/datafusion:vortex-compact	43533123 / 44128985 / -1.4%	85545529 / 79284195 / +7.9%	0.51 / 0.56 / -8.6%
fineweb_q03/datafusion:vortex-compact	157543058 / 158381251 / -0.5%	230816032 / 222838812 / +3.6%	0.68 / 0.71 / -4.0%
fineweb_q04/datafusion:vortex-compact	176760670 / 178898274 / -1.2%	252424315 / 258862689 / -2.5%	0.70 / 0.69 / +1.3%
fineweb_q05/datafusion:vortex-compact	154497030 / 171170607 / -9.7%	244779314 / 231039757 / +5.9%	0.63 / 0.74 / -14.8%
fineweb_q06/datafusion:vortex-compact	86908930 / 87199181 / -0.3%	165160237 / 164733390 / +0.3%	0.53 / 0.53 / -0.6%
fineweb_q07/datafusion:vortex-compact	88505942 / 88478991 / +0.0%	164784985 / 159138266 / +3.5%	0.54 / 0.56 / -3.4%
fineweb_q08/datafusion:vortex-compact	9128590 / 10827006 / -15.7% 🟢	54360195 / 36074151 / +50.7% 🔴	0.17 / 0.30 / -44.0%

datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	9689012 / 9223406 / +5.0%	32847265 / 34071675 / -3.6%	0.29 / 0.27 / +9.0%
fineweb_q01/datafusion:parquet	76453834 / 74363798 / +2.8%	158477474 / 159401685 / -0.6%	0.48 / 0.47 / +3.4%
fineweb_q02/datafusion:parquet	75002594 / 75118028 / -0.2%	155553074 / 161340070 / -3.6%	0.48 / 0.47 / +3.6%
fineweb_q03/datafusion:parquet	73784062 / 74313364 / -0.7%	160068479 / 159492717 / +0.4%	0.46 / 0.47 / -1.1%
fineweb_q04/datafusion:parquet	82490740 / 82429846 / +0.1%	160985851 / 155661639 / +3.4%	0.51 / 0.53 / -3.2%
fineweb_q05/datafusion:parquet	80830790 / 80611062 / +0.3%	156291026 / 163222060 / -4.2%	0.52 / 0.49 / +4.7%
fineweb_q06/datafusion:parquet	75567375 / 76224448 / -0.9%	166637814 / 165832200 / +0.5%	0.45 / 0.46 / -1.3%
fineweb_q07/datafusion:parquet	73900932 / 74636434 / -1.0%	155475242 / 158978083 / -2.2%	0.48 / 0.47 / +1.2%
fineweb_q08/datafusion:parquet	72271424 / 72429759 / -0.2%	158475227 / 181012910 / -12.5% 🟢	0.46 / 0.40 / +14.0%

duckdb / vortex-file-compressed / ns (1.035x ➖, 2↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	3545826 / 3104230 / +14.2% 🔴	5076548 / 6173142 / -17.8% 🟢	0.70 / 0.50 / +38.9%
fineweb_q01/duckdb:vortex-file-compressed	22937993 / 22692156 / +1.1%	62837276 / 59706379 / +5.2%	0.37 / 0.38 / -4.0%
fineweb_q02/duckdb:vortex-file-compressed	19474670 / 20243214 / -3.8%	54297026 / 49188247 / +10.4% 🔴	0.36 / 0.41 / -12.8%
fineweb_q03/duckdb:vortex-file-compressed	26889208 / 30436908 / -11.7% 🟢	106142417 / 106910445 / -0.7%	0.25 / 0.28 / -11.0%
fineweb_q04/duckdb:vortex-file-compressed	82067548 / 78621026 / +4.4%	128412346 / 119706880 / +7.3%	0.64 / 0.66 / -2.7%
fineweb_q05/duckdb:vortex-file-compressed	70752280 / 73892700 / -4.2%	130291266 / 157884532 / -17.5% 🟢	0.54 / 0.47 / +16.0%
fineweb_q06/duckdb:vortex-file-compressed	44297987 / 34448418 / +28.6% 🔴	150370994 / 116271117 / +29.3% 🔴	0.29 / 0.30 / -0.6%
fineweb_q07/duckdb:vortex-file-compressed	27851740 / 20249952 / +37.5% 🔴	104555233 / 93735133 / +11.5% 🔴	0.27 / 0.22 / +23.3%
fineweb_q08/duckdb:vortex-file-compressed	6636158 / 8458548 / -21.5% 🟢	14380448 / 14738984 / -2.4%	0.46 / 0.57 / -19.6%

duckdb / vortex-compact / ns (1.060x ➖, 1↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	5158225 / 3588305 / +43.8% 🔴	8678397 / 7425165 / +16.9% 🔴	0.59 / 0.48 / +23.0%
fineweb_q01/duckdb:vortex-compact	56533994 / 45185246 / +25.1% 🔴	99108753 / 67192411 / +47.5% 🔴	0.57 / 0.67 / -15.2%
fineweb_q02/duckdb:vortex-compact	46020926 / 46475571 / -1.0%	74203874 / 68881241 / +7.7%	0.62 / 0.67 / -8.1%
fineweb_q03/duckdb:vortex-compact	186110778 / 180514715 / +3.1%	292156813 / 255537970 / +14.3% 🔴	0.64 / 0.71 / -9.8%
fineweb_q04/duckdb:vortex-compact	193803422 / 186226270 / +4.1%	228778950 / 220037404 / +4.0%	0.85 / 0.85 / +0.1%
fineweb_q05/duckdb:vortex-compact	182024702 / 184295650 / -1.2%	223750932 / 226232214 / -1.1%	0.81 / 0.81 / -0.1%
fineweb_q06/duckdb:vortex-compact	107480148 / 110361040 / -2.6%	193955154 / 242541964 / -20.0% 🟢	0.55 / 0.46 / +21.8%
fineweb_q07/duckdb:vortex-compact	116250766 / 102309532 / +13.6% 🔴	179035355 / 184001253 / -2.7%	0.65 / 0.56 / +16.8%
fineweb_q08/duckdb:vortex-compact	5896921 / 7310556 / -19.3% 🟢	12743702 / 11819461 / +7.8%	0.46 / 0.62 / -25.2%

duckdb / parquet / ns (1.007x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	23009060 / 23458958 / -1.9%	22999284 / 24676544 / -6.8%	1.00 / 0.95 / +5.2%
fineweb_q01/duckdb:parquet	44646481 / 44660136 / -0.0%	57011089 / 54786606 / +4.1%	0.78 / 0.82 / -3.9%
fineweb_q02/duckdb:parquet	44838700 / 43825046 / +2.3%	55645857 / 53570475 / +3.9%	0.81 / 0.82 / -1.5%
fineweb_q03/duckdb:parquet	94881545 / 94352892 / +0.6%	185725167 / 183258686 / +1.3%	0.51 / 0.51 / -0.8%
fineweb_q04/duckdb:parquet	151675877 / 159862688 / -5.1%	215037542 / 200666990 / +7.2%	0.71 / 0.80 / -11.5%
fineweb_q05/duckdb:parquet	143074385 / 142138525 / +0.7%	199596657 / 195904887 / +1.9%	0.72 / 0.73 / -1.2%
fineweb_q06/duckdb:parquet	70899276 / 70794738 / +0.1%	134763818 / 130627778 / +3.2%	0.53 / 0.54 / -2.9%
fineweb_q07/duckdb:parquet	71740664 / 71959097 / -0.3%	154806612 / 158696228 / -2.5%	0.46 / 0.45 / +2.2%
fineweb_q08/duckdb:parquet	24823322 / 22348172 / +11.1% 🔴	25168422 / 26691523 / -5.7%	0.99 / 0.84 / +17.8%

No file size changes detected.

github-actions · 2026-10-09T15:17:41Z

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.018x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	16119021 / 16788518 / -4.0%	48228995 / 46141548 / +4.5%	0.33 / 0.36 / -8.1%
tpch_q02/datafusion:vortex-file-compressed	17402408 / 17332089 / +0.4%	40687913 / 36794676 / +10.6% 🔴	0.43 / 0.47 / -9.2%
tpch_q03/datafusion:vortex-file-compressed	19458718 / 19706862 / -1.3%	54488232 / 50146688 / +8.7%	0.36 / 0.39 / -9.1%
tpch_q04/datafusion:vortex-file-compressed	10035674 / 10021239 / +0.1%	36547664 / 33044741 / +10.6% 🔴	0.27 / 0.30 / -9.5%
tpch_q05/datafusion:vortex-file-compressed	37237529 / 37275565 / -0.1%	70828485 / 64307388 / +10.1% 🔴	0.53 / 0.58 / -9.3%
tpch_q06/datafusion:vortex-file-compressed	6364699 / 6249028 / +1.9%	34800289 / 29576160 / +17.7% 🔴	0.18 / 0.21 / -13.4%
tpch_q07/datafusion:vortex-file-compressed	51116987 / 51963406 / -1.6%	87217042 / 80919103 / +7.8%	0.59 / 0.64 / -8.7%
tpch_q08/datafusion:vortex-file-compressed	51359025 / 52036963 / -1.3%	84908737 / 82964081 / +2.3%	0.60 / 0.63 / -3.6%
tpch_q09/datafusion:vortex-file-compressed	49593998 / 49477665 / +0.2%	78355592 / 75749769 / +3.4%	0.63 / 0.65 / -3.1%
tpch_q10/datafusion:vortex-file-compressed	16913545 / 17086651 / -1.0%	53120212 / 49988077 / +6.3%	0.32 / 0.34 / -6.8%
tpch_q11/datafusion:vortex-file-compressed	15124848 / 15154458 / -0.2%	35544547 / 34406089 / +3.3%	0.43 / 0.44 / -3.4%
tpch_q12/datafusion:vortex-file-compressed	23127336 / 22959228 / +0.7%	48184480 / 48060253 / +0.3%	0.48 / 0.48 / +0.5%
tpch_q13/datafusion:vortex-file-compressed	20197988 / 20057618 / +0.7%	43430874 / 42487213 / +2.2%	0.47 / 0.47 / -1.5%
tpch_q14/datafusion:vortex-file-compressed	15032003 / 14802747 / +1.5%	44676618 / 40922167 / +9.2%	0.34 / 0.36 / -7.0%
tpch_q15/datafusion:vortex-file-compressed	18276221 / 18482546 / -1.1%	47593324 / 45743679 / +4.0%	0.38 / 0.40 / -5.0%
tpch_q16/datafusion:vortex-file-compressed	18577165 / 18590795 / -0.1%	38139579 / 39796203 / -4.2%	0.49 / 0.47 / +4.3%
tpch_q17/datafusion:vortex-file-compressed	28153692 / 27868960 / +1.0%	58194159 / 58777993 / -1.0%	0.48 / 0.47 / +2.0%
tpch_q18/datafusion:vortex-file-compressed	36687107 / 36507260 / +0.5%	57717694 / 55390113 / +4.2%	0.64 / 0.66 / -3.6%
tpch_q19/datafusion:vortex-file-compressed	13202289 / 13167299 / +0.3%	41253807 / 38964021 / +5.9%	0.32 / 0.34 / -5.3%
tpch_q20/datafusion:vortex-file-compressed	20506307 / 21159274 / -3.1%	46728187 / 45094039 / +3.6%	0.44 / 0.47 / -6.5%
tpch_q21/datafusion:vortex-file-compressed	38779908 / 39615724 / -2.1%	68169384 / 67081969 / +1.6%	0.57 / 0.59 / -3.7%
tpch_q22/datafusion:vortex-file-compressed	11237169 / 11491114 / -2.2%	32507822 / 32779653 / -0.8%	0.35 / 0.35 / -1.4%

datafusion / vortex-compact / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	17969787 / 18671667 / -3.8%	44513351 / 43936395 / +1.3%	0.40 / 0.42 / -5.0%
tpch_q02/datafusion:vortex-compact	19540597 / 19587515 / -0.2%	38716394 / 36849275 / +5.1%	0.50 / 0.53 / -5.1%
tpch_q03/datafusion:vortex-compact	20187815 / 19975878 / +1.1%	47568191 / 46742936 / +1.8%	0.42 / 0.43 / -0.7%
tpch_q04/datafusion:vortex-compact	11008904 / 10977648 / +0.3%	32053792 / 33505690 / -4.3%	0.34 / 0.33 / +4.8%
tpch_q05/datafusion:vortex-compact	37829481 / 38045363 / -0.6%	67187711 / 65030489 / +3.3%	0.56 / 0.59 / -3.8%
tpch_q06/datafusion:vortex-compact	6850569 / 7051416 / -2.8%	31299754 / 28754172 / +8.9%	0.22 / 0.25 / -10.7%
tpch_q07/datafusion:vortex-compact	52710727 / 52607895 / +0.2%	79438393 / 81063881 / -2.0%	0.66 / 0.65 / +2.2%
tpch_q08/datafusion:vortex-compact	52857147 / 53496111 / -1.2%	85012205 / 82751188 / +2.7%	0.62 / 0.65 / -3.8%
tpch_q09/datafusion:vortex-compact	50801239 / 50531434 / +0.5%	78408365 / 78065768 / +0.4%	0.65 / 0.65 / +0.1%
tpch_q10/datafusion:vortex-compact	18626944 / 19406189 / -4.0%	50081047 / 50143115 / -0.1%	0.37 / 0.39 / -3.9%
tpch_q11/datafusion:vortex-compact	16118263 / 16127156 / -0.1%	36944973 / 35226403 / +4.9%	0.44 / 0.46 / -4.7%
tpch_q12/datafusion:vortex-compact	24093146 / 24590975 / -2.0%	48235406 / 45998329 / +4.9%	0.50 / 0.53 / -6.6%
tpch_q13/datafusion:vortex-compact	20720999 / 20546535 / +0.8%	39577502 / 40624267 / -2.6%	0.52 / 0.51 / +3.5%
tpch_q14/datafusion:vortex-compact	16437289 / 16123838 / +1.9%	41636518 / 40036346 / +4.0%	0.39 / 0.40 / -2.0%
tpch_q15/datafusion:vortex-compact	19584192 / 19891331 / -1.5%	46860981 / 46485615 / +0.8%	0.42 / 0.43 / -2.3%
tpch_q16/datafusion:vortex-compact	19374737 / 18476537 / +4.9%	38925894 / 38899055 / +0.1%	0.50 / 0.47 / +4.8%
tpch_q17/datafusion:vortex-compact	28701381 / 29253784 / -1.9%	56821444 / 57378579 / -1.0%	0.51 / 0.51 / -0.9%
tpch_q18/datafusion:vortex-compact	37438100 / 37842786 / -1.1%	59218472 / 57076933 / +3.8%	0.63 / 0.66 / -4.6%
tpch_q19/datafusion:vortex-compact	16239268 / 16546184 / -1.9%	42218436 / 41386647 / +2.0%	0.38 / 0.40 / -3.8%
tpch_q20/datafusion:vortex-compact	21626928 / 21820704 / -0.9%	45427767 / 46385900 / -2.1%	0.48 / 0.47 / +1.2%
tpch_q21/datafusion:vortex-compact	41787627 / 41936769 / -0.4%	70416406 / 68261504 / +3.2%	0.59 / 0.61 / -3.4%
tpch_q22/datafusion:vortex-compact	11963400 / 11829177 / +1.1%	31394309 / 30970931 / +1.4%	0.38 / 0.38 / -0.2%

datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	72181420 / 72294957 / -0.2%	96175844 / 91344595 / +5.3%	0.75 / 0.79 / -5.2%
tpch_q02/datafusion:parquet	57612557 / 57562951 / +0.1%	79201564 / 77254655 / +2.5%	0.73 / 0.75 / -2.4%
tpch_q03/datafusion:parquet	83996785 / 83749488 / +0.3%	110541593 / 110891278 / -0.3%	0.76 / 0.76 / +0.6%
tpch_q04/datafusion:parquet	46710905 / 47129601 / -0.9%	72106876 / 67444594 / +6.9%	0.65 / 0.70 / -7.3%
tpch_q05/datafusion:parquet	99464333 / 99591003 / -0.1%	131907070 / 131072630 / +0.6%	0.75 / 0.76 / -0.8%
tpch_q06/datafusion:parquet	31687823 / 32170800 / -1.5%	54912051 / 54767643 / +0.3%	0.58 / 0.59 / -1.8%
tpch_q07/datafusion:parquet	105987507 / 104639385 / +1.3%	137741310 / 136591105 / +0.8%	0.77 / 0.77 / +0.4%
tpch_q08/datafusion:parquet	112711092 / 112278601 / +0.4%	147527178 / 142283699 / +3.7%	0.76 / 0.79 / -3.2%
tpch_q09/datafusion:parquet	130482643 / 130666220 / -0.1%	166501282 / 163983250 / +1.5%	0.78 / 0.80 / -1.7%
tpch_q10/datafusion:parquet	103715732 / 104422264 / -0.7%	138578602 / 135725795 / +2.1%	0.75 / 0.77 / -2.7%
tpch_q11/datafusion:parquet	41765525 / 42770715 / -2.4%	67582407 / 68346474 / -1.1%	0.62 / 0.63 / -1.2%
tpch_q12/datafusion:parquet	68993603 / 68456665 / +0.8%	95771019 / 96625221 / -0.9%	0.72 / 0.71 / +1.7%
tpch_q13/datafusion:parquet	187399278 / 186656386 / +0.4%	213330612 / 211148969 / +1.0%	0.88 / 0.88 / -0.6%
tpch_q14/datafusion:parquet	48414807 / 47682619 / +1.5%	78945338 / 78917339 / +0.0%	0.61 / 0.60 / +1.5%
tpch_q15/datafusion:parquet	54086376 / 55090099 / -1.8%	79144430 / 80618799 / -1.8%	0.68 / 0.68 / +0.0%
tpch_q16/datafusion:parquet	41553371 / 41352178 / +0.5%	62926498 / 60929774 / +3.3%	0.66 / 0.68 / -2.7%
tpch_q17/datafusion:parquet	129503010 / 128573342 / +0.7%	158901427 / 154536654 / +2.8%	0.81 / 0.83 / -2.0%
tpch_q18/datafusion:parquet	130352513 / 130307422 / +0.0%	155420770 / 153772301 / +1.1%	0.84 / 0.85 / -1.0%
tpch_q19/datafusion:parquet	59478442 / 59169149 / +0.5%	93830412 / 87955333 / +6.7%	0.63 / 0.67 / -5.8%
tpch_q20/datafusion:parquet	68298950 / 68235654 / +0.1%	98230550 / 93365800 / +5.2%	0.70 / 0.73 / -4.9%
tpch_q21/datafusion:parquet	107554427 / 108809108 / -1.2%	135750032 / 132697867 / +2.3%	0.79 / 0.82 / -3.4%
tpch_q22/datafusion:parquet	46735169 / 47847048 / -2.3%	71438924 / 65490981 / +9.1%	0.65 / 0.73 / -10.5%

duckdb / vortex-file-compressed / ns (1.018x ➖, 1↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	11969570 / 10880141 / +10.0% 🔴	24498415 / 24551945 / -0.2%	0.49 / 0.44 / +10.3%
tpch_q02/duckdb:vortex-file-compressed	17435251 / 17348457 / +0.5%	27391668 / 27156316 / +0.9%	0.64 / 0.64 / -0.4%
tpch_q03/duckdb:vortex-file-compressed	17946084 / 17767408 / +1.0%	33252796 / 32262068 / +3.1%	0.54 / 0.55 / -2.0%
tpch_q04/duckdb:vortex-file-compressed	17339784 / 17329979 / +0.1%	29808466 / 32111353 / -7.2%	0.58 / 0.54 / +7.8%
tpch_q05/duckdb:vortex-file-compressed	21515022 / 22524529 / -4.5%	37007690 / 39396888 / -6.1%	0.58 / 0.57 / +1.7%
tpch_q06/duckdb:vortex-file-compressed	7853575 / 5110165 / +53.7% 🔴	14637828 / 15989880 / -8.5%	0.54 / 0.32 / +67.9%
tpch_q07/duckdb:vortex-file-compressed	20314629 / 20310825 / +0.0%	35586599 / 41673407 / -14.6% 🟢	0.57 / 0.49 / +17.1%
tpch_q08/duckdb:vortex-file-compressed	24495013 / 23336642 / +5.0%	40346966 / 39022125 / +3.4%	0.61 / 0.60 / +1.5%
tpch_q09/duckdb:vortex-file-compressed	30135969 / 29205759 / +3.2%	50425209 / 49743592 / +1.4%	0.60 / 0.59 / +1.8%
tpch_q10/duckdb:vortex-file-compressed	27464377 / 27696033 / -0.8%	45572905 / 44618790 / +2.1%	0.60 / 0.62 / -2.9%
tpch_q11/duckdb:vortex-file-compressed	8884397 / 8778205 / +1.2%	14198330 / 14630139 / -3.0%	0.63 / 0.60 / +4.3%
tpch_q12/duckdb:vortex-file-compressed	15413826 / 15964949 / -3.5%	31130596 / 33452867 / -6.9%	0.50 / 0.48 / +3.8%
tpch_q13/duckdb:vortex-file-compressed	22254052 / 21495764 / +3.5%	41711120 / 38408999 / +8.6%	0.53 / 0.56 / -4.7%
tpch_q14/duckdb:vortex-file-compressed	12948954 / 13897748 / -6.8%	24276910 / 26431546 / -8.2%	0.53 / 0.53 / +1.4%
tpch_q15/duckdb:vortex-file-compressed	10973690 / 10140266 / +8.2%	21999546 / 17939058 / +22.6% 🔴	0.50 / 0.57 / -11.8%
tpch_q16/duckdb:vortex-file-compressed	18183681 / 18084827 / +0.5%	23108500 / 24054560 / -3.9%	0.79 / 0.75 / +4.7%
tpch_q17/duckdb:vortex-file-compressed	15168152 / 15007971 / +1.1%	33166742 / 31687049 / +4.7%	0.46 / 0.47 / -3.4%
tpch_q18/duckdb:vortex-file-compressed	24038707 / 24985564 / -3.8%	35689631 / 35160089 / +1.5%	0.67 / 0.71 / -5.2%
tpch_q19/duckdb:vortex-file-compressed	23262834 / 24093492 / -3.4%	37609813 / 35993828 / +4.5%	0.62 / 0.67 / -7.6%
tpch_q20/duckdb:vortex-file-compressed	17298537 / 16765172 / +3.2%	36285361 / 32716154 / +10.9% 🔴	0.48 / 0.51 / -7.0%
tpch_q21/duckdb:vortex-file-compressed	67002949 / 66532192 / +0.7%	83692507 / 84044657 / -0.4%	0.80 / 0.79 / +1.1%
tpch_q22/duckdb:vortex-file-compressed	12347843 / 14560139 / -15.2% 🟢	20193385 / 21293130 / -5.2%	0.61 / 0.68 / -10.6%

duckdb / vortex-compact / ns (0.996x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	14188629 / 14867381 / -4.6%	21590699 / 24268900 / -11.0% 🟢	0.66 / 0.61 / +7.3%
tpch_q02/duckdb:vortex-compact	19997458 / 19821660 / +0.9%	29230252 / 26738818 / +9.3%	0.68 / 0.74 / -7.7%
tpch_q03/duckdb:vortex-compact	18628851 / 19477963 / -4.4%	38495665 / 33661339 / +14.4% 🔴	0.48 / 0.58 / -16.4%
tpch_q04/duckdb:vortex-compact	18368416 / 18283816 / +0.5%	32372620 / 29846015 / +8.5%	0.57 / 0.61 / -7.4%
tpch_q05/duckdb:vortex-compact	22062673 / 22437816 / -1.7%	34820297 / 36077374 / -3.5%	0.63 / 0.62 / +1.9%
tpch_q06/duckdb:vortex-compact	6272657 / 6194278 / +1.3%	16900339 / 18452254 / -8.4%	0.37 / 0.34 / +10.6%
tpch_q07/duckdb:vortex-compact	21706710 / 21898589 / -0.9%	37708639 / 37326959 / +1.0%	0.58 / 0.59 / -1.9%
tpch_q08/duckdb:vortex-compact	25917076 / 26212190 / -1.1%	41472789 / 40983566 / +1.2%	0.62 / 0.64 / -2.3%
tpch_q09/duckdb:vortex-compact	29992157 / 30182492 / -0.6%	47930874 / 52318240 / -8.4%	0.63 / 0.58 / +8.5%
tpch_q10/duckdb:vortex-compact	29592896 / 29988695 / -1.3%	50653055 / 47152448 / +7.4%	0.58 / 0.64 / -8.1%
tpch_q11/duckdb:vortex-compact	9902556 / 10071813 / -1.7%	14953163 / 17075826 / -12.4% 🟢	0.66 / 0.59 / +12.3%
tpch_q12/duckdb:vortex-compact	17944888 / 18176052 / -1.3%	30021663 / 32176262 / -6.7%	0.60 / 0.56 / +5.8%
tpch_q13/duckdb:vortex-compact	21809213 / 22025124 / -1.0%	42356083 / 39033962 / +8.5%	0.51 / 0.56 / -8.7%
tpch_q14/duckdb:vortex-compact	14256647 / 14224985 / +0.2%	26732145 / 28093405 / -4.8%	0.53 / 0.51 / +5.3%
tpch_q15/duckdb:vortex-compact	11385492 / 10140330 / +12.3% 🔴	22113167 / 22090281 / +0.1%	0.51 / 0.46 / +12.2%
tpch_q16/duckdb:vortex-compact	20112330 / 19723092 / +2.0%	25444124 / 24203481 / +5.1%	0.79 / 0.81 / -3.0%
tpch_q17/duckdb:vortex-compact	16004940 / 15566897 / +2.8%	32609372 / 32345096 / +0.8%	0.49 / 0.48 / +2.0%
tpch_q18/duckdb:vortex-compact	25668425 / 26349962 / -2.6%	37401039 / 34601847 / +8.1%	0.69 / 0.76 / -9.9%
tpch_q19/duckdb:vortex-compact	24131965 / 23829407 / +1.3%	36111801 / 33204931 / +8.8%	0.67 / 0.72 / -6.9%
tpch_q20/duckdb:vortex-compact	18937239 / 19523968 / -3.0%	35781329 / 35923554 / -0.4%	0.53 / 0.54 / -2.6%
tpch_q21/duckdb:vortex-compact	67792018 / 70448594 / -3.8%	83735055 / 88220358 / -5.1%	0.81 / 0.80 / +1.4%
tpch_q22/duckdb:vortex-compact	12919319 / 13116292 / -1.5%	25244497 / 21116325 / +19.5% 🔴	0.51 / 0.62 / -17.6%

duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	63169705 / 63014014 / +0.2%	69815006 / 69133835 / +1.0%	0.90 / 0.91 / -0.7%
tpch_q02/duckdb:parquet	37731704 / 37417572 / +0.8%	45694778 / 47956195 / -4.7%	0.83 / 0.78 / +5.8%
tpch_q03/duckdb:parquet	67774270 / 67695177 / +0.1%	78138199 / 79069830 / -1.2%	0.87 / 0.86 / +1.3%
tpch_q04/duckdb:parquet	46500007 / 46553291 / -0.1%	55687786 / 55709191 / -0.0%	0.84 / 0.84 / -0.1%
tpch_q05/duckdb:parquet	65614015 / 65791511 / -0.3%	76714785 / 76164451 / +0.7%	0.86 / 0.86 / -1.0%
tpch_q06/duckdb:parquet	21943641 / 22067246 / -0.6%	27316654 / 28027693 / -2.5%	0.80 / 0.79 / +2.0%
tpch_q07/duckdb:parquet	65056641 / 65117598 / -0.1%	75145330 / 76234790 / -1.4%	0.87 / 0.85 / +1.4%
tpch_q08/duckdb:parquet	79975315 / 79863513 / +0.1%	91965575 / 92450856 / -0.5%	0.87 / 0.86 / +0.7%
tpch_q09/duckdb:parquet	119275458 / 119440069 / -0.1%	132171072 / 131714449 / +0.3%	0.90 / 0.91 / -0.5%
tpch_q10/duckdb:parquet	118973149 / 119118028 / -0.1%	131627967 / 131734543 / -0.1%	0.90 / 0.90 / -0.0%
tpch_q11/duckdb:parquet	21178460 / 21484263 / -1.4%	24898367 / 24817997 / +0.3%	0.85 / 0.87 / -1.7%
tpch_q12/duckdb:parquet	44218401 / 44309967 / -0.2%	51348092 / 51330631 / +0.0%	0.86 / 0.86 / -0.2%
tpch_q13/duckdb:parquet	242508161 / 242577575 / -0.0%	251975826 / 251190329 / +0.3%	0.96 / 0.97 / -0.3%
tpch_q14/duckdb:parquet	47072278 / 47297463 / -0.5%	55755803 / 56817060 / -1.9%	0.84 / 0.83 / +1.4%
tpch_q15/duckdb:parquet	26363640 / 26530064 / -0.6%	33207317 / 36731767 / -9.6%	0.79 / 0.72 / +9.9%
tpch_q16/duckdb:parquet	51143735 / 51771852 / -1.2%	57613088 / 61220417 / -5.9%	0.89 / 0.85 / +5.0%
tpch_q17/duckdb:parquet	48947876 / 48997031 / -0.1%	58022417 / 59367351 / -2.3%	0.84 / 0.83 / +2.2%
tpch_q18/duckdb:parquet	95066179 / 96779396 / -1.8%	103810262 / 106601282 / -2.6%	0.92 / 0.91 / +0.9%
tpch_q19/duckdb:parquet	64928840 / 65065347 / -0.2%	75192142 / 75090313 / +0.1%	0.86 / 0.87 / -0.3%
tpch_q20/duckdb:parquet	61629327 / 61449380 / +0.3%	73026797 / 74106438 / -1.5%	0.84 / 0.83 / +1.8%
tpch_q21/duckdb:parquet	141612130 / 143613712 / -1.4%	155660542 / 154160140 / +1.0%	0.91 / 0.93 / -2.3%
tpch_q22/duckdb:parquet	51351103 / 51649027 / -0.6%	59199463 / 59450789 / -0.4%	0.87 / 0.87 / -0.2%

duckdb / duckdb / ns (0.983x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb	9234144 / 9151278 / +0.9%	14911504 / 14963998 / -0.4%	0.62 / 0.61 / +1.3%
tpch_q02/duckdb:duckdb	10926839 / 11387253 / -4.0%	17895472 / 18182604 / -1.6%	0.61 / 0.63 / -2.5%
tpch_q03/duckdb:duckdb	14471278 / 14595449 / -0.9%	23788445 / 25874101 / -8.1%	0.61 / 0.56 / +7.8%
tpch_q04/duckdb:duckdb	13937937 / 14404195 / -3.2%	25278730 / 22048001 / +14.7% 🔴	0.55 / 0.65 / -15.6%
tpch_q05/duckdb:duckdb	15232996 / 15328554 / -0.6%	24394453 / 25238514 / -3.3%	0.62 / 0.61 / +2.8%
tpch_q06/duckdb:duckdb	3992402 / 4041482 / -1.2%	9005573 / 9409744 / -4.3%	0.44 / 0.43 / +3.2%
tpch_q07/duckdb:duckdb	17538530 / 17400289 / +0.8%	26232333 / 31512250 / -16.8% 🟢	0.67 / 0.55 / +21.1%
tpch_q08/duckdb:duckdb	17996279 / 17798447 / +1.1%	27380383 / 27989132 / -2.2%	0.66 / 0.64 / +3.4%
tpch_q09/duckdb:duckdb	37335174 / 37311004 / +0.1%	47506421 / 47931720 / -0.9%	0.79 / 0.78 / +1.0%
tpch_q10/duckdb:duckdb	32690094 / 33106307 / -1.3%	43983581 / 45331945 / -3.0%	0.74 / 0.73 / +1.8%
tpch_q11/duckdb:duckdb	5318305 / 5477385 / -2.9%	10950183 / 11126150 / -1.6%	0.49 / 0.49 / -1.3%
tpch_q12/duckdb:duckdb	10702601 / 10492570 / +2.0%	17749314 / 17167446 / +3.4%	0.60 / 0.61 / -1.3%
tpch_q13/duckdb:duckdb	33752586 / 34308781 / -1.6%	40746412 / 41191507 / -1.1%	0.83 / 0.83 / -0.5%
tpch_q14/duckdb:duckdb	14046445 / 14870401 / -5.5%	19622792 / 21655777 / -9.4%	0.72 / 0.69 / +4.2%
tpch_q15/duckdb:duckdb	8883553 / 10841283 / -18.1% 🟢	15892343 / 22161763 / -28.3% 🟢	0.56 / 0.49 / +14.3%
tpch_q16/duckdb:duckdb	19714709 / 19892263 / -0.9%	25337075 / 25158048 / +0.7%	0.78 / 0.79 / -1.6%
tpch_q17/duckdb:duckdb	11769236 / 12212580 / -3.6%	21454416 / 21400641 / +0.3%	0.55 / 0.57 / -3.9%
tpch_q18/duckdb:duckdb	20376354 / 21432424 / -4.9%	28556328 / 27162605 / +5.1%	0.71 / 0.79 / -9.6%
tpch_q19/duckdb:duckdb	17910345 / 17922422 / -0.1%	25629975 / 25716287 / -0.3%	0.70 / 0.70 / +0.3%
tpch_q20/duckdb:duckdb	17998384 / 16320172 / +10.3% 🔴	28869484 / 27363752 / +5.5%	0.62 / 0.60 / +4.5%
tpch_q21/duckdb:duckdb	40552483 / 41337707 / -1.9%	51028509 / 50864355 / +0.3%	0.79 / 0.81 / -2.2%
tpch_q22/duckdb:duckdb	23754364 / 23660517 / +0.4%	30308323 / 30417754 / -0.4%	0.78 / 0.78 / +0.8%

No file size changes detected.

github-actions · 2026-10-09T15:19:23Z

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (+0.7%, environment too noisy confidence)
Vortex (geomean): hot 0.983x ➖ · cold 0.940x ➖
Parquet (geomean): hot 0.987x ➖ · cold 0.953x ➖
Shifts: Parquet (control) -1.3% · Median polish -1.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.990x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed	176100314 / 186581582 / -5.6%	667586166 / 719061723 / -7.2%	0.26 / 0.26 / +1.7%
clickbench-sorted_q24/datafusion:vortex-file-compressed	10793763 / 10829444 / -0.3%	49042934 / 57801591 / -15.2% 🟢	0.22 / 0.19 / +17.5%
clickbench-sorted_q26/datafusion:vortex-file-compressed	11671626 / 11022070 / +5.9%	48372858 / 51473616 / -6.0%	0.24 / 0.21 / +12.7%
clickbench-sorted_q36/datafusion:vortex-file-compressed	23006146 / 23382451 / -1.6%	63979220 / 70023558 / -8.6%	0.36 / 0.33 / +7.7%
clickbench-sorted_q37/datafusion:vortex-file-compressed	18139569 / 18922746 / -4.1%	56531970 / 62193886 / -9.1%	0.32 / 0.30 / +5.5%
clickbench-sorted_q38/datafusion:vortex-file-compressed	18052276 / 17884995 / +0.9%	55617458 / 63221104 / -12.0% 🟢	0.32 / 0.28 / +14.7%
clickbench-sorted_q39/datafusion:vortex-file-compressed	39696356 / 40725096 / -2.5%	92826740 / 94836690 / -2.1%	0.43 / 0.43 / -0.4%
clickbench-sorted_q40/datafusion:vortex-file-compressed	11887585 / 12442623 / -4.5%	41750483 / 46932287 / -11.0% 🟢	0.28 / 0.27 / +7.4%
clickbench-sorted_q41/datafusion:vortex-file-compressed	11993963 / 12088256 / -0.8%	41325023 / 44641315 / -7.4%	0.29 / 0.27 / +7.2%
clickbench-sorted_q42/datafusion:vortex-file-compressed	10030308 / 9736336 / +3.0%	34491905 / 37036223 / -6.9%	0.29 / 0.26 / +10.6%

datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet	757469486 / 762031361 / -0.6%	986698597 / 966925215 / +2.0%	0.77 / 0.79 / -2.6%
clickbench-sorted_q24/datafusion:parquet	9237690 / 9123430 / +1.3%	72632581 / 70823929 / +2.6%	0.13 / 0.13 / -1.3%
clickbench-sorted_q26/datafusion:parquet	9322720 / 9673927 / -3.6%	72494685 / 71825358 / +0.9%	0.13 / 0.13 / -4.5%
clickbench-sorted_q36/datafusion:parquet	93607214 / 94296664 / -0.7%	169920033 / 173618214 / -2.1%	0.55 / 0.54 / +1.4%
clickbench-sorted_q37/datafusion:parquet	64152768 / 64307056 / -0.2%	131744311 / 132952090 / -0.9%	0.49 / 0.48 / +0.7%
clickbench-sorted_q38/datafusion:parquet	87499012 / 87927298 / -0.5%	162049065 / 164725955 / -1.6%	0.54 / 0.53 / +1.2%
clickbench-sorted_q39/datafusion:parquet	159491402 / 160025709 / -0.3%	236183246 / 239598245 / -1.4%	0.68 / 0.67 / +1.1%
clickbench-sorted_q40/datafusion:parquet	44339014 / 44481176 / -0.3%	109150321 / 116808686 / -6.6%	0.41 / 0.38 / +6.7%
clickbench-sorted_q41/datafusion:parquet	42231800 / 41876838 / +0.8%	108764679 / 112564542 / -3.4%	0.39 / 0.37 / +4.4%
clickbench-sorted_q42/datafusion:parquet	26547922 / 26150988 / +1.5%	87223516 / 88107372 / -1.0%	0.30 / 0.30 / +2.5%

duckdb / vortex-file-compressed / ns (0.976x ➖, 2↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed	54358172 / 56192323 / -3.3%	79991573 / 78529078 / +1.9%	0.68 / 0.72 / -5.0%
clickbench-sorted_q24/duckdb:vortex-file-compressed	21197265 / 22585704 / -6.1%	35075147 / 32788971 / +7.0%	0.60 / 0.69 / -12.3%
clickbench-sorted_q26/duckdb:vortex-file-compressed	16865841 / 13391836 / +25.9% 🔴	26267588 / 31512713 / -16.6% 🟢	0.64 / 0.42 / +51.1%
clickbench-sorted_q36/duckdb:vortex-file-compressed	29875134 / 28154796 / +6.1%	61422430 / 62745648 / -2.1%	0.49 / 0.45 / +8.4%
clickbench-sorted_q37/duckdb:vortex-file-compressed	23029091 / 28583309 / -19.4% 🟢	51776744 / 55904288 / -7.4%	0.44 / 0.51 / -13.0%
clickbench-sorted_q38/duckdb:vortex-file-compressed	26301854 / 25638046 / +2.6%	59231981 / 60342513 / -1.8%	0.44 / 0.42 / +4.5%
clickbench-sorted_q39/duckdb:vortex-file-compressed	47412065 / 48456596 / -2.2%	93670553 / 96849237 / -3.3%	0.51 / 0.50 / +1.2%
clickbench-sorted_q40/duckdb:vortex-file-compressed	15233626 / 16731334 / -9.0%	43854196 / 39527065 / +10.9% 🔴	0.35 / 0.42 / -17.9%
clickbench-sorted_q41/duckdb:vortex-file-compressed	15510218 / 15733107 / -1.4%	36173357 / 45119755 / -19.8% 🟢	0.43 / 0.35 / +23.0%
clickbench-sorted_q42/duckdb:vortex-file-compressed	12352076 / 13911741 / -11.2% 🟢	30818635 / 30235886 / +1.9%	0.40 / 0.46 / -12.9%

duckdb / parquet / ns (0.978x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet	128973981 / 127235182 / +1.4%	140355788 / 152413782 / -7.9%	0.92 / 0.83 / +10.1%
clickbench-sorted_q24/duckdb:parquet	17508154 / 19287840 / -9.2%	32032224 / 32798154 / -2.3%	0.55 / 0.59 / -7.1%
clickbench-sorted_q26/duckdb:parquet	14008182 / 13212778 / +6.0%	22028126 / 24707616 / -10.8% 🟢	0.64 / 0.53 / +18.9%
clickbench-sorted_q36/duckdb:parquet	44772080 / 48580037 / -7.8%	62098466 / 68461014 / -9.3%	0.72 / 0.71 / +1.6%
clickbench-sorted_q37/duckdb:parquet	31230282 / 31778490 / -1.7%	44123610 / 50047421 / -11.8% 🟢	0.71 / 0.63 / +11.5%
clickbench-sorted_q38/duckdb:parquet	41096576 / 40642859 / +1.1%	63784430 / 62405639 / +2.2%	0.64 / 0.65 / -1.1%
clickbench-sorted_q39/duckdb:parquet	77300592 / 74312548 / +4.0%	90715566 / 96357211 / -5.9%	0.85 / 0.77 / +10.5%
clickbench-sorted_q40/duckdb:parquet	17148949 / 17879977 / -4.1%	35898924 / 44019813 / -18.4% 🟢	0.48 / 0.41 / +17.6%
clickbench-sorted_q41/duckdb:parquet	16506364 / 17579298 / -6.1%	42439570 / 47908154 / -11.4% 🟢	0.39 / 0.37 / +6.0%
clickbench-sorted_q42/duckdb:parquet	11092648 / 11626396 / -4.6%	23000433 / 23717471 / -3.0%	0.48 / 0.49 / -1.6%

duckdb / duckdb / ns (0.993x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:duckdb	212682122 / 206769140 / +2.9%	313670926 / 295193786 / +6.3%	0.68 / 0.70 / -3.2%
clickbench-sorted_q24/duckdb:duckdb	37247510 / 37036252 / +0.6%	41290138 / 44141188 / -6.5%	0.90 / 0.84 / +7.5%
clickbench-sorted_q26/duckdb:duckdb	33818393 / 35018505 / -3.4%	37329114 / 38288373 / -2.5%	0.91 / 0.91 / -0.9%
clickbench-sorted_q36/duckdb:duckdb	55359425 / 58769190 / -5.8%	84190420 / 86608395 / -2.8%	0.66 / 0.68 / -3.1%
clickbench-sorted_q37/duckdb:duckdb	56719689 / 56676588 / +0.1%	86341226 / 96627516 / -10.6% 🟢	0.66 / 0.59 / +12.0%
clickbench-sorted_q38/duckdb:duckdb	48165744 / 48880052 / -1.5%	78095493 / 80005310 / -2.4%	0.62 / 0.61 / +0.9%
clickbench-sorted_q39/duckdb:duckdb	88736944 / 87362140 / +1.6%	135558452 / 137293363 / -1.3%	0.65 / 0.64 / +2.9%
clickbench-sorted_q40/duckdb:duckdb	32481070 / 32948905 / -1.4%	49887243 / 57166470 / -12.7% 🟢	0.65 / 0.58 / +13.0%
clickbench-sorted_q41/duckdb:duckdb	30803116 / 29596003 / +4.1%	44910994 / 46512487 / -3.4%	0.69 / 0.64 / +7.8%
clickbench-sorted_q42/duckdb:duckdb	22263862 / 23066472 / -3.5%	30398476 / 32641167 / -6.9%	0.73 / 0.71 / +3.6%

File Size Changes (201 files changed, -0.0% overall, 92↑ 109↓)

File	Scale	Format	Base	HEAD	Change	%
hits_001.vortex	1.0	vortex-file-compressed	188.85 MB	195.38 MB	+6.52 MB	+3.5%
hits_087.vortex	1.0	vortex-file-compressed	159.83 MB	161.67 MB	+1.84 MB	+1.1%
hits_087.vortex	1.0	vortex-compact	123.89 MB	125.32 MB	+1.42 MB	+1.1%
hits_001.vortex	1.0	vortex-compact	137.66 MB	139.15 MB	+1.48 MB	+1.1%
hits_015.vortex	1.0	vortex-compact	97.34 MB	98.36 MB	+1.02 MB	+1.0%
hits_004.vortex	1.0	vortex-compact	97.31 MB	98.07 MB	+776.45 KB	+0.8%
hits_063.vortex	1.0	vortex-compact	98.46 MB	99.19 MB	+754.19 KB	+0.7%
hits_066.vortex	1.0	vortex-compact	116.73 MB	117.42 MB	+707.21 KB	+0.6%
hits_053.vortex	1.0	vortex-compact	137.44 MB	138.23 MB	+803.60 KB	+0.6%
hits_080.vortex	1.0	vortex-compact	96.00 MB	96.53 MB	+543.50 KB	+0.6%
hits_010.vortex	1.0	vortex-compact	123.09 MB	123.71 MB	+637.02 KB	+0.5%
hits_018.vortex	1.0	vortex-file-compressed	200.10 MB	201.04 MB	+963.92 KB	+0.5%
hits_070.vortex	1.0	vortex-file-compressed	199.98 MB	200.89 MB	+927.60 KB	+0.5%
hits_099.vortex	1.0	vortex-file-compressed	171.86 MB	172.53 MB	+686.92 KB	+0.4%
hits_078.vortex	1.0	vortex-compact	97.20 MB	97.48 MB	+287.59 KB	+0.3%
hits_068.vortex	1.0	vortex-compact	111.91 MB	112.23 MB	+325.45 KB	+0.3%
hits_040.vortex	1.0	vortex-compact	109.94 MB	110.24 MB	+308.23 KB	+0.3%
hits_062.vortex	1.0	vortex-file-compressed	171.24 MB	171.65 MB	+423.04 KB	+0.2%
hits_012.vortex	1.0	vortex-file-compressed	190.43 MB	190.80 MB	+386.38 KB	+0.2%
hits_073.vortex	1.0	vortex-compact	134.16 MB	134.42 MB	+266.58 KB	+0.2%
hits_050.vortex	1.0	vortex-compact	124.97 MB	125.21 MB	+240.66 KB	+0.2%
hits_000.vortex	1.0	vortex-compact	97.69 MB	97.87 MB	+187.66 KB	+0.2%
hits_076.vortex	1.0	vortex-compact	125.09 MB	125.32 MB	+238.34 KB	+0.2%
hits_072.vortex	1.0	vortex-file-compressed	101.82 MB	102.01 MB	+193.91 KB	+0.2%
hits_071.vortex	1.0	vortex-file-compressed	139.81 MB	140.06 MB	+253.43 KB	+0.2%
hits_027.vortex	1.0	vortex-file-compressed	189.53 MB	189.84 MB	+316.24 KB	+0.2%
hits_059.vortex	1.0	vortex-compact	152.73 MB	152.95 MB	+231.18 KB	+0.1%
hits_076.vortex	1.0	vortex-file-compressed	161.50 MB	161.73 MB	+239.75 KB	+0.1%
hits_017.vortex	1.0	vortex-compact	111.70 MB	111.86 MB	+165.06 KB	+0.1%
hits_016.vortex	1.0	vortex-compact	127.33 MB	127.48 MB	+151.66 KB	+0.1%
hits_014.vortex	1.0	vortex-file-compressed	172.75 MB	172.94 MB	+198.88 KB	+0.1%
hits_011.vortex	1.0	vortex-compact	152.81 MB	152.97 MB	+168.68 KB	+0.1%
hits_059.vortex	1.0	vortex-file-compressed	200.16 MB	200.38 MB	+220.34 KB	+0.1%
hits_019.vortex	1.0	vortex-file-compressed	140.02 MB	140.15 MB	+141.94 KB	+0.1%
hits_042.vortex	1.0	vortex-compact	136.22 MB	136.36 MB	+137.63 KB	+0.1%
hits_057.vortex	1.0	vortex-compact	111.35 MB	111.46 MB	+111.20 KB	+0.1%
hits_067.vortex	1.0	vortex-file-compressed	130.85 MB	130.97 MB	+116.00 KB	+0.1%
hits_005.vortex	1.0	vortex-file-compressed	167.32 MB	167.46 MB	+146.03 KB	+0.1%
hits_042.vortex	1.0	vortex-file-compressed	202.03 MB	202.19 MB	+168.81 KB	+0.1%
hits_012.vortex	1.0	vortex-compact	138.70 MB	138.82 MB	+115.60 KB	+0.1%
hits_083.vortex	1.0	vortex-compact	110.04 MB	110.13 MB	+88.60 KB	+0.1%
hits_077.vortex	1.0	vortex-file-compressed	172.84 MB	172.98 MB	+138.48 KB	+0.1%
hits_064.vortex	1.0	vortex-file-compressed	190.44 MB	190.59 MB	+151.62 KB	+0.1%
hits_057.vortex	1.0	vortex-file-compressed	159.76 MB	159.87 MB	+115.91 KB	+0.1%
hits_074.vortex	1.0	vortex-compact	152.94 MB	153.05 MB	+109.76 KB	+0.1%
hits_045.vortex	1.0	vortex-file-compressed	139.78 MB	139.88 MB	+96.56 KB	+0.1%
hits_077.vortex	1.0	vortex-compact	133.98 MB	134.06 MB	+87.95 KB	+0.1%
hits_056.vortex	1.0	vortex-compact	100.71 MB	100.77 MB	+62.14 KB	+0.1%
hits_007.vortex	1.0	vortex-compact	153.41 MB	153.50 MB	+94.52 KB	+0.1%
hits_044.vortex	1.0	vortex-compact	153.62 MB	153.71 MB	+92.95 KB	+0.1%
hits_088.vortex	1.0	vortex-file-compressed	172.61 MB	172.71 MB	+103.28 KB	+0.1%
hits_029.vortex	1.0	vortex-file-compressed	200.88 MB	201.00 MB	+120.15 KB	+0.1%
hits_007.vortex	1.0	vortex-file-compressed	201.11 MB	201.22 MB	+114.84 KB	+0.1%
hits_095.vortex	1.0	vortex-compact	110.61 MB	110.67 MB	+62.17 KB	+0.1%
hits_028.vortex	1.0	vortex-compact	115.17 MB	115.23 MB	+61.04 KB	+0.1%
hits_056.vortex	1.0	vortex-file-compressed	135.01 MB	135.08 MB	+71.38 KB	+0.1%
hits_026.vortex	1.0	vortex-file-compressed	130.38 MB	130.45 MB	+67.08 KB	+0.1%
hits_083.vortex	1.0	vortex-file-compressed	156.25 MB	156.32 MB	+80.36 KB	+0.1%
hits_053.vortex	1.0	vortex-file-compressed	189.49 MB	189.58 MB	+92.34 KB	+0.0%
hits_065.vortex	1.0	vortex-compact	125.60 MB	125.66 MB	+59.25 KB	+0.0%
hits_010.vortex	1.0	vortex-file-compressed	168.86 MB	168.94 MB	+76.59 KB	+0.0%
hits_045.vortex	1.0	vortex-compact	105.59 MB	105.63 MB	+44.62 KB	+0.0%
hits_047.vortex	1.0	vortex-file-compressed	153.77 MB	153.83 MB	+62.62 KB	+0.0%
hits_030.vortex	1.0	vortex-file-compressed	131.11 MB	131.15 MB	+50.69 KB	+0.0%
hits_071.vortex	1.0	vortex-compact	105.61 MB	105.64 MB	+37.40 KB	+0.0%
hits_022.vortex	1.0	vortex-compact	153.01 MB	153.06 MB	+46.48 KB	+0.0%
hits_098.vortex	1.0	vortex-file-compressed	137.62 MB	137.66 MB	+41.58 KB	+0.0%
hits_046.vortex	1.0	vortex-compact	74.94 MB	74.96 MB	+21.93 KB	+0.0%
hits_086.vortex	1.0	vortex-file-compressed	191.77 MB	191.82 MB	+51.55 KB	+0.0%
hits_036.vortex	1.0	vortex-file-compressed	171.95 MB	171.99 MB	+41.62 KB	+0.0%
hits_008.vortex	1.0	vortex-compact	105.65 MB	105.68 MB	+25.12 KB	+0.0%
hits_013.vortex	1.0	vortex-file-compressed	161.90 MB	161.94 MB	+36.64 KB	+0.0%
hits_066.vortex	1.0	vortex-file-compressed	162.93 MB	162.96 MB	+35.73 KB	+0.0%
hits_054.vortex	1.0	vortex-compact	111.73 MB	111.75 MB	+23.54 KB	+0.0%
hits_093.vortex	1.0	vortex-file-compressed	130.87 MB	130.89 MB	+27.51 KB	+0.0%
hits_037.vortex	1.0	vortex-file-compressed	178.12 MB	178.15 MB	+35.01 KB	+0.0%
hits_027.vortex	1.0	vortex-compact	138.05 MB	138.08 MB	+26.30 KB	+0.0%
hits_060.vortex	1.0	vortex-file-compressed	192.83 MB	192.87 MB	+36.62 KB	+0.0%
hits_006.vortex	1.0	vortex-file-compressed	126.59 MB	126.62 MB	+23.02 KB	+0.0%
hits_016.vortex	1.0	vortex-file-compressed	179.77 MB	179.80 MB	+30.84 KB	+0.0%
hits_095.vortex	1.0	vortex-file-compressed	153.76 MB	153.78 MB	+24.38 KB	+0.0%
hits_067.vortex	1.0	vortex-compact	99.62 MB	99.63 MB	+15.55 KB	+0.0%
hits_090.vortex	1.0	vortex-compact	140.12 MB	140.13 MB	+19.19 KB	+0.0%
hits_021.vortex	1.0	vortex-compact	110.61 MB	110.62 MB	+14.30 KB	+0.0%
hits_063.vortex	1.0	vortex-file-compressed	130.84 MB	130.85 MB	+16.10 KB	+0.0%
hits_008.vortex	1.0	vortex-file-compressed	139.29 MB	139.30 MB	+12.16 KB	+0.0%
hits_051.vortex	1.0	vortex-compact	133.98 MB	133.99 MB	+11.18 KB	+0.0%
hits_009.vortex	1.0	vortex-compact	75.21 MB	75.21 MB	+5.74 KB	+0.0%
hits_091.vortex	1.0	vortex-file-compressed	147.36 MB	147.37 MB	+8.41 KB	+0.0%
hits_049.vortex	1.0	vortex-compact	139.28 MB	139.29 MB	+6.66 KB	+0.0%
hits_082.vortex	1.0	vortex-compact	105.65 MB	105.65 MB	+2.69 KB	+0.0%
hits_025.vortex	1.0	vortex-file-compressed	172.32 MB	172.32 MB	+32 B	+0.0%
hits_050.vortex	1.0	vortex-file-compressed	161.66 MB	161.66 MB	1.53 KB	-0.0%
hits_097.vortex	1.0	vortex-compact	140.13 MB	140.13 MB	2.35 KB	-0.0%
hits_058.vortex	1.0	vortex-file-compressed	154.45 MB	154.45 MB	3.08 KB	-0.0%
hits_075.vortex	1.0	vortex-compact	137.83 MB	137.83 MB	3.87 KB	-0.0%
hits_032.vortex	1.0	vortex-compact	110.59 MB	110.59 MB	3.70 KB	-0.0%
hits_032.vortex	1.0	vortex-file-compressed	154.34 MB	154.34 MB	5.48 KB	-0.0%
hits_022.vortex	1.0	vortex-file-compressed	200.33 MB	200.33 MB	8.41 KB	-0.0%
hits_084.vortex	1.0	vortex-compact	110.66 MB	110.66 MB	4.86 KB	-0.0%
hits_047.vortex	1.0	vortex-compact	110.48 MB	110.47 MB	6.73 KB	-0.0%
hits_061.vortex	1.0	vortex-compact	123.42 MB	123.41 MB	8.13 KB	-0.0%
hits_000.vortex	1.0	vortex-file-compressed	130.72 MB	130.71 MB	8.70 KB	-0.0%
hits_006.vortex	1.0	vortex-compact	95.79 MB	95.79 MB	6.65 KB	-0.0%
hits_003.vortex	1.0	vortex-file-compressed	136.50 MB	136.49 MB	10.41 KB	-0.0%
hits_058.vortex	1.0	vortex-compact	111.06 MB	111.05 MB	10.31 KB	-0.0%
hits_031.vortex	1.0	vortex-file-compressed	159.35 MB	159.33 MB	15.86 KB	-0.0%
hits_092.vortex	1.0	vortex-file-compressed	200.74 MB	200.72 MB	22.30 KB	-0.0%
hits_064.vortex	1.0	vortex-compact	138.89 MB	138.88 MB	15.87 KB	-0.0%
hits_017.vortex	1.0	vortex-file-compressed	147.28 MB	147.26 MB	19.47 KB	-0.0%
hits_034.vortex	1.0	vortex-file-compressed	181.84 MB	181.81 MB	26.63 KB	-0.0%
hits_081.vortex	1.0	vortex-file-compressed	201.16 MB	201.13 MB	29.80 KB	-0.0%
hits_020.vortex	1.0	vortex-compact	111.66 MB	111.64 MB	22.27 KB	-0.0%
hits_072.vortex	1.0	vortex-compact	75.60 MB	75.59 MB	17.28 KB	-0.0%
hits_023.vortex	1.0	vortex-file-compressed	194.88 MB	194.83 MB	47.30 KB	-0.0%
hits_005.vortex	1.0	vortex-compact	115.84 MB	115.81 MB	29.43 KB	-0.0%
hits_096.vortex	1.0	vortex-compact	153.26 MB	153.22 MB	40.02 KB	-0.0%
hits_097.vortex	1.0	vortex-file-compressed	192.65 MB	192.60 MB	51.29 KB	-0.0%
hits_049.vortex	1.0	vortex-file-compressed	191.16 MB	191.11 MB	51.09 KB	-0.0%
hits_002.vortex	1.0	vortex-file-compressed	161.63 MB	161.59 MB	45.39 KB	-0.0%
hits_081.vortex	1.0	vortex-compact	153.57 MB	153.53 MB	43.65 KB	-0.0%
hits_046.vortex	1.0	vortex-file-compressed	100.76 MB	100.74 MB	28.72 KB	-0.0%
hits_054.vortex	1.0	vortex-file-compressed	147.36 MB	147.31 MB	42.36 KB	-0.0%
hits_040.vortex	1.0	vortex-file-compressed	144.00 MB	143.96 MB	41.99 KB	-0.0%
hits_069.vortex	1.0	vortex-compact	99.70 MB	99.67 MB	30.12 KB	-0.0%
hits_074.vortex	1.0	vortex-file-compressed	200.17 MB	200.10 MB	72.20 KB	-0.0%
hits_079.vortex	1.0	vortex-compact	127.93 MB	127.89 MB	46.37 KB	-0.0%
hits_043.vortex	1.0	vortex-file-compressed	126.78 MB	126.74 MB	46.95 KB	-0.0%
hits_009.vortex	1.0	vortex-file-compressed	101.10 MB	101.06 MB	38.59 KB	-0.0%
hits_024.vortex	1.0	vortex-file-compressed	161.18 MB	161.11 MB	62.34 KB	-0.0%
hits_033.vortex	1.0	vortex-compact	152.73 MB	152.67 MB	62.73 KB	-0.0%
hits_015.vortex	1.0	vortex-file-compressed	130.42 MB	130.37 MB	57.59 KB	-0.0%
hits_041.vortex	1.0	vortex-file-compressed	130.34 MB	130.28 MB	57.77 KB	-0.0%
hits_038.vortex	1.0	vortex-compact	138.24 MB	138.17 MB	67.98 KB	-0.0%
hits_078.vortex	1.0	vortex-file-compressed	130.37 MB	130.30 MB	65.05 KB	-0.0%
hits_060.vortex	1.0	vortex-compact	140.04 MB	139.97 MB	72.43 KB	-0.1%
hits_069.vortex	1.0	vortex-file-compressed	142.85 MB	142.77 MB	76.37 KB	-0.1%
hits_062.vortex	1.0	vortex-compact	132.58 MB	132.51 MB	72.27 KB	-0.1%
hits_065.vortex	1.0	vortex-file-compressed	161.99 MB	161.90 MB	89.02 KB	-0.1%
hits_035.vortex	1.0	vortex-compact	75.95 MB	75.91 MB	44.76 KB	-0.1%
hits_034.vortex	1.0	vortex-compact	132.44 MB	132.36 MB	80.35 KB	-0.1%
hits_035.vortex	1.0	vortex-file-compressed	102.24 MB	102.17 MB	62.49 KB	-0.1%
hits_021.vortex	1.0	vortex-file-compressed	153.81 MB	153.71 MB	95.37 KB	-0.1%
hits_052.vortex	1.0	vortex-file-compressed	130.12 MB	130.04 MB	81.70 KB	-0.1%
hits_094.vortex	1.0	vortex-compact	110.77 MB	110.70 MB	70.96 KB	-0.1%
hits_014.vortex	1.0	vortex-compact	133.85 MB	133.77 MB	86.00 KB	-0.1%
hits_089.vortex	1.0	vortex-file-compressed	130.76 MB	130.67 MB	88.15 KB	-0.1%
hits_048.vortex	1.0	vortex-file-compressed	200.80 MB	200.67 MB	139.17 KB	-0.1%
hits_020.vortex	1.0	vortex-file-compressed	160.07 MB	159.96 MB	111.09 KB	-0.1%
hits_070.vortex	1.0	vortex-compact	153.74 MB	153.64 MB	109.35 KB	-0.1%
hits_044.vortex	1.0	vortex-file-compressed	201.03 MB	200.89 MB	148.33 KB	-0.1%
hits_039.vortex	1.0	vortex-file-compressed	161.76 MB	161.64 MB	119.84 KB	-0.1%
hits_092.vortex	1.0	vortex-compact	153.37 MB	153.26 MB	115.67 KB	-0.1%
hits_004.vortex	1.0	vortex-file-compressed	130.64 MB	130.54 MB	100.08 KB	-0.1%
hits_061.vortex	1.0	vortex-file-compressed	161.42 MB	161.30 MB	124.23 KB	-0.1%
hits_079.vortex	1.0	vortex-file-compressed	180.69 MB	180.54 MB	156.95 KB	-0.1%
hits_088.vortex	1.0	vortex-compact	134.22 MB	134.10 MB	126.50 KB	-0.1%
hits_085.vortex	1.0	vortex-compact	153.26 MB	153.10 MB	166.94 KB	-0.1%
hits_073.vortex	1.0	vortex-file-compressed	173.34 MB	173.13 MB	217.73 KB	-0.1%
hits_055.vortex	1.0	vortex-file-compressed	200.72 MB	200.47 MB	255.25 KB	-0.1%
hits_019.vortex	1.0	vortex-compact	106.10 MB	105.97 MB	135.01 KB	-0.1%
hits_013.vortex	1.0	vortex-compact	125.46 MB	125.30 MB	162.43 KB	-0.1%
hits_038.vortex	1.0	vortex-file-compressed	192.27 MB	192.00 MB	276.73 KB	-0.1%
hits_075.vortex	1.0	vortex-file-compressed	189.40 MB	189.12 MB	280.88 KB	-0.1%
hits_043.vortex	1.0	vortex-compact	94.25 MB	94.11 MB	147.08 KB	-0.2%
hits_099.vortex	1.0	vortex-compact	133.40 MB	133.19 MB	215.33 KB	-0.2%
hits_003.vortex	1.0	vortex-compact	104.64 MB	104.45 MB	190.79 KB	-0.2%
hits_025.vortex	1.0	vortex-compact	133.70 MB	133.45 MB	252.55 KB	-0.2%
hits_051.vortex	1.0	vortex-file-compressed	173.18 MB	172.86 MB	332.04 KB	-0.2%
hits_068.vortex	1.0	vortex-file-compressed	160.51 MB	160.18 MB	337.44 KB	-0.2%
hits_093.vortex	1.0	vortex-compact	99.25 MB	99.04 MB	222.64 KB	-0.2%
hits_086.vortex	1.0	vortex-compact	139.88 MB	139.57 MB	316.88 KB	-0.2%
hits_030.vortex	1.0	vortex-compact	98.75 MB	98.51 MB	240.04 KB	-0.2%
hits_036.vortex	1.0	vortex-compact	133.70 MB	133.35 MB	358.52 KB	-0.3%
hits_055.vortex	1.0	vortex-compact	153.54 MB	153.13 MB	425.54 KB	-0.3%
hits_031.vortex	1.0	vortex-compact	111.47 MB	111.11 MB	362.05 KB	-0.3%
hits_028.vortex	1.0	vortex-file-compressed	152.80 MB	152.28 MB	539.80 KB	-0.3%
hits_029.vortex	1.0	vortex-compact	153.42 MB	152.81 MB	629.81 KB	-0.4%
hits_048.vortex	1.0	vortex-compact	153.37 MB	152.75 MB	639.79 KB	-0.4%
hits_018.vortex	1.0	vortex-compact	153.68 MB	153.05 MB	648.88 KB	-0.4%
hits_089.vortex	1.0	vortex-compact	98.72 MB	98.24 MB	494.62 KB	-0.5%
hits_094.vortex	1.0	vortex-file-compressed	159.08 MB	158.28 MB	819.77 KB	-0.5%
hits_084.vortex	1.0	vortex-file-compressed	154.73 MB	153.89 MB	858.18 KB	-0.5%
hits_082.vortex	1.0	vortex-file-compressed	140.04 MB	139.25 MB	810.39 KB	-0.6%
hits_023.vortex	1.0	vortex-compact	142.38 MB	141.55 MB	850.39 KB	-0.6%
hits_011.vortex	1.0	vortex-file-compressed	200.15 MB	198.89 MB	1.25 MB	-0.6%
hits_091.vortex	1.0	vortex-compact	111.98 MB	111.21 MB	795.14 KB	-0.7%
hits_080.vortex	1.0	vortex-file-compressed	127.11 MB	126.17 MB	964.75 KB	-0.7%
hits_039.vortex	1.0	vortex-compact	124.80 MB	123.86 MB	957.52 KB	-0.7%
hits_026.vortex	1.0	vortex-compact	98.64 MB	97.89 MB	764.39 KB	-0.8%
hits_096.vortex	1.0	vortex-file-compressed	200.70 MB	199.16 MB	1.54 MB	-0.8%
hits_085.vortex	1.0	vortex-file-compressed	200.94 MB	199.28 MB	1.66 MB	-0.8%
hits_037.vortex	1.0	vortex-compact	133.58 MB	132.47 MB	1.11 MB	-0.8%
hits_033.vortex	1.0	vortex-file-compressed	200.96 MB	199.27 MB	1.69 MB	-0.8%
hits_041.vortex	1.0	vortex-compact	98.71 MB	97.80 MB	935.36 KB	-0.9%
hits_052.vortex	1.0	vortex-compact	99.03 MB	97.83 MB	1.19 MB	-1.2%
hits_024.vortex	1.0	vortex-compact	125.05 MB	123.45 MB	1.61 MB	-1.3%
hits_002.vortex	1.0	vortex-compact	125.34 MB	123.70 MB	1.64 MB	-1.3%
hits_090.vortex	1.0	vortex-file-compressed	195.23 MB	192.30 MB	2.93 MB	-1.5%
hits_098.vortex	1.0	vortex-compact	103.88 MB	102.29 MB	1.58 MB	-1.5%
duckdb.db	1.0	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%

Totals:

vortex-compact: 11.91 GB → 11.91 GB (-0.1%)
vortex-file-compressed: 15.97 GB → 15.96 GB (-0.0%)

github-actions · 2026-10-09T15:19:51Z

Benchmarks: FineWeb S3 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.0%
Engines: DataFusion No clear signal (-8.9%, environment too noisy confidence) · DuckDB No clear signal (+1.1%, environment too noisy confidence)
Vortex (geomean): hot 1.069x ➖ · cold 1.057x ➖
Parquet (geomean): hot 1.114x ➖ · cold 1.083x ➖
Shifts: Parquet (control) +11.4% · Median polish +3.9%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.177x ➖, 1↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	55979868 / 52015236 / +7.6%	146115835 / 131312261 / +11.3%	0.38 / 0.40 / -3.3%
fineweb_q01/datafusion:vortex-file-compressed	430984302 / 413833922 / +4.1%	829406913 / 661600095 / +25.4%	0.52 / 0.63 / -16.9%
fineweb_q02/datafusion:vortex-file-compressed	690442584 / 449691734 / +53.5% 🔴	693418254 / 653313060 / +6.1%	1.00 / 0.69 / +44.7%
fineweb_q03/datafusion:vortex-file-compressed	576207532 / 552492428 / +4.3%	950268066 / 863854421 / +10.0%	0.61 / 0.64 / -5.2%
fineweb_q04/datafusion:vortex-file-compressed	578439724 / 412419639 / +40.3% 🔴	616453075 / 446459380 / +38.1% 🔴	0.94 / 0.92 / +1.6%
fineweb_q05/datafusion:vortex-file-compressed	600702354 / 394796976 / +52.2% 🔴	600968879 / 448047097 / +34.1% 🔴	1.00 / 0.88 / +13.4%
fineweb_q06/datafusion:vortex-file-compressed	792549842 / 737248220 / +7.5%	993472749 / 865150729 / +14.8%	0.80 / 0.85 / -6.4%
fineweb_q07/datafusion:vortex-file-compressed	767840030 / 502081638 / +52.9% 🔴	628024695 / 563231220 / +11.5%	1.22 / 0.89 / +37.2%
fineweb_q08/datafusion:vortex-file-compressed	315943744 / 457696772 / -31.0% 🟢	239288463 / 190877633 / +25.4%	1.32 / 2.40 / -44.9%

datafusion / vortex-compact / ns (1.074x ➖, 1↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	58095436 / 42818560 / +35.7% 🔴	110564896 / 178883147 / -38.2% 🟢	0.53 / 0.24 / +119.5%
fineweb_q01/datafusion:vortex-compact	392484666 / 416158778 / -5.7%	950014876 / 884050973 / +7.5%	0.41 / 0.47 / -12.2%
fineweb_q02/datafusion:vortex-compact	451209228 / 412626514 / +9.4%	559586672 / 499631400 / +12.0%	0.81 / 0.83 / -2.4%
fineweb_q03/datafusion:vortex-compact	575226826 / 530773839 / +8.4%	804457266 / 728295808 / +10.5%	0.72 / 0.73 / -1.9%
fineweb_q04/datafusion:vortex-compact	652474844 / 448772374 / +45.4% 🔴	559266844 / 526371485 / +6.2%	1.17 / 0.85 / +36.8%
fineweb_q05/datafusion:vortex-compact	487027601 / 449909350 / +8.3%	506825131 / 524695067 / -3.4%	0.96 / 0.86 / +12.1%
fineweb_q06/datafusion:vortex-compact	695335270 / 1024401051 / -32.1% 🟢	748911484 / 727279221 / +3.0%	0.93 / 1.41 / -34.1%
fineweb_q07/datafusion:vortex-compact	548060330 / 506572905 / +8.2%	510060898 / 428484225 / +19.0%	1.07 / 1.18 / -9.1%
fineweb_q08/datafusion:vortex-compact	190091372 / 174727493 / +8.8%	331663033 / 241379635 / +37.4% 🔴	0.57 / 0.72 / -20.8%

datafusion / parquet / ns (1.234x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	578630705 / 612740243 / -5.6%	1086919100 / 1008570474 / +7.8%	0.53 / 0.61 / -12.4%
fineweb_q01/datafusion:parquet	888159164 / 746674776 / +18.9%	1201851185 / 855685051 / +40.5% 🔴	0.74 / 0.87 / -15.3%
fineweb_q02/datafusion:parquet	1420510070 / 777151706 / +82.8% 🔴	892127517 / 738632958 / +20.8%	1.59 / 1.05 / +51.3%
fineweb_q03/datafusion:parquet	835530256 / 844551652 / -1.1%	938725047 / 793863342 / +18.2%	0.89 / 1.06 / -16.3%
fineweb_q04/datafusion:parquet	1143661228 / 1121251882 / +2.0%	1082271589 / 1310605645 / -17.4%	1.06 / 0.86 / +23.5%
fineweb_q05/datafusion:parquet	1347091999 / 865397974 / +55.7% 🔴	1435492705 / 1090176907 / +31.7% 🔴	0.94 / 0.79 / +18.2%
fineweb_q06/datafusion:parquet	1042615798 / 733992184 / +42.0% 🔴	874133495 / 786795965 / +11.1%	1.19 / 0.93 / +27.9%
fineweb_q07/datafusion:parquet	1026840358 / 842173278 / +21.9%	869797362 / 807280072 / +7.7%	1.18 / 1.04 / +13.2%
fineweb_q08/datafusion:parquet	973274504 / 818642106 / +18.9%	1062446392 / 886173059 / +19.9%	0.92 / 0.92 / -0.8%

duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	60025099 / 51974899 / +15.5%	64070786 / 56483978 / +13.4%	0.94 / 0.92 / +1.8%
fineweb_q01/duckdb:vortex-file-compressed	517321622 / 454311502 / +13.9%	484583906 / 427122664 / +13.5%	1.07 / 1.06 / +0.4%
fineweb_q02/duckdb:vortex-file-compressed	629708162 / 554771515 / +13.5%	609535520 / 595602257 / +2.3%	1.03 / 0.93 / +10.9%
fineweb_q03/duckdb:vortex-file-compressed	1061135819 / 1063696205 / -0.2%	1195010668 / 1223666770 / -2.3%	0.89 / 0.87 / +2.2%
fineweb_q04/duckdb:vortex-file-compressed	989127118 / 1045676826 / -5.4%	978197892 / 1024967121 / -4.6%	1.01 / 1.02 / -0.9%
fineweb_q05/duckdb:vortex-file-compressed	918287124 / 969138082 / -5.2%	979242149 / 1019322871 / -3.9%	0.94 / 0.95 / -1.4%
fineweb_q06/duckdb:vortex-file-compressed	1238374772 / 1281881198 / -3.4%	1292463174 / 1239250243 / +4.3%	0.96 / 1.03 / -7.4%
fineweb_q07/duckdb:vortex-file-compressed	1050729360 / 962977642 / +9.1%	1248863129 / 1008221888 / +23.9%	0.84 / 0.96 / -11.9%
fineweb_q08/duckdb:vortex-file-compressed	426897928 / 548902422 / -22.2%	492750952 / 526635333 / -6.4%	0.87 / 1.04 / -16.9%

duckdb / vortex-compact / ns (1.023x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	67323761 / 66450688 / +1.3%	79099960 / 77736070 / +1.8%	0.85 / 0.85 / -0.4%
fineweb_q01/duckdb:vortex-compact	389747643 / 377802819 / +3.2%	448687954 / 444617628 / +0.9%	0.87 / 0.85 / +2.2%
fineweb_q02/duckdb:vortex-compact	607659850 / 572478827 / +6.1%	600851966 / 614653175 / -2.2%	1.01 / 0.93 / +8.6%
fineweb_q03/duckdb:vortex-compact	1148618860 / 1108304332 / +3.6%	1216872271 / 1419469150 / -14.3%	0.94 / 0.78 / +20.9%
fineweb_q04/duckdb:vortex-compact	1049452562 / 1056306742 / -0.6%	993724544 / 1042787933 / -4.7%	1.06 / 1.01 / +4.3%
fineweb_q05/duckdb:vortex-compact	898350094 / 943614884 / -4.8%	1114726375 / 995285975 / +12.0%	0.81 / 0.95 / -15.0%
fineweb_q06/duckdb:vortex-compact	1108282822 / 1101089956 / +0.7%	1130730808 / 1461945043 / -22.7%	0.98 / 0.75 / +30.1%
fineweb_q07/duckdb:vortex-compact	1090994782 / 963329186 / +13.3%	1078971412 / 1097074600 / -1.7%	1.01 / 0.88 / +15.2%
fineweb_q08/duckdb:vortex-compact	358757725 / 361838535 / -0.9%	439380273 / 410604441 / +7.0%	0.82 / 0.88 / -7.3%

duckdb / parquet / ns (1.006x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	536092510 / 542830025 / -1.2%	557682316 / 644159656 / -13.4%	0.96 / 0.84 / +14.1%
fineweb_q01/duckdb:parquet	660022835 / 715970278 / -7.8%	652768590 / 592172381 / +10.2%	1.01 / 1.21 / -16.4%
fineweb_q02/duckdb:parquet	619078670 / 625995555 / -1.1%	634821287 / 670432334 / -5.3%	0.98 / 0.93 / +4.4%
fineweb_q03/duckdb:parquet	1841480405 / 1493628576 / +23.3%	1729511937 / 1498525632 / +15.4%	1.06 / 1.00 / +6.8%
fineweb_q04/duckdb:parquet	878650654 / 930449875 / -5.6%	851999832 / 944817760 / -9.8%	1.03 / 0.98 / +4.7%
fineweb_q05/duckdb:parquet	943637043 / 995235630 / -5.2%	1166853714 / 1132595593 / +3.0%	0.81 / 0.88 / -8.0%
fineweb_q06/duckdb:parquet	1802113138 / 1967341812 / -8.4%	2030710217 / 1973698253 / +2.9%	0.89 / 1.00 / -11.0%
fineweb_q07/duckdb:parquet	1223577896 / 1156638054 / +5.8%	1381568896 / 1173735207 / +17.7%	0.89 / 0.99 / -10.1%
fineweb_q08/duckdb:parquet	597201856 / 547113746 / +9.2%	615244521 / 580256109 / +6.0%	0.97 / 0.94 / +2.9%

github-actions · 2026-10-09T15:21:38Z

Benchmarks: Clickbench on NVME 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.3%, environment too noisy confidence)
Vortex (geomean): hot 1.014x ➖ · cold 0.988x ➖
Parquet (geomean): hot 1.003x ➖ · cold 0.985x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1204652 / 1236975 / -2.6%	20845435 / 20625490 / +1.1%	0.06 / 0.06 / -3.6%
clickbench_q01/datafusion:vortex-file-compressed	6015895 / 5649156 / +6.5%	32610639 / 32981222 / -1.1%	0.18 / 0.17 / +7.7%
clickbench_q02/datafusion:vortex-file-compressed	9959354 / 9813354 / +1.5%	35134902 / 40011954 / -12.2% 🟢	0.28 / 0.25 / +15.6%
clickbench_q03/datafusion:vortex-file-compressed	11804154 / 11287738 / +4.6%	51997465 / 54447720 / -4.5%	0.23 / 0.21 / +9.5%
clickbench_q04/datafusion:vortex-file-compressed	55061388 / 56042854 / -1.8%	93977154 / 89965692 / +4.5%	0.59 / 0.62 / -5.9%
clickbench_q05/datafusion:vortex-file-compressed	73427829 / 76936827 / -4.6%	114808209 / 122588290 / -6.3%	0.64 / 0.63 / +1.9%
clickbench_q06/datafusion:vortex-file-compressed	1247704 / 1242898 / +0.4%	20653867 / 19744007 / +4.6%	0.06 / 0.06 / -4.0%
clickbench_q07/datafusion:vortex-file-compressed	9965904 / 9645806 / +3.3%	33626693 / 32373047 / +3.9%	0.30 / 0.30 / -0.5%
clickbench_q08/datafusion:vortex-file-compressed	75203465 / 78115198 / -3.7%	118418722 / 116274927 / +1.8%	0.64 / 0.67 / -5.5%
clickbench_q09/datafusion:vortex-file-compressed	165727481 / 166809220 / -0.6%	211504595 / 204658343 / +3.3%	0.78 / 0.82 / -3.9%
clickbench_q10/datafusion:vortex-file-compressed	23641257 / 22639236 / +4.4%	65486263 / 68082602 / -3.8%	0.36 / 0.33 / +8.6%
clickbench_q11/datafusion:vortex-file-compressed	26014388 / 25583567 / +1.7%	68520762 / 65056431 / +5.3%	0.38 / 0.39 / -3.5%
clickbench_q12/datafusion:vortex-file-compressed	72104972 / 72149042 / -0.1%	118961555 / 111719641 / +6.5%	0.61 / 0.65 / -6.1%
clickbench_q13/datafusion:vortex-file-compressed	118165776 / 116680023 / +1.3%	175021520 / 181944942 / -3.8%	0.68 / 0.64 / +5.3%
clickbench_q14/datafusion:vortex-file-compressed	75442150 / 78593074 / -4.0%	113291141 / 121594707 / -6.8%	0.67 / 0.65 / +3.0%
clickbench_q15/datafusion:vortex-file-compressed	61413455 / 60659261 / +1.2%	93163979 / 95286975 / -2.2%	0.66 / 0.64 / +3.6%
clickbench_q16/datafusion:vortex-file-compressed	149946713 / 151083774 / -0.8%	208136244 / 211814293 / -1.7%	0.72 / 0.71 / +1.0%
clickbench_q17/datafusion:vortex-file-compressed	149234926 / 149356338 / -0.1%	211252589 / 214805861 / -1.7%	0.71 / 0.70 / +1.6%
clickbench_q18/datafusion:vortex-file-compressed	292089915 / 298806254 / -2.2%	378012549 / 375751227 / +0.6%	0.77 / 0.80 / -2.8%
clickbench_q19/datafusion:vortex-file-compressed	7897220 / 7583803 / +4.1%	42970748 / 48172585 / -10.8% 🟢	0.18 / 0.16 / +16.7%
clickbench_q20/datafusion:vortex-file-compressed	62813164 / 63563507 / -1.2%	234728117 / 228782441 / +2.6%	0.27 / 0.28 / -3.7%
clickbench_q21/datafusion:vortex-file-compressed	90595611 / 88539372 / +2.3%	269386880 / 275540230 / -2.2%	0.34 / 0.32 / +4.7%
clickbench_q22/datafusion:vortex-file-compressed	100004788 / 98609980 / +1.4%	342609468 / 351120295 / -2.4%	0.29 / 0.28 / +3.9%
clickbench_q23/datafusion:vortex-file-compressed	196036924 / 188305512 / +4.1%	503363004 / 531786676 / -5.3%	0.39 / 0.35 / +10.0%
clickbench_q24/datafusion:vortex-file-compressed	15943823 / 16097455 / -1.0%	67060747 / 62474452 / +7.3%	0.24 / 0.26 / -7.7%
clickbench_q25/datafusion:vortex-file-compressed	17736154 / 17878718 / -0.8%	57320982 / 55658034 / +3.0%	0.31 / 0.32 / -3.7%
clickbench_q26/datafusion:vortex-file-compressed	16259234 / 16273234 / -0.1%	64398156 / 66894486 / -3.7%	0.25 / 0.24 / +3.8%
clickbench_q27/datafusion:vortex-file-compressed	99436888 / 97981429 / +1.5%	241446281 / 241989896 / -0.2%	0.41 / 0.40 / +1.7%
clickbench_q28/datafusion:vortex-file-compressed	565736202 / 575016467 / -1.6%	611208892 / 620372050 / -1.5%	0.93 / 0.93 / -0.1%
clickbench_q29/datafusion:vortex-file-compressed	23099660 / 23108874 / -0.0%	49576424 / 49527422 / +0.1%	0.47 / 0.47 / -0.1%
clickbench_q30/datafusion:vortex-file-compressed	57243286 / 59645899 / -4.0%	99062195 / 105173732 / -5.8%	0.58 / 0.57 / +1.9%
clickbench_q31/datafusion:vortex-file-compressed	69553310 / 68864334 / +1.0%	150855329 / 153105792 / -1.5%	0.46 / 0.45 / +2.5%
clickbench_q32/datafusion:vortex-file-compressed	296616421 / 298357048 / -0.6%	386044434 / 388925143 / -0.7%	0.77 / 0.77 / +0.2%
clickbench_q33/datafusion:vortex-file-compressed	337336704 / 332273960 / +1.5%	426384749 / 441084826 / -3.3%	0.79 / 0.75 / +5.0%
clickbench_q34/datafusion:vortex-file-compressed	330532468 / 336267856 / -1.7%	439066545 / 433718215 / +1.2%	0.75 / 0.78 / -2.9%
clickbench_q35/datafusion:vortex-file-compressed	56144212 / 56508762 / -0.6%	88973828 / 88570254 / +0.5%	0.63 / 0.64 / -1.1%
clickbench_q36/datafusion:vortex-file-compressed	37227194 / 37008660 / +0.6%	64775416 / 64469773 / +0.5%	0.57 / 0.57 / +0.1%
clickbench_q37/datafusion:vortex-file-compressed	21599310 / 21521902 / +0.4%	47062420 / 46169424 / +1.9%	0.46 / 0.47 / -1.5%
clickbench_q38/datafusion:vortex-file-compressed	11684253 / 11719320 / -0.3%	38176718 / 37306432 / +2.3%	0.31 / 0.31 / -2.6%
clickbench_q39/datafusion:vortex-file-compressed	77965538 / 77938674 / +0.0%	109235194 / 109854721 / -0.6%	0.71 / 0.71 / +0.6%
clickbench_q40/datafusion:vortex-file-compressed	11008824 / 11363901 / -3.1%	35835729 / 35549515 / +0.8%	0.31 / 0.32 / -3.9%
clickbench_q41/datafusion:vortex-file-compressed	10679176 / 10762950 / -0.8%	35585803 / 34766506 / +2.4%	0.30 / 0.31 / -3.1%
clickbench_q42/datafusion:vortex-file-compressed	11050661 / 11069476 / -0.2%	35078686 / 34250406 / +2.4%	0.32 / 0.32 / -2.5%

datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1263977 / 1270971 / -0.6%	50486208 / 48966370 / +3.1%	0.03 / 0.03 / -3.5%
clickbench_q01/datafusion:parquet	15832228 / 15953604 / -0.8%	72239279 / 73388056 / -1.6%	0.22 / 0.22 / +0.8%
clickbench_q02/datafusion:parquet	18792664 / 18295962 / +2.7%	85060375 / 81459290 / +4.4%	0.22 / 0.22 / -1.6%
clickbench_q03/datafusion:parquet	16792889 / 17356559 / -3.2%	80730290 / 79946334 / +1.0%	0.21 / 0.22 / -4.2%
clickbench_q04/datafusion:parquet	62833455 / 62428751 / +0.6%	133260234 / 132999832 / +0.2%	0.47 / 0.47 / +0.5%
clickbench_q05/datafusion:parquet	88377328 / 88373448 / +0.0%	160383306 / 157711563 / +1.7%	0.55 / 0.56 / -1.7%
clickbench_q06/datafusion:parquet	1259324 / 1291786 / -2.5%	50849219 / 49824090 / +2.1%	0.02 / 0.03 / -4.5%
clickbench_q07/datafusion:parquet	16722840 / 16867634 / -0.9%	71494409 / 69184446 / +3.3%	0.23 / 0.24 / -4.1%
clickbench_q08/datafusion:parquet	86154890 / 85679682 / +0.6%	158737468 / 168512536 / -5.8%	0.54 / 0.51 / +6.7%
clickbench_q09/datafusion:parquet	192362618 / 192052550 / +0.2%	277291488 / 274849802 / +0.9%	0.69 / 0.70 / -0.7%
clickbench_q10/datafusion:parquet	35933530 / 36427277 / -1.4%	103992362 / 102082462 / +1.9%	0.35 / 0.36 / -3.2%
clickbench_q11/datafusion:parquet	42451598 / 43465878 / -2.3%	111548840 / 112207315 / -0.6%	0.38 / 0.39 / -1.8%
clickbench_q12/datafusion:parquet	96832678 / 96873433 / -0.0%	162851972 / 163036391 / -0.1%	0.59 / 0.59 / +0.1%
clickbench_q13/datafusion:parquet	149332184 / 147022032 / +1.6%	223779723 / 230521056 / -2.9%	0.67 / 0.64 / +4.6%
clickbench_q14/datafusion:parquet	101947800 / 102600574 / -0.6%	170337883 / 173967748 / -2.1%	0.60 / 0.59 / +1.5%
clickbench_q15/datafusion:parquet	70016585 / 71521016 / -2.1%	132720047 / 132514756 / +0.2%	0.53 / 0.54 / -2.3%
clickbench_q16/datafusion:parquet	157478646 / 156311814 / +0.7%	235624935 / 239119990 / -1.5%	0.67 / 0.65 / +2.2%
clickbench_q17/datafusion:parquet	156688569 / 157970036 / -0.8%	237386464 / 240430731 / -1.3%	0.66 / 0.66 / +0.5%
clickbench_q18/datafusion:parquet	317489271 / 315069182 / +0.8%	425990276 / 425792194 / +0.0%	0.75 / 0.74 / +0.7%
clickbench_q19/datafusion:parquet	19554490 / 18950925 / +3.2%	76579688 / 79739385 / -4.0%	0.26 / 0.24 / +7.4%
clickbench_q20/datafusion:parquet	179702581 / 180313834 / -0.3%	277975283 / 299421213 / -7.2%	0.65 / 0.60 / +7.3%
clickbench_q21/datafusion:parquet	173995765 / 174517002 / -0.3%	293034504 / 317332173 / -7.7%	0.59 / 0.55 / +8.0%
clickbench_q22/datafusion:parquet	262356159 / 262713448 / -0.1%	415697985 / 451857305 / -8.0%	0.63 / 0.58 / +8.6%
clickbench_q23/datafusion:parquet	1167410476 / 1184563930 / -1.4%	1226954359 / 1246144816 / -1.5%	0.95 / 0.95 / +0.1%
clickbench_q24/datafusion:parquet	30132112 / 29957268 / +0.6%	88016981 / 89895309 / -2.1%	0.34 / 0.33 / +2.7%
clickbench_q25/datafusion:parquet	37461980 / 36937738 / +1.4%	100327325 / 105773659 / -5.1%	0.37 / 0.35 / +6.9%
clickbench_q26/datafusion:parquet	31018510 / 31075816 / -0.2%	88651356 / 90283831 / -1.8%	0.35 / 0.34 / +1.7%
clickbench_q27/datafusion:parquet	193300052 / 194236952 / -0.5%	286992056 / 308056141 / -6.8%	0.67 / 0.63 / +6.8%
clickbench_q28/datafusion:parquet	624268506 / 622080154 / +0.4%	698260380 / 703510488 / -0.7%	0.89 / 0.88 / +1.1%
clickbench_q29/datafusion:parquet	28812669 / 28419412 / +1.4%	92505605 / 92358038 / +0.2%	0.31 / 0.31 / +1.2%
clickbench_q30/datafusion:parquet	90954662 / 90396848 / +0.6%	168188395 / 174804997 / -3.8%	0.54 / 0.52 / +4.6%
clickbench_q31/datafusion:parquet	103538734 / 104410434 / -0.8%	191293844 / 201669252 / -5.1%	0.54 / 0.52 / +4.5%
clickbench_q32/datafusion:parquet	320187618 / 324346427 / -1.3%	428133153 / 435102282 / -1.6%	0.75 / 0.75 / +0.3%
clickbench_q33/datafusion:parquet	383080515 / 383264070 / -0.0%	470410672 / 476699855 / -1.3%	0.81 / 0.80 / +1.3%
clickbench_q34/datafusion:parquet	384291314 / 381728692 / +0.7%	482483297 / 473979449 / +1.8%	0.80 / 0.81 / -1.1%
clickbench_q35/datafusion:parquet	64752634 / 64295196 / +0.7%	126616890 / 123840178 / +2.2%	0.51 / 0.52 / -1.5%
clickbench_q36/datafusion:parquet	73947851 / 73497933 / +0.6%	136297616 / 136933462 / -0.5%	0.54 / 0.54 / +1.1%
clickbench_q37/datafusion:parquet	35329666 / 35361230 / -0.1%	91877894 / 90881847 / +1.1%	0.38 / 0.39 / -1.2%
clickbench_q38/datafusion:parquet	47785402 / 47329160 / +1.0%	107115704 / 107739306 / -0.6%	0.45 / 0.44 / +1.6%
clickbench_q39/datafusion:parquet	143794882 / 143615913 / +0.1%	206926848 / 209277745 / -1.1%	0.69 / 0.69 / +1.3%
clickbench_q40/datafusion:parquet	19841311 / 20399270 / -2.7%	77317822 / 77170942 / +0.2%	0.26 / 0.26 / -2.9%
clickbench_q41/datafusion:parquet	18812789 / 18815044 / -0.0%	76796424 / 74127615 / +3.6%	0.24 / 0.25 / -3.5%
clickbench_q42/datafusion:parquet	19421726 / 19380637 / +0.2%	76141606 / 74864323 / +1.7%	0.26 / 0.26 / -1.5%

duckdb / vortex-file-compressed / ns (1.028x ➖, 0↑ 6↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	1839200 / 1595528 / +15.3% 🔴	24066297 / 24285185 / -0.9%	0.08 / 0.07 / +16.3%
clickbench_q01/duckdb:vortex-file-compressed	14863316 / 12016983 / +23.7% 🔴	32468824 / 28448447 / +14.1% 🔴	0.46 / 0.42 / +8.4%
clickbench_q02/duckdb:vortex-file-compressed	13097585 / 12743041 / +2.8%	31592309 / 34158969 / -7.5%	0.41 / 0.37 / +11.1%
clickbench_q03/duckdb:vortex-file-compressed	17543810 / 16784340 / +4.5%	42897546 / 54124888 / -20.7% 🟢	0.41 / 0.31 / +31.9%
clickbench_q04/duckdb:vortex-file-compressed	71826776 / 67676547 / +6.1%	106906350 / 119416650 / -10.5% 🟢	0.67 / 0.57 / +18.6%
clickbench_q05/duckdb:vortex-file-compressed	69362678 / 67928114 / +2.1%	93597643 / 103687515 / -9.7%	0.74 / 0.66 / +13.1%
clickbench_q06/duckdb:vortex-file-compressed	2043552 / 1816086 / +12.5% 🔴	33393984 / 27593243 / +21.0% 🔴	0.06 / 0.07 / -7.0%
clickbench_q07/duckdb:vortex-file-compressed	13814254 / 15326474 / -9.9%	30641701 / 28616809 / +7.1%	0.45 / 0.54 / -15.8%
clickbench_q08/duckdb:vortex-file-compressed	85711483 / 81841310 / +4.7%	123797883 / 125624630 / -1.5%	0.69 / 0.65 / +6.3%
clickbench_q09/duckdb:vortex-file-compressed	105536896 / 106873047 / -1.3%	141913964 / 161547206 / -12.2% 🟢	0.74 / 0.66 / +12.4%
clickbench_q10/duckdb:vortex-file-compressed	33618806 / 32249878 / +4.2%	66695870 / 70643638 / -5.6%	0.50 / 0.46 / +10.4%
clickbench_q11/duckdb:vortex-file-compressed	35810374 / 35006443 / +2.3%	69836855 / 75120638 / -7.0%	0.51 / 0.47 / +10.0%
clickbench_q12/duckdb:vortex-file-compressed	76974462 / 74006154 / +4.0%	108563954 / 108809952 / -0.2%	0.71 / 0.68 / +4.2%
clickbench_q13/duckdb:vortex-file-compressed	138887910 / 131039751 / +6.0%	177509441 / 178109549 / -0.3%	0.78 / 0.74 / +6.3%
clickbench_q14/duckdb:vortex-file-compressed	76606260 / 78129796 / -2.0%	112774754 / 111124508 / +1.5%	0.68 / 0.70 / -3.4%
clickbench_q15/duckdb:vortex-file-compressed	92256688 / 93614404 / -1.5%	127621459 / 131904585 / -3.2%	0.72 / 0.71 / +1.9%
clickbench_q16/duckdb:vortex-file-compressed	160283784 / 167499124 / -4.3%	205687944 / 210900319 / -2.5%	0.78 / 0.79 / -1.9%
clickbench_q17/duckdb:vortex-file-compressed	162176981 / 161915470 / +0.2%	206030476 / 211813252 / -2.7%	0.79 / 0.76 / +3.0%
clickbench_q18/duckdb:vortex-file-compressed	353898259 / 314501096 / +12.5% 🔴	385029687 / 381832064 / +0.8%	0.92 / 0.82 / +11.6%
clickbench_q19/duckdb:vortex-file-compressed	16216321 / 15920721 / +1.9%	41582236 / 42955640 / -3.2%	0.39 / 0.37 / +5.2%
clickbench_q20/duckdb:vortex-file-compressed	109942508 / 111684212 / -1.6%	186739514 / 198965775 / -6.1%	0.59 / 0.56 / +4.9%
clickbench_q21/duckdb:vortex-file-compressed	156865128 / 155609538 / +0.8%	292872350 / 299908462 / -2.3%	0.54 / 0.52 / +3.2%
clickbench_q22/duckdb:vortex-file-compressed	237590656 / 234964843 / +1.1%	431696697 / 457181484 / -5.6%	0.55 / 0.51 / +7.1%
clickbench_q23/duckdb:vortex-file-compressed	57650626 / 58432042 / -1.3%	107669782 / 104000982 / +3.5%	0.54 / 0.56 / -4.7%
clickbench_q24/duckdb:vortex-file-compressed	29485543 / 24171824 / +22.0% 🔴	44474699 / 44399006 / +0.2%	0.66 / 0.54 / +21.8%
clickbench_q25/duckdb:vortex-file-compressed	31611226 / 30746766 / +2.8%	59326859 / 50616578 / +17.2% 🔴	0.53 / 0.61 / -12.3%
clickbench_q26/duckdb:vortex-file-compressed	20798060 / 20196780 / +3.0%	37147922 / 36342351 / +2.2%	0.56 / 0.56 / +0.7%
clickbench_q27/duckdb:vortex-file-compressed	134304605 / 134248772 / +0.0%	236608286 / 244740536 / -3.3%	0.57 / 0.55 / +3.5%
clickbench_q28/duckdb:vortex-file-compressed	965390859 / 812505888 / +18.8% 🔴	682006679 / 693956241 / -1.7%	1.42 / 1.17 / +20.9%
clickbench_q29/duckdb:vortex-file-compressed	18396588 / 17028966 / +8.0%	39873073 / 37030241 / +7.7%	0.46 / 0.46 / +0.3%
clickbench_q30/duckdb:vortex-file-compressed	63668417 / 65011818 / -2.1%	108630814 / 112510766 / -3.4%	0.59 / 0.58 / +1.4%
clickbench_q31/duckdb:vortex-file-compressed	124827441 / 122393724 / +2.0%	195223269 / 208320255 / -6.3%	0.64 / 0.59 / +8.8%
clickbench_q32/duckdb:vortex-file-compressed	441191672 / 439079456 / +0.5%	482826552 / 602209230 / -19.8% 🟢	0.91 / 0.73 / +25.3%
clickbench_q33/duckdb:vortex-file-compressed	399120178 / 396437616 / +0.7%	492674472 / 500232959 / -1.5%	0.81 / 0.79 / +2.2%
clickbench_q34/duckdb:vortex-file-compressed	411319024 / 420582537 / -2.2%	512859496 / 524102162 / -2.1%	0.80 / 0.80 / -0.1%
clickbench_q35/duckdb:vortex-file-compressed	101908356 / 107432695 / -5.1%	139272557 / 144399038 / -3.6%	0.73 / 0.74 / -1.7%
clickbench_q36/duckdb:vortex-file-compressed	15963906 / 16148637 / -1.1%	32025831 / 32808388 / -2.4%	0.50 / 0.49 / +1.3%
clickbench_q37/duckdb:vortex-file-compressed	11440127 / 11308626 / +1.2%	28597979 / 28762456 / -0.6%	0.40 / 0.39 / +1.7%
clickbench_q38/duckdb:vortex-file-compressed	13386947 / 12850272 / +4.2%	28800315 / 29263717 / -1.6%	0.46 / 0.44 / +5.9%
clickbench_q39/duckdb:vortex-file-compressed	24935864 / 23267372 / +7.2%	43877171 / 40231717 / +9.1%	0.57 / 0.58 / -1.7%
clickbench_q40/duckdb:vortex-file-compressed	10695843 / 11674149 / -8.4%	28638868 / 27940225 / +2.5%	0.37 / 0.42 / -10.6%
clickbench_q41/duckdb:vortex-file-compressed	11270190 / 10972232 / +2.7%	27409875 / 26151363 / +4.8%	0.41 / 0.42 / -2.0%
clickbench_q42/duckdb:vortex-file-compressed	11300469 / 12096354 / -6.6%	28506876 / 28561178 / -0.2%	0.40 / 0.42 / -6.4%

duckdb / parquet / ns (1.008x ➖, 3↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	7254974 / 9597083 / -24.4% 🟢	20088956 / 25478677 / -21.2% 🟢	0.36 / 0.38 / -4.1%
clickbench_q01/duckdb:parquet	10702518 / 9594056 / +11.6% 🔴	19856178 / 21405221 / -7.2%	0.54 / 0.45 / +20.3%
clickbench_q02/duckdb:parquet	16297809 / 15374066 / +6.0%	33279302 / 36177077 / -8.0%	0.49 / 0.42 / +15.2%
clickbench_q03/duckdb:parquet	16156426 / 15812282 / +2.2%	48952710 / 57239162 / -14.5% 🟢	0.33 / 0.28 / +19.5%
clickbench_q04/duckdb:parquet	67493449 / 75835764 / -11.0% 🟢	90329103 / 105831356 / -14.6% 🟢	0.75 / 0.72 / +4.3%
clickbench_q05/duckdb:parquet	78586724 / 91179099 / -13.8% 🟢	124497786 / 136828497 / -9.0%	0.63 / 0.67 / -5.3%
clickbench_q06/duckdb:parquet	15146207 / 14714058 / +2.9%	24464240 / 25042208 / -2.3%	0.62 / 0.59 / +5.4%
clickbench_q07/duckdb:parquet	11611125 / 11611015 / +0.0%	24295385 / 25752996 / -5.7%	0.48 / 0.45 / +6.0%
clickbench_q08/duckdb:parquet	85064896 / 84786348 / +0.3%	122171603 / 125823727 / -2.9%	0.70 / 0.67 / +3.3%
clickbench_q09/duckdb:parquet	119951947 / 114458847 / +4.8%	160382440 / 159781084 / +0.4%	0.75 / 0.72 / +4.4%
clickbench_q10/duckdb:parquet	32685554 / 32088768 / +1.9%	68269650 / 71919589 / -5.1%	0.48 / 0.45 / +7.3%
clickbench_q11/duckdb:parquet	38859610 / 38132616 / +1.9%	76234333 / 79576524 / -4.2%	0.51 / 0.48 / +6.4%
clickbench_q12/duckdb:parquet	93034846 / 89728357 / +3.7%	135931228 / 137117547 / -0.9%	0.68 / 0.65 / +4.6%
clickbench_q13/duckdb:parquet	150511258 / 144140672 / +4.4%	216562680 / 212020391 / +2.1%	0.70 / 0.68 / +2.2%
clickbench_q14/duckdb:parquet	97279234 / 98639674 / -1.4%	143088940 / 140557297 / +1.8%	0.68 / 0.70 / -3.1%
clickbench_q15/duckdb:parquet	93464186 / 93712248 / -0.3%	128452042 / 119218560 / +7.7%	0.73 / 0.79 / -7.4%
clickbench_q16/duckdb:parquet	178095406 / 174282596 / +2.2%	225255974 / 229255413 / -1.7%	0.79 / 0.76 / +4.0%
clickbench_q17/duckdb:parquet	181607628 / 185056731 / -1.9%	238180625 / 234372424 / +1.6%	0.76 / 0.79 / -3.4%
clickbench_q18/duckdb:parquet	332641090 / 323627446 / +2.8%	421554947 / 408317145 / +3.2%	0.79 / 0.79 / -0.4%
clickbench_q19/duckdb:parquet	14079654 / 12867412 / +9.4%	40454647 / 41221004 / -1.9%	0.35 / 0.31 / +11.5%
clickbench_q20/duckdb:parquet	144660806 / 130292602 / +11.0% 🔴	243523487 / 246820694 / -1.3%	0.59 / 0.53 / +12.5%
clickbench_q21/duckdb:parquet	187359256 / 174964261 / +7.1%	321280674 / 333807432 / -3.8%	0.58 / 0.52 / +11.3%
clickbench_q22/duckdb:parquet	239860433 / 246113972 / -2.5%	396648117 / 417095457 / -4.9%	0.60 / 0.59 / +2.5%
clickbench_q23/duckdb:parquet	148620828 / 147525945 / +0.7%	186491821 / 167791783 / +11.1% 🔴	0.80 / 0.88 / -9.4%
clickbench_q24/duckdb:parquet	45229713 / 42992722 / +5.2%	65248728 / 61124611 / +6.7%	0.69 / 0.70 / -1.4%
clickbench_q25/duckdb:parquet	39209445 / 40072000 / -2.2%	88502764 / 94409786 / -6.3%	0.44 / 0.42 / +4.4%
clickbench_q26/duckdb:parquet	31146410 / 31230570 / -0.3%	47715541 / 48763214 / -2.1%	0.65 / 0.64 / +1.9%
clickbench_q27/duckdb:parquet	149238400 / 143908522 / +3.7%	250751597 / 255420415 / -1.8%	0.60 / 0.56 / +5.6%
clickbench_q28/duckdb:parquet	903539744 / 906697548 / -0.3%	1010335062 / 1005835192 / +0.4%	0.89 / 0.90 / -0.8%
clickbench_q29/duckdb:parquet	17523687 / 16735458 / +4.7%	28884591 / 34118535 / -15.3% 🟢	0.61 / 0.49 / +23.7%
clickbench_q30/duckdb:parquet	94256516 / 92870312 / +1.5%	171742907 / 174116765 / -1.4%	0.55 / 0.53 / +2.9%
clickbench_q31/duckdb:parquet	145322966 / 145028702 / +0.2%	266035767 / 291970308 / -8.9%	0.55 / 0.50 / +10.0%
clickbench_q32/duckdb:parquet	462838996 / 450585456 / +2.7%	521386083 / 531994687 / -2.0%	0.89 / 0.85 / +4.8%
clickbench_q33/duckdb:parquet	447823336 / 449551838 / -0.4%	473780794 / 476103719 / -0.5%	0.95 / 0.94 / +0.1%
clickbench_q34/duckdb:parquet	463652568 / 446528592 / +3.8%	478189548 / 512976524 / -6.8%	0.97 / 0.87 / +11.4%
clickbench_q35/duckdb:parquet	103306184 / 99811428 / +3.5%	128620517 / 125747170 / +2.3%	0.80 / 0.79 / +1.2%
clickbench_q36/duckdb:parquet	31577366 / 31510094 / +0.2%	41668523 / 40819515 / +2.1%	0.76 / 0.77 / -1.8%
clickbench_q37/duckdb:parquet	22860160 / 23043446 / -0.8%	31632026 / 31232513 / +1.3%	0.72 / 0.74 / -2.0%
clickbench_q38/duckdb:parquet	25031576 / 24163536 / +3.6%	36235271 / 33062043 / +9.6%	0.69 / 0.73 / -5.5%
clickbench_q39/duckdb:parquet	56949482 / 56682154 / +0.5%	65445391 / 66011117 / -0.9%	0.87 / 0.86 / +1.3%
clickbench_q40/duckdb:parquet	12953116 / 13119926 / -1.3%	23435269 / 21781451 / +7.6%	0.55 / 0.60 / -8.2%
clickbench_q41/duckdb:parquet	13244248 / 13163920 / +0.6%	22627595 / 22279814 / +1.6%	0.59 / 0.59 / -0.9%
clickbench_q42/duckdb:parquet	14478540 / 14376906 / +0.7%	30396406 / 23757026 / +27.9% 🔴	0.48 / 0.61 / -21.3%

duckdb / duckdb / ns (0.994x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:duckdb	13710654 / 13932080 / -1.6%	14550120 / 14852791 / -2.0%	0.94 / 0.94 / +0.5%
clickbench_q01/duckdb:duckdb	26879380 / 26223730 / +2.5%	35098001 / 36361438 / -3.5%	0.77 / 0.72 / +6.2%
clickbench_q02/duckdb:duckdb	35357351 / 36740936 / -3.8%	51184836 / 53383891 / -4.1%	0.69 / 0.69 / +0.4%
clickbench_q03/duckdb:duckdb	32934859 / 33260512 / -1.0%	49064598 / 53877438 / -8.9%	0.67 / 0.62 / +8.7%
clickbench_q04/duckdb:duckdb	74587800 / 75620054 / -1.4%	97539516 / 104927295 / -7.0%	0.76 / 0.72 / +6.1%
clickbench_q05/duckdb:duckdb	91922780 / 91658519 / +0.3%	127200050 / 124451559 / +2.2%	0.72 / 0.74 / -1.9%
clickbench_q06/duckdb:duckdb	26898854 / 25925170 / +3.8%	34174573 / 36453126 / -6.3%	0.79 / 0.71 / +10.7%
clickbench_q07/duckdb:duckdb	26192668 / 26602932 / -1.5%	36914388 / 37974294 / -2.8%	0.71 / 0.70 / +1.3%
clickbench_q08/duckdb:duckdb	90546112 / 89340402 / +1.3%	121199281 / 129259728 / -6.2%	0.75 / 0.69 / +8.1%
clickbench_q09/duckdb:duckdb	121592183 / 126129988 / -3.6%	171190527 / 174660024 / -2.0%	0.71 / 0.72 / -1.6%
clickbench_q10/duckdb:duckdb	56357659 / 54242014 / +3.9%	78200245 / 80049092 / -2.3%	0.72 / 0.68 / +6.4%
clickbench_q11/duckdb:duckdb	59117500 / 61502760 / -3.9%	88260714 / 89352293 / -1.2%	0.67 / 0.69 / -2.7%
clickbench_q12/duckdb:duckdb	91526950 / 88664206 / +3.2%	146318736 / 126517724 / +15.7% 🔴	0.63 / 0.70 / -10.7%
clickbench_q13/duckdb:duckdb	146005698 / 145473726 / +0.4%	196166135 / 196125301 / +0.0%	0.74 / 0.74 / +0.3%
clickbench_q14/duckdb:duckdb	101497450 / 98648074 / +2.9%	131719193 / 136956696 / -3.8%	0.77 / 0.72 / +7.0%
clickbench_q15/duckdb:duckdb	82590425 / 87297655 / -5.4%	106073534 / 119269496 / -11.1% 🟢	0.78 / 0.73 / +6.4%
clickbench_q16/duckdb:duckdb	169504186 / 168386795 / +0.7%	238947823 / 244107665 / -2.1%	0.71 / 0.69 / +2.8%
clickbench_q17/duckdb:duckdb	171329428 / 168465466 / +1.7%	224268037 / 220768798 / +1.6%	0.76 / 0.76 / +0.1%
clickbench_q18/duckdb:duckdb	315932216 / 328370934 / -3.8%	432818008 / 404350601 / +7.0%	0.73 / 0.81 / -10.1%
clickbench_q19/duckdb:duckdb	27623109 / 26468406 / +4.4%	37960730 / 38433850 / -1.2%	0.73 / 0.69 / +5.7%
clickbench_q20/duckdb:duckdb	276565680 / 296173989 / -6.6%	484379725 / 509896850 / -5.0%	0.57 / 0.58 / -1.7%
clickbench_q21/duckdb:duckdb	302838377 / 304024322 / -0.4%	530239104 / 562110460 / -5.7%	0.57 / 0.54 / +5.6%
clickbench_q22/duckdb:duckdb	346809810 / 377043689 / -8.0%	619411731 / 658741742 / -6.0%	0.56 / 0.57 / -2.2%
clickbench_q23/duckdb:duckdb	181883063 / 183352294 / -0.8%	273627989 / 276504526 / -1.0%	0.66 / 0.66 / +0.2%
clickbench_q24/duckdb:duckdb	45026912 / 44521278 / +1.1%	60756587 / 60609105 / +0.2%	0.74 / 0.73 / +0.9%
clickbench_q25/duckdb:duckdb	60119305 / 59108796 / +1.7%	96311775 / 90602471 / +6.3%	0.62 / 0.65 / -4.3%
clickbench_q26/duckdb:duckdb	42214458 / 44324236 / -4.8%	59242139 / 58525978 / +1.2%	0.71 / 0.76 / -5.9%
clickbench_q27/duckdb:duckdb	280477384 / 284509218 / -1.4%	524722387 / 554448050 / -5.4%	0.53 / 0.51 / +4.2%
clickbench_q28/duckdb:duckdb	842975406 / 840342791 / +0.3%	1259542973 / 1245560543 / +1.1%	0.67 / 0.67 / -0.8%
clickbench_q29/duckdb:duckdb	33242654 / 34928962 / -4.8%	44599025 / 44341790 / +0.6%	0.75 / 0.79 / -5.4%
clickbench_q30/duckdb:duckdb	115665226 / 119897068 / -3.5%	180584476 / 183291569 / -1.5%	0.64 / 0.65 / -2.1%
clickbench_q31/duckdb:duckdb	189038346 / 197145342 / -4.1%	271454844 / 283646860 / -4.3%	0.70 / 0.70 / +0.2%
clickbench_q32/duckdb:duckdb	494410198 / 475451892 / +4.0%	552732426 / 532377057 / +3.8%	0.89 / 0.89 / +0.2%
clickbench_q33/duckdb:duckdb	482356836 / 466099267 / +3.5%	732447407 / 864791182 / -15.3% 🟢	0.66 / 0.54 / +22.2%
clickbench_q34/duckdb:duckdb	479645026 / 469822150 / +2.1%	756171015 / 740785210 / +2.1%	0.63 / 0.63 / +0.0%
clickbench_q35/duckdb:duckdb	97257087 / 97935714 / -0.7%	114377737 / 136921506 / -16.5% 🟢	0.85 / 0.72 / +18.9%
clickbench_q36/duckdb:duckdb	38826131 / 37800084 / +2.7%	50635211 / 49545616 / +2.2%	0.77 / 0.76 / +0.5%
clickbench_q37/duckdb:duckdb	20458134 / 20998148 / -2.6%	28480592 / 28529939 / -0.2%	0.72 / 0.74 / -2.4%
clickbench_q38/duckdb:duckdb	25444108 / 24863154 / +2.3%	47674701 / 36868567 / +29.3% 🔴	0.53 / 0.67 / -20.9%
clickbench_q39/duckdb:duckdb	62035663 / 62356250 / -0.5%	80635480 / 82562367 / -2.3%	0.77 / 0.76 / +1.9%
clickbench_q40/duckdb:duckdb	20404600 / 21214611 / -3.8%	29946445 / 31732111 / -5.6%	0.68 / 0.67 / +1.9%
clickbench_q41/duckdb:duckdb	20477414 / 20558730 / -0.4%	25972992 / 27586484 / -5.8%	0.79 / 0.75 / +5.8%
clickbench_q42/duckdb:duckdb	22006650 / 21799476 / +1.0%	28213878 / 28319767 / -0.4%	0.78 / 0.77 / +1.3%

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)

File	Scale	Format	Base	HEAD	Change	%
duckdb.db	1.0	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%

Totals:

vortex-compact: 7.10 GB → 7.10 GB (-0.0%)
vortex-file-compressed: 11.31 GB → 11.31 GB (0.0%)

github-actions · 2026-10-09T15:21:49Z

Benchmarks: Appian on NVME 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (+1.1%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.992x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.996x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-file-compressed	51888928 / 53294849 / -2.6%	76242456 / 79457833 / -4.0%	0.68 / 0.67 / +1.5%
appian_q02/datafusion:vortex-file-compressed	235055931 / 230409396 / +2.0%	270851335 / 266427622 / +1.7%	0.87 / 0.86 / +0.4%
appian_q03/datafusion:vortex-file-compressed	144399275 / 144390265 / +0.0%	187086388 / 188058320 / -0.5%	0.77 / 0.77 / +0.5%
appian_q04/datafusion:vortex-file-compressed	9870715116 / 9897838669 / -0.3%	9797859369 / 9754385861 / +0.4%	1.01 / 1.01 / -0.7%
appian_q05/datafusion:vortex-file-compressed	137317159 / 136456169 / +0.6%	172122212 / 165570637 / +4.0%	0.80 / 0.82 / -3.2%
appian_q06/datafusion:vortex-file-compressed	142194873 / 142347407 / -0.1%	164312556 / 164924326 / -0.4%	0.87 / 0.86 / +0.3%
appian_q07/datafusion:vortex-file-compressed	159148048 / 158956158 / +0.1%	197582088 / 191422362 / +3.2%	0.81 / 0.83 / -3.0%
appian_q08/datafusion:vortex-file-compressed	555227539 / 564547710 / -1.7%	592454341 / 584147907 / +1.4%	0.94 / 0.97 / -3.0%

datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet	72701533 / 73792847 / -1.5%	92863449 / 96146609 / -3.4%	0.78 / 0.77 / +2.0%
appian_q02/datafusion:parquet	303793025 / 303064677 / +0.2%	332334472 / 334087656 / -0.5%	0.91 / 0.91 / +0.8%
appian_q03/datafusion:parquet	191604299 / 190215512 / +0.7%	231773534 / 230515789 / +0.5%	0.83 / 0.83 / +0.2%
appian_q04/datafusion:parquet	9924721626 / 9949407648 / -0.2%	9763509433 / 9767862327 / -0.0%	1.02 / 1.02 / -0.2%
appian_q05/datafusion:parquet	196843682 / 198253177 / -0.7%	227767705 / 223135699 / +2.1%	0.86 / 0.89 / -2.7%
appian_q06/datafusion:parquet	167947918 / 167241690 / +0.4%	191917129 / 196300202 / -2.2%	0.88 / 0.85 / +2.7%
appian_q07/datafusion:parquet	210154871 / 211039198 / -0.4%	239559906 / 242001688 / -1.0%	0.88 / 0.87 / +0.6%
appian_q08/datafusion:parquet	698328718 / 673293284 / +3.7%	687435090 / 700633863 / -1.9%	1.02 / 0.96 / +5.7%

duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-file-compressed	90174661 / 89207510 / +1.1%	108377027 / 112292161 / -3.5%	0.83 / 0.79 / +4.7%
appian_q02/duckdb:vortex-file-compressed	216786091 / 212099315 / +2.2%	228830824 / 227906967 / +0.4%	0.95 / 0.93 / +1.8%
appian_q03/duckdb:vortex-file-compressed	118113332 / 117637513 / +0.4%	134638206 / 136118633 / -1.1%	0.88 / 0.86 / +1.5%
appian_q04/duckdb:vortex-file-compressed	564038733 / 565420985 / -0.2%	574544371 / 588687354 / -2.4%	0.98 / 0.96 / +2.2%
appian_q05/duckdb:vortex-file-compressed	133272817 / 133469290 / -0.1%	139295426 / 152378206 / -8.6%	0.96 / 0.88 / +9.2%
appian_q06/duckdb:vortex-file-compressed	399542015 / 394813413 / +1.2%	401453824 / 387182511 / +3.7%	1.00 / 1.02 / -2.4%
appian_q07/duckdb:vortex-file-compressed	134896360 / 133216720 / +1.3%	152666174 / 161681538 / -5.6%	0.88 / 0.82 / +7.2%
appian_q08/duckdb:vortex-file-compressed	404933413 / 417752441 / -3.1%	441916945 / 448225427 / -1.4%	0.92 / 0.93 / -1.7%

duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet	99085631 / 100540830 / -1.4%	118959577 / 113983284 / +4.4%	0.83 / 0.88 / -5.6%
appian_q02/duckdb:parquet	196992916 / 200844077 / -1.9%	198605501 / 196868499 / +0.9%	0.99 / 1.02 / -2.8%
appian_q03/duckdb:parquet	124030681 / 124246104 / -0.2%	135067589 / 131988222 / +2.3%	0.92 / 0.94 / -2.4%
appian_q04/duckdb:parquet	439935306 / 444039335 / -0.9%	483685991 / 451170279 / +7.2%	0.91 / 0.98 / -7.6%
appian_q05/duckdb:parquet	144051582 / 143559805 / +0.3%	157532095 / 157847298 / -0.2%	0.91 / 0.91 / +0.5%
appian_q06/duckdb:parquet	272266748 / 260990971 / +4.3%	254183161 / 250724004 / +1.4%	1.07 / 1.04 / +2.9%
appian_q07/duckdb:parquet	153785014 / 154291367 / -0.3%	162763271 / 170220690 / -4.4%	0.94 / 0.91 / +4.2%
appian_q08/duckdb:parquet	371999220 / 390637467 / -4.8%	352188876 / 390294713 / -9.8%	1.06 / 1.00 / +5.5%

duckdb / duckdb / ns (1.005x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:duckdb	89415787 / 89261340 / +0.2%	97507429 / 97337387 / +0.2%	0.92 / 0.92 / -0.0%
appian_q02/duckdb:duckdb	176527434 / 177072856 / -0.3%	186349847 / 184191310 / +1.2%	0.95 / 0.96 / -1.5%
appian_q03/duckdb:duckdb	217623597 / 207778362 / +4.7%	228318386 / 226594180 / +0.8%	0.95 / 0.92 / +3.9%
appian_q04/duckdb:duckdb	434355194 / 441001688 / -1.5%	480716081 / 450987488 / +6.6%	0.90 / 0.98 / -7.6%
appian_q05/duckdb:duckdb	129112980 / 126096548 / +2.4%	141704024 / 146111030 / -3.0%	0.91 / 0.86 / +5.6%
appian_q06/duckdb:duckdb	219058323 / 218212149 / +0.4%	229979192 / 252036615 / -8.8%	0.95 / 0.87 / +10.0%
appian_q07/duckdb:duckdb	137871407 / 137871802 / -0.0%	159446325 / 158652048 / +0.5%	0.86 / 0.87 / -0.5%
appian_q08/duckdb:duckdb	343391355 / 348542362 / -1.5%	343708608 / 363442928 / -5.4%	1.00 / 0.96 / +4.2%

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)

File	Scale	Format	Base	HEAD	Change	%
duckdb.db	1.0	vortex-compact	268.00 KB	0 B	268.00 KB	-100.0%

Totals:

vortex-compact: 271.86 MB → 271.60 MB (-0.1%)
vortex-file-compressed: 517.82 MB → 517.82 MB (0.0%)

github-actions · 2026-10-09T15:22:41Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.004x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.002x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed	24472002 / 24223422 / +1.0%	42743587 / 43424991 / -1.6%	0.57 / 0.56 / +2.6%
tpcds_q02/datafusion:vortex-file-compressed	44697497 / 45067718 / -0.8%	61557728 / 61178308 / +0.6%	0.73 / 0.74 / -1.4%
tpcds_q03/datafusion:vortex-file-compressed	11818742 / 11656553 / +1.4%	28462920 / 28810430 / -1.2%	0.42 / 0.40 / +2.6%
tpcds_q04/datafusion:vortex-file-compressed	111641408 / 112720384 / -1.0%	146553044 / 141811025 / +3.3%	0.76 / 0.79 / -4.2%
tpcds_q05/datafusion:vortex-file-compressed	60497699 / 60186094 / +0.5%	79283965 / 80809485 / -1.9%	0.76 / 0.74 / +2.5%
tpcds_q06/datafusion:vortex-file-compressed	23509632 / 23887528 / -1.6%	45350026 / 44233744 / +2.5%	0.52 / 0.54 / -4.0%
tpcds_q07/datafusion:vortex-file-compressed	32859761 / 32752478 / +0.3%	58164489 / 56190650 / +3.5%	0.56 / 0.58 / -3.1%
tpcds_q08/datafusion:vortex-file-compressed	25654494 / 25523942 / +0.5%	43324209 / 44493600 / -2.6%	0.59 / 0.57 / +3.2%
tpcds_q09/datafusion:vortex-file-compressed	15641076 / 17239395 / -9.3%	33420045 / 34916189 / -4.3%	0.47 / 0.49 / -5.2%
tpcds_q10/datafusion:vortex-file-compressed	28826992 / 28169182 / +2.3%	49454151 / 49396094 / +0.1%	0.58 / 0.57 / +2.2%
tpcds_q11/datafusion:vortex-file-compressed	62319160 / 61463097 / +1.4%	91176486 / 87815516 / +3.8%	0.68 / 0.70 / -2.3%
tpcds_q12/datafusion:vortex-file-compressed	16560442 / 16527126 / +0.2%	32973084 / 32235680 / +2.3%	0.50 / 0.51 / -2.0%
tpcds_q13/datafusion:vortex-file-compressed	33669370 / 33583850 / +0.3%	52536602 / 52323838 / +0.4%	0.64 / 0.64 / -0.2%
tpcds_q14/datafusion:vortex-file-compressed	92495006 / 92953266 / -0.5%	117225524 / 116643427 / +0.5%	0.79 / 0.80 / -1.0%
tpcds_q15/datafusion:vortex-file-compressed	23895606 / 24035556 / -0.6%	43878151 / 42689522 / +2.8%	0.54 / 0.56 / -3.3%
tpcds_q16/datafusion:vortex-file-compressed	20564126 / 20518693 / +0.2%	41441617 / 40673775 / +1.9%	0.50 / 0.50 / -1.6%
tpcds_q17/datafusion:vortex-file-compressed	61545284 / 61133179 / +0.7%	76653557 / 77303288 / -0.8%	0.80 / 0.79 / +1.5%
tpcds_q18/datafusion:vortex-file-compressed	68724058 / 68418778 / +0.4%	94437284 / 93373441 / +1.1%	0.73 / 0.73 / -0.7%
tpcds_q19/datafusion:vortex-file-compressed	18786514 / 18359868 / +2.3%	40360231 / 38852725 / +3.9%	0.47 / 0.47 / -1.5%
tpcds_q20/datafusion:vortex-file-compressed	17306412 / 17753816 / -2.5%	34744992 / 34086146 / +1.9%	0.50 / 0.52 / -4.4%
tpcds_q21/datafusion:vortex-file-compressed	17715624 / 16850476 / +5.1%	39970687 / 38713818 / +3.2%	0.44 / 0.44 / +1.8%
tpcds_q22/datafusion:vortex-file-compressed	51125284 / 49946073 / +2.4%	71387694 / 70204246 / +1.7%	0.72 / 0.71 / +0.7%
tpcds_q23/datafusion:vortex-file-compressed	72473330 / 73114280 / -0.9%	101300774 / 99123962 / +2.2%	0.72 / 0.74 / -3.0%
tpcds_q24/datafusion:vortex-file-compressed	70322270 / 70739934 / -0.6%	94891522 / 95780152 / -0.9%	0.74 / 0.74 / +0.3%
tpcds_q25/datafusion:vortex-file-compressed	52337316 / 56165868 / -6.8%	80690790 / 85457690 / -5.6%	0.65 / 0.66 / -1.3%
tpcds_q26/datafusion:vortex-file-compressed	30072841 / 30145081 / -0.2%	54088585 / 51839798 / +4.3%	0.56 / 0.58 / -4.4%
tpcds_q27/datafusion:vortex-file-compressed	64133548 / 64346884 / -0.3%	87060003 / 88757312 / -1.9%	0.74 / 0.72 / +1.6%
tpcds_q28/datafusion:vortex-file-compressed	17865038 / 17855500 / +0.1%	38914501 / 36952387 / +5.3%	0.46 / 0.48 / -5.0%
tpcds_q29/datafusion:vortex-file-compressed	57936156 / 53279720 / +8.7%	81660159 / 75635375 / +8.0%	0.71 / 0.70 / +0.7%
tpcds_q30/datafusion:vortex-file-compressed	27702026 / 27153938 / +2.0%	45226399 / 45207918 / +0.0%	0.61 / 0.60 / +2.0%
tpcds_q31/datafusion:vortex-file-compressed	64441600 / 64170516 / +0.4%	90698659 / 91059366 / -0.4%	0.71 / 0.70 / +0.8%
tpcds_q32/datafusion:vortex-file-compressed	13354084 / 13520959 / -1.2%	31663514 / 31728767 / -0.2%	0.42 / 0.43 / -1.0%
tpcds_q33/datafusion:vortex-file-compressed	27195184 / 27251753 / -0.2%	49002721 / 49022101 / -0.0%	0.55 / 0.56 / -0.2%
tpcds_q34/datafusion:vortex-file-compressed	18395218 / 18206176 / +1.0%	39808800 / 37918205 / +5.0%	0.46 / 0.48 / -3.8%
tpcds_q35/datafusion:vortex-file-compressed	35928962 / 35467798 / +1.3%	56919718 / 59062262 / -3.6%	0.63 / 0.60 / +5.1%
tpcds_q36/datafusion:vortex-file-compressed	47678838 / 48143728 / -1.0%	73745770 / 74498660 / -1.0%	0.65 / 0.65 / +0.0%
tpcds_q37/datafusion:vortex-file-compressed	14493084 / 13088696 / +10.7% 🔴	34856438 / 33965138 / +2.6%	0.42 / 0.39 / +7.9%
tpcds_q38/datafusion:vortex-file-compressed	29469500 / 29912896 / -1.5%	52421386 / 52698209 / -0.5%	0.56 / 0.57 / -1.0%
tpcds_q39/datafusion:vortex-file-compressed	64589740 / 65712729 / -1.7%	90148416 / 92357764 / -2.4%	0.72 / 0.71 / +0.7%
tpcds_q40/datafusion:vortex-file-compressed	24598982 / 24729766 / -0.5%	45360534 / 44405676 / +2.2%	0.54 / 0.56 / -2.6%
tpcds_q41/datafusion:vortex-file-compressed	16549551 / 16393538 / +1.0%	31407965 / 31019030 / +1.3%	0.53 / 0.53 / -0.3%
tpcds_q42/datafusion:vortex-file-compressed	11284352 / 11226813 / +0.5%	26413444 / 27530332 / -4.1%	0.43 / 0.41 / +4.8%
tpcds_q43/datafusion:vortex-file-compressed	13499200 / 13420526 / +0.6%	32209549 / 31582591 / +2.0%	0.42 / 0.42 / -1.4%
tpcds_q44/datafusion:vortex-file-compressed	25968466 / 26217243 / -0.9%	49914877 / 48677800 / +2.5%	0.52 / 0.54 / -3.4%
tpcds_q45/datafusion:vortex-file-compressed	27301107 / 27309296 / -0.0%	47757985 / 47243754 / +1.1%	0.57 / 0.58 / -1.1%
tpcds_q46/datafusion:vortex-file-compressed	24633613 / 24314218 / +1.3%	47257185 / 48324526 / -2.2%	0.52 / 0.50 / +3.6%
tpcds_q47/datafusion:vortex-file-compressed	78209854 / 77739474 / +0.6%	106448367 / 106881817 / -0.4%	0.73 / 0.73 / +1.0%
tpcds_q48/datafusion:vortex-file-compressed	30762994 / 30701796 / +0.2%	51793438 / 50873982 / +1.8%	0.59 / 0.60 / -1.6%
tpcds_q49/datafusion:vortex-file-compressed	63234240 / 60090317 / +5.2%	81116719 / 89040395 / -8.9%	0.78 / 0.67 / +15.5%
tpcds_q50/datafusion:vortex-file-compressed	34662179 / 34478438 / +0.5%	54300120 / 54911626 / -1.1%	0.64 / 0.63 / +1.7%
tpcds_q51/datafusion:vortex-file-compressed	60550185 / 60724604 / -0.3%	83933777 / 82757839 / +1.4%	0.72 / 0.73 / -1.7%
tpcds_q52/datafusion:vortex-file-compressed	11495640 / 11890310 / -3.3%	28763331 / 28169413 / +2.1%	0.40 / 0.42 / -5.3%
tpcds_q53/datafusion:vortex-file-compressed	18336926 / 18344167 / -0.0%	38285942 / 37951369 / +0.9%	0.48 / 0.48 / -0.9%
tpcds_q54/datafusion:vortex-file-compressed	33230650 / 33976400 / -2.2%	61027830 / 56950456 / +7.2%	0.54 / 0.60 / -8.7%
tpcds_q55/datafusion:vortex-file-compressed	11586663 / 11118484 / +4.2%	27944269 / 27027315 / +3.4%	0.41 / 0.41 / +0.8%
tpcds_q56/datafusion:vortex-file-compressed	27071724 / 27030462 / +0.2%	46801823 / 46673917 / +0.3%	0.58 / 0.58 / -0.1%
tpcds_q57/datafusion:vortex-file-compressed	73488484 / 73578555 / -0.1%	98969863 / 96443301 / +2.6%	0.74 / 0.76 / -2.7%
tpcds_q58/datafusion:vortex-file-compressed	40777458 / 40961180 / -0.4%	66746624 / 65945799 / +1.2%	0.61 / 0.62 / -1.6%
tpcds_q59/datafusion:vortex-file-compressed	32282858 / 31955894 / +1.0%	53079456 / 53452546 / -0.7%	0.61 / 0.60 / +1.7%
tpcds_q60/datafusion:vortex-file-compressed	26671620 / 26708035 / -0.1%	48623506 / 47162540 / +3.1%	0.55 / 0.57 / -3.1%
tpcds_q61/datafusion:vortex-file-compressed	24463948 / 24049834 / +1.7%	47096439 / 44803860 / +5.1%	0.52 / 0.54 / -3.2%
tpcds_q62/datafusion:vortex-file-compressed	17039276 / 17133056 / -0.5%	35517410 / 35241561 / +0.8%	0.48 / 0.49 / -1.3%
tpcds_q63/datafusion:vortex-file-compressed	18687720 / 18300530 / +2.1%	37942204 / 36937223 / +2.7%	0.49 / 0.50 / -0.6%
tpcds_q64/datafusion:vortex-file-compressed	323754995 / 322241934 / +0.5%	347999269 / 357704255 / -2.7%	0.93 / 0.90 / +3.3%
tpcds_q65/datafusion:vortex-file-compressed	74037396 / 76717788 / -3.5%	95710627 / 94116178 / +1.7%	0.77 / 0.82 / -5.1%
tpcds_q66/datafusion:vortex-file-compressed	52658785 / 52846922 / -0.4%	74377914 / 73054294 / +1.8%	0.71 / 0.72 / -2.1%
tpcds_q67/datafusion:vortex-file-compressed	56396784 / 56240220 / +0.3%	86160149 / 85551066 / +0.7%	0.65 / 0.66 / -0.4%
tpcds_q68/datafusion:vortex-file-compressed	23695930 / 24912900 / -4.9%	47548586 / 46305792 / +2.7%	0.50 / 0.54 / -7.4%
tpcds_q69/datafusion:vortex-file-compressed	28331030 / 27952022 / +1.4%	49885362 / 47508659 / +5.0%	0.57 / 0.59 / -3.5%
tpcds_q70/datafusion:vortex-file-compressed	71388975 / 71437356 / -0.1%	93293640 / 92503391 / +0.9%	0.77 / 0.77 / -0.9%
tpcds_q71/datafusion:vortex-file-compressed	20056810 / 18277944 / +9.7%	39348582 / 39492174 / -0.4%	0.51 / 0.46 / +10.1%
tpcds_q72/datafusion:vortex-file-compressed	474722278 / 454138170 / +4.5%	496893149 / 520573672 / -4.5%	0.96 / 0.87 / +9.5%
tpcds_q73/datafusion:vortex-file-compressed	17187790 / 17158725 / +0.2%	38988844 / 37366697 / +4.3%	0.44 / 0.46 / -4.0%
tpcds_q74/datafusion:vortex-file-compressed	45594730 / 45200106 / +0.9%	69772311 / 69792247 / -0.0%	0.65 / 0.65 / +0.9%
tpcds_q75/datafusion:vortex-file-compressed	130262460 / 129819092 / +0.3%	168998962 / 159772194 / +5.8%	0.77 / 0.81 / -5.1%
tpcds_q76/datafusion:vortex-file-compressed	42740898 / 42582449 / +0.4%	63228528 / 64769040 / -2.4%	0.68 / 0.66 / +2.8%
tpcds_q77/datafusion:vortex-file-compressed	34722898 / 37730543 / -8.0%	58208220 / 59442897 / -2.1%	0.60 / 0.63 / -6.0%
tpcds_q78/datafusion:vortex-file-compressed	78853107 / 79585692 / -0.9%	111388673 / 106350941 / +4.7%	0.71 / 0.75 / -5.4%
tpcds_q79/datafusion:vortex-file-compressed	21329008 / 20914406 / +2.0%	42580852 / 42099804 / +1.1%	0.50 / 0.50 / +0.8%
tpcds_q80/datafusion:vortex-file-compressed	77015818 / 76984924 / +0.0%	109775039 / 110406035 / -0.6%	0.70 / 0.70 / +0.6%
tpcds_q81/datafusion:vortex-file-compressed	27980951 / 27730084 / +0.9%	46909039 / 45107769 / +4.0%	0.60 / 0.61 / -3.0%
tpcds_q82/datafusion:vortex-file-compressed	12956296 / 14218510 / -8.9%	35601445 / 33930103 / +4.9%	0.36 / 0.42 / -13.2%
tpcds_q83/datafusion:vortex-file-compressed	36524133 / 35955114 / +1.6%	57959760 / 57729530 / +0.4%	0.63 / 0.62 / +1.2%
tpcds_q84/datafusion:vortex-file-compressed	11780158 / 11909414 / -1.1%	29085076 / 27920637 / +4.2%	0.41 / 0.43 / -5.0%
tpcds_q85/datafusion:vortex-file-compressed	58680418 / 59597346 / -1.5%	83542922 / 82124041 / +1.7%	0.70 / 0.73 / -3.2%
tpcds_q86/datafusion:vortex-file-compressed	16581003 / 16449310 / +0.8%	33134092 / 32471350 / +2.0%	0.50 / 0.51 / -1.2%
tpcds_q87/datafusion:vortex-file-compressed	29544292 / 29590229 / -0.2%	50770197 / 52521202 / -3.3%	0.58 / 0.56 / +3.3%
tpcds_q88/datafusion:vortex-file-compressed	34535866 / 34210954 / +0.9%	62325784 / 61247665 / +1.8%	0.55 / 0.56 / -0.8%
tpcds_q89/datafusion:vortex-file-compressed	21020564 / 21042229 / -0.1%	41778083 / 40330821 / +3.6%	0.50 / 0.52 / -3.6%
tpcds_q90/datafusion:vortex-file-compressed	10474020 / 10357146 / +1.1%	27171343 / 26003511 / +4.5%	0.39 / 0.40 / -3.2%
tpcds_q91/datafusion:vortex-file-compressed	15984182 / 16922692 / -5.5%	36192363 / 32771224 / +10.4% 🔴	0.44 / 0.52 / -14.5%
tpcds_q92/datafusion:vortex-file-compressed	13967390 / 13211454 / +5.7%	31834993 / 30848014 / +3.2%	0.44 / 0.43 / +2.4%
tpcds_q93/datafusion:vortex-file-compressed	23720352 / 23949905 / -1.0%	44958678 / 45260485 / -0.7%	0.53 / 0.53 / -0.3%
tpcds_q94/datafusion:vortex-file-compressed	19702010 / 19286888 / +2.2%	39732771 / 38296334 / +3.8%	0.50 / 0.50 / -1.5%
tpcds_q95/datafusion:vortex-file-compressed	45941982 / 45759799 / +0.4%	67141514 / 68220345 / -1.6%	0.68 / 0.67 / +2.0%
tpcds_q96/datafusion:vortex-file-compressed	9484796 / 9482400 / +0.0%	25864389 / 24678159 / +4.8%	0.37 / 0.38 / -4.6%
tpcds_q97/datafusion:vortex-file-compressed	21107266 / 20978646 / +0.6%	42520567 / 41124169 / +3.4%	0.50 / 0.51 / -2.7%
tpcds_q98/datafusion:vortex-file-compressed	16869328 / 16885240 / -0.1%	36205142 / 34522714 / +4.9%	0.47 / 0.49 / -4.7%
tpcds_q99/datafusion:vortex-file-compressed	19252037 / 19640984 / -2.0%	37485404 / 37052150 / +1.2%	0.51 / 0.53 / -3.1%

datafusion / vortex-compact / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact	25574982 / 25993858 / -1.6%	43414472 / 43654916 / -0.6%	0.59 / 0.60 / -1.1%
tpcds_q02/datafusion:vortex-compact	48640298 / 48965328 / -0.7%	65517239 / 65580040 / -0.1%	0.74 / 0.75 / -0.6%
tpcds_q03/datafusion:vortex-compact	13078311 / 12665804 / +3.3%	32222328 / 31422438 / +2.5%	0.41 / 0.40 / +0.7%
tpcds_q04/datafusion:vortex-compact	123998724 / 122501404 / +1.2%	147757776 / 151092882 / -2.2%	0.84 / 0.81 / +3.5%
tpcds_q05/datafusion:vortex-compact	61968451 / 62659290 / -1.1%	82206119 / 84051307 / -2.2%	0.75 / 0.75 / +1.1%
tpcds_q06/datafusion:vortex-compact	25501542 / 26355011 / -3.2%	47287483 / 46633086 / +1.4%	0.54 / 0.57 / -4.6%
tpcds_q07/datafusion:vortex-compact	35840779 / 34006602 / +5.4%	56010476 / 53932076 / +3.9%	0.64 / 0.63 / +1.5%
tpcds_q08/datafusion:vortex-compact	30851973 / 30396112 / +1.5%	48419640 / 48101083 / +0.7%	0.64 / 0.63 / +0.8%
tpcds_q09/datafusion:vortex-compact	22841940 / 22077246 / +3.5%	40710271 / 39558621 / +2.9%	0.56 / 0.56 / +0.5%
tpcds_q10/datafusion:vortex-compact	37840090 / 36591793 / +3.4%	59470740 / 57222540 / +3.9%	0.64 / 0.64 / -0.5%
tpcds_q11/datafusion:vortex-compact	69524230 / 69348652 / +0.3%	97496357 / 93651921 / +4.1%	0.71 / 0.74 / -3.7%
tpcds_q12/datafusion:vortex-compact	21010495 / 20765074 / +1.2%	38193775 / 38052625 / +0.4%	0.55 / 0.55 / +0.8%
tpcds_q13/datafusion:vortex-compact	54733312 / 53879027 / +1.6%	73959539 / 74598787 / -0.9%	0.74 / 0.72 / +2.5%
tpcds_q14/datafusion:vortex-compact	95620035 / 97209967 / -1.6%	121555150 / 120765190 / +0.7%	0.79 / 0.80 / -2.3%
tpcds_q15/datafusion:vortex-compact	27248598 / 26656541 / +2.2%	46313557 / 45051898 / +2.8%	0.59 / 0.59 / -0.6%
tpcds_q16/datafusion:vortex-compact	23303526 / 24533350 / -5.0%	43516380 / 43018984 / +1.2%	0.54 / 0.57 / -6.1%
tpcds_q17/datafusion:vortex-compact	63811358 / 68468197 / -6.8%	91761362 / 92340614 / -0.6%	0.70 / 0.74 / -6.2%
tpcds_q18/datafusion:vortex-compact	68985106 / 70438104 / -2.1%	95236420 / 91724068 / +3.8%	0.72 / 0.77 / -5.7%
tpcds_q19/datafusion:vortex-compact	23653792 / 21977914 / +7.6%	42396453 / 41960956 / +1.0%	0.56 / 0.52 / +6.5%
tpcds_q20/datafusion:vortex-compact	22302596 / 22405048 / -0.5%	42104763 / 40630101 / +3.6%	0.53 / 0.55 / -3.9%
tpcds_q21/datafusion:vortex-compact	19404140 / 18183472 / +6.7%	41813094 / 39457666 / +6.0%	0.46 / 0.46 / +0.7%
tpcds_q22/datafusion:vortex-compact	50302734 / 50019196 / +0.6%	73921777 / 71451481 / +3.5%	0.68 / 0.70 / -2.8%
tpcds_q23/datafusion:vortex-compact	76258726 / 76485768 / -0.3%	105482065 / 100191667 / +5.3%	0.72 / 0.76 / -5.3%
tpcds_q24/datafusion:vortex-compact	77794617 / 77711621 / +0.1%	99152342 / 100295290 / -1.1%	0.78 / 0.77 / +1.3%
tpcds_q25/datafusion:vortex-compact	63486562 / 61341151 / +3.5%	91658689 / 86464169 / +6.0%	0.69 / 0.71 / -2.4%
tpcds_q26/datafusion:vortex-compact	32711638 / 32574022 / +0.4%	52094184 / 51479279 / +1.2%	0.63 / 0.63 / -0.8%
tpcds_q27/datafusion:vortex-compact	63680964 / 63792249 / -0.2%	88877682 / 85376448 / +4.1%	0.72 / 0.75 / -4.1%
tpcds_q28/datafusion:vortex-compact	28478211 / 27691996 / +2.8%	47844824 / 49372826 / -3.1%	0.60 / 0.56 / +6.1%
tpcds_q29/datafusion:vortex-compact	65292702 / 67673740 / -3.5%	83434224 / 81695565 / +2.1%	0.78 / 0.83 / -5.5%
tpcds_q30/datafusion:vortex-compact	30414398 / 30556698 / -0.5%	48920017 / 47898642 / +2.1%	0.62 / 0.64 / -2.5%
tpcds_q31/datafusion:vortex-compact	79345912 / 80252138 / -1.1%	100148970 / 103672065 / -3.4%	0.79 / 0.77 / +2.3%
tpcds_q32/datafusion:vortex-compact	16509425 / 16544068 / -0.2%	34190095 / 37269822 / -8.3%	0.48 / 0.44 / +8.8%
tpcds_q33/datafusion:vortex-compact	27673590 / 28937353 / -4.4%	50582360 / 48016334 / +5.3%	0.55 / 0.60 / -9.2%
tpcds_q34/datafusion:vortex-compact	20911188 / 20675810 / +1.1%	41937283 / 41218250 / +1.7%	0.50 / 0.50 / -0.6%
tpcds_q35/datafusion:vortex-compact	41922948 / 40835113 / +2.7%	65513070 / 66662174 / -1.7%	0.64 / 0.61 / +4.5%
tpcds_q36/datafusion:vortex-compact	50731974 / 50900918 / -0.3%	78583987 / 74818358 / +5.0%	0.65 / 0.68 / -5.1%
tpcds_q37/datafusion:vortex-compact	15493163 / 15565792 / -0.5%	37780014 / 36718016 / +2.9%	0.41 / 0.42 / -3.3%
tpcds_q38/datafusion:vortex-compact	33572730 / 33905224 / -1.0%	56443398 / 58637224 / -3.7%	0.59 / 0.58 / +2.9%
tpcds_q39/datafusion:vortex-compact	67425936 / 66095258 / +2.0%	88241589 / 88921730 / -0.8%	0.76 / 0.74 / +2.8%
tpcds_q40/datafusion:vortex-compact	27605452 / 28583179 / -3.4%	51130421 / 50263955 / +1.7%	0.54 / 0.57 / -5.1%
tpcds_q41/datafusion:vortex-compact	18285316 / 18620292 / -1.8%	33479720 / 32195377 / +4.0%	0.55 / 0.58 / -5.6%
tpcds_q42/datafusion:vortex-compact	12919142 / 12792590 / +1.0%	31532866 / 30241986 / +4.3%	0.41 / 0.42 / -3.1%
tpcds_q43/datafusion:vortex-compact	15839220 / 16088736 / -1.6%	33419112 / 32810035 / +1.9%	0.47 / 0.49 / -3.3%
tpcds_q44/datafusion:vortex-compact	30575424 / 31166234 / -1.9%	51769182 / 51364360 / +0.8%	0.59 / 0.61 / -2.7%
tpcds_q45/datafusion:vortex-compact	30561060 / 30545778 / +0.1%	49697974 / 50585277 / -1.8%	0.61 / 0.60 / +1.8%
tpcds_q46/datafusion:vortex-compact	28440720 / 28242452 / +0.7%	49876483 / 54653338 / -8.7%	0.57 / 0.52 / +10.3%
tpcds_q47/datafusion:vortex-compact	89136596 / 87714199 / +1.6%	115601416 / 115929199 / -0.3%	0.77 / 0.76 / +1.9%
tpcds_q48/datafusion:vortex-compact	50614726 / 55499434 / -8.8%	69881506 / 67392420 / +3.7%	0.72 / 0.82 / -12.0%
tpcds_q49/datafusion:vortex-compact	65762726 / 65999884 / -0.4%	86382054 / 87362161 / -1.1%	0.76 / 0.76 / +0.8%
tpcds_q50/datafusion:vortex-compact	36253090 / 36081256 / +0.5%	58182671 / 56795736 / +2.4%	0.62 / 0.64 / -1.9%
tpcds_q51/datafusion:vortex-compact	63393166 / 62765510 / +1.0%	85347741 / 85717899 / -0.4%	0.74 / 0.73 / +1.4%
tpcds_q52/datafusion:vortex-compact	13609442 / 12892653 / +5.6%	32216523 / 30943186 / +4.1%	0.42 / 0.42 / +1.4%
tpcds_q53/datafusion:vortex-compact	23273500 / 21908578 / +6.2%	42743440 / 40937150 / +4.4%	0.54 / 0.54 / +1.7%
tpcds_q54/datafusion:vortex-compact	39043586 / 40361286 / -3.3%	63960041 / 63352821 / +1.0%	0.61 / 0.64 / -4.2%
tpcds_q55/datafusion:vortex-compact	13050862 / 12730108 / +2.5%	30632354 / 32189781 / -4.8%	0.43 / 0.40 / +7.7%
tpcds_q56/datafusion:vortex-compact	27905691 / 27911864 / -0.0%	50564815 / 49764049 / +1.6%	0.55 / 0.56 / -1.6%
tpcds_q57/datafusion:vortex-compact	81441512 / 80814691 / +0.8%	107878609 / 104295669 / +3.4%	0.75 / 0.77 / -2.6%
tpcds_q58/datafusion:vortex-compact	48137738 / 48817975 / -1.4%	72330941 / 71826290 / +0.7%	0.67 / 0.68 / -2.1%
tpcds_q59/datafusion:vortex-compact	41841401 / 41311679 / +1.3%	62355915 / 61489235 / +1.4%	0.67 / 0.67 / -0.1%
tpcds_q60/datafusion:vortex-compact	29514209 / 28357124 / +4.1%	50366176 / 50799586 / -0.9%	0.59 / 0.56 / +5.0%
tpcds_q61/datafusion:vortex-compact	27936487 / 26815687 / +4.2%	49049997 / 50605456 / -3.1%	0.57 / 0.53 / +7.5%
tpcds_q62/datafusion:vortex-compact	18128236 / 17769069 / +2.0%	35385529 / 34895257 / +1.4%	0.51 / 0.51 / +0.6%
tpcds_q63/datafusion:vortex-compact	23152842 / 21920188 / +5.6%	43718212 / 41017786 / +6.6%	0.53 / 0.53 / -0.9%
tpcds_q64/datafusion:vortex-compact	452846429 / 451888945 / +0.2%	455569781 / 451175629 / +1.0%	0.99 / 1.00 / -0.8%
tpcds_q65/datafusion:vortex-compact	81187438 / 81962225 / -0.9%	102187481 / 97610179 / +4.7%	0.79 / 0.84 / -5.4%
tpcds_q66/datafusion:vortex-compact	54849380 / 55164376 / -0.6%	77955350 / 76205033 / +2.3%	0.70 / 0.72 / -2.8%
tpcds_q67/datafusion:vortex-compact	60713487 / 60119026 / +1.0%	88830980 / 88378945 / +0.5%	0.68 / 0.68 / +0.5%
tpcds_q68/datafusion:vortex-compact	27727276 / 27871480 / -0.5%	56024507 / 50593381 / +10.7% 🔴	0.49 / 0.55 / -10.2%
tpcds_q69/datafusion:vortex-compact	37790310 / 36376200 / +3.9%	58533442 / 58011278 / +0.9%	0.65 / 0.63 / +3.0%
tpcds_q70/datafusion:vortex-compact	76070986 / 76808660 / -1.0%	97767027 / 95691238 / +2.2%	0.78 / 0.80 / -3.1%
tpcds_q71/datafusion:vortex-compact	20386504 / 20184896 / +1.0%	39071386 / 40942832 / -4.6%	0.52 / 0.49 / +5.8%
tpcds_q72/datafusion:vortex-compact	469921088 / 492938594 / -4.7%	483732816 / 490137071 / -1.3%	0.97 / 1.01 / -3.4%
tpcds_q73/datafusion:vortex-compact	19706880 / 21371974 / -7.8%	40413732 / 38654317 / +4.6%	0.49 / 0.55 / -11.8%
tpcds_q74/datafusion:vortex-compact	51677268 / 50100419 / +3.1%	73688783 / 74190778 / -0.7%	0.70 / 0.68 / +3.9%
tpcds_q75/datafusion:vortex-compact	144508384 / 140045400 / +3.2%	168991507 / 165263187 / +2.3%	0.86 / 0.85 / +0.9%
tpcds_q76/datafusion:vortex-compact	42676179 / 41832239 / +2.0%	66593584 / 62055548 / +7.3%	0.64 / 0.67 / -4.9%
tpcds_q77/datafusion:vortex-compact	37205552 / 37337592 / -0.4%	62735177 / 61682701 / +1.7%	0.59 / 0.61 / -2.0%
tpcds_q78/datafusion:vortex-compact	85590871 / 86683590 / -1.3%	111965694 / 112444113 / -0.4%	0.76 / 0.77 / -0.8%
tpcds_q79/datafusion:vortex-compact	24598074 / 24625047 / -0.1%	44077039 / 51351155 / -14.2% 🟢	0.56 / 0.48 / +16.4%
tpcds_q80/datafusion:vortex-compact	79413762 / 79190948 / +0.3%	107362806 / 111197898 / -3.4%	0.74 / 0.71 / +3.9%
tpcds_q81/datafusion:vortex-compact	30278444 / 29697454 / +2.0%	46967171 / 46432248 / +1.2%	0.64 / 0.64 / +0.8%
tpcds_q82/datafusion:vortex-compact	15487444 / 15201418 / +1.9%	40258455 / 40354536 / -0.2%	0.38 / 0.38 / +2.1%
tpcds_q83/datafusion:vortex-compact	36912557 / 37020282 / -0.3%	61617963 / 58898516 / +4.6%	0.60 / 0.63 / -4.7%
tpcds_q84/datafusion:vortex-compact	12838101 / 12975344 / -1.1%	29637112 / 28033649 / +5.7%	0.43 / 0.46 / -6.4%
tpcds_q85/datafusion:vortex-compact	102902386 / 102971729 / -0.1%	126121377 / 128916736 / -2.2%	0.82 / 0.80 / +2.1%
tpcds_q86/datafusion:vortex-compact	17384524 / 17584560 / -1.1%	35306241 / 34109514 / +3.5%	0.49 / 0.52 / -4.5%
tpcds_q87/datafusion:vortex-compact	33917618 / 34056841 / -0.4%	57708990 / 57765405 / -0.1%	0.59 / 0.59 / -0.3%
tpcds_q88/datafusion:vortex-compact	41179541 / 40650512 / +1.3%	69267731 / 65746646 / +5.4%	0.59 / 0.62 / -3.8%
tpcds_q89/datafusion:vortex-compact	25408006 / 25700896 / -1.1%	46299404 / 46424070 / -0.3%	0.55 / 0.55 / -0.9%
tpcds_q90/datafusion:vortex-compact	11183683 / 11181998 / +0.0%	26845304 / 26583238 / +1.0%	0.42 / 0.42 / -1.0%
tpcds_q91/datafusion:vortex-compact	27108208 / 27005968 / +0.4%	46087873 / 44288896 / +4.1%	0.59 / 0.61 / -3.5%
tpcds_q92/datafusion:vortex-compact	15715546 / 15808290 / -0.6%	32912115 / 33432946 / -1.6%	0.48 / 0.47 / +1.0%
tpcds_q93/datafusion:vortex-compact	26332807 / 25369713 / +3.8%	47308184 / 44467341 / +6.4%	0.56 / 0.57 / -2.4%
tpcds_q94/datafusion:vortex-compact	22235764 / 22600513 / -1.6%	41028630 / 39918623 / +2.8%	0.54 / 0.57 / -4.3%
tpcds_q95/datafusion:vortex-compact	49612730 / 50029842 / -0.8%	68307463 / 70373741 / -2.9%	0.73 / 0.71 / +2.2%
tpcds_q96/datafusion:vortex-compact	11371954 / 10690312 / +6.4%	26382258 / 25802120 / +2.2%	0.43 / 0.41 / +4.0%
tpcds_q97/datafusion:vortex-compact	24343452 / 24825702 / -1.9%	44466463 / 43213995 / +2.9%	0.55 / 0.57 / -4.7%
tpcds_q98/datafusion:vortex-compact	22116528 / 22353646 / -1.1%	42903567 / 41708685 / +2.9%	0.52 / 0.54 / -3.8%
tpcds_q99/datafusion:vortex-compact	21582398 / 21039954 / +2.6%	38777020 / 38319097 / +1.2%	0.56 / 0.55 / +1.4%

datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet	31652208 / 31591156 / +0.2%	51255130 / 49831978 / +2.9%	0.62 / 0.63 / -2.6%
tpcds_q02/datafusion:parquet	39757432 / 39794594 / -0.1%	59965670 / 57816006 / +3.7%	0.66 / 0.69 / -3.7%
tpcds_q03/datafusion:parquet	16436450 / 16168274 / +1.7%	31891941 / 30139985 / +5.8%	0.52 / 0.54 / -3.9%
tpcds_q04/datafusion:parquet	199951212 / 200137245 / -0.1%	229481248 / 225653108 / +1.7%	0.87 / 0.89 / -1.8%
tpcds_q05/datafusion:parquet	73421126 / 71585642 / +2.6%	99250623 / 94055907 / +5.5%	0.74 / 0.76 / -2.8%
tpcds_q06/datafusion:parquet	28615290 / 28517142 / +0.3%	50511070 / 48499042 / +4.1%	0.57 / 0.59 / -3.7%
tpcds_q07/datafusion:parquet	47722504 / 45923396 / +3.9%	68240691 / 67041542 / +1.8%	0.70 / 0.68 / +2.1%
tpcds_q08/datafusion:parquet	30177184 / 30436199 / -0.9%	50190254 / 47420903 / +5.8%	0.60 / 0.64 / -6.3%
tpcds_q09/datafusion:parquet	32309809 / 31385614 / +2.9%	45325563 / 38129658 / +18.9% 🔴	0.71 / 0.82 / -13.4%
tpcds_q10/datafusion:parquet	43116608 / 41858844 / +3.0%	62004017 / 60631988 / +2.3%	0.70 / 0.69 / +0.7%
tpcds_q11/datafusion:parquet	95642282 / 94516484 / +1.2%	122708772 / 120222569 / +2.1%	0.78 / 0.79 / -0.9%
tpcds_q12/datafusion:parquet	21521138 / 21695845 / -0.8%	36636012 / 35382296 / +3.5%	0.59 / 0.61 / -4.2%
tpcds_q13/datafusion:parquet	42105445 / 42825130 / -1.7%	70731863 / 67147996 / +5.3%	0.60 / 0.64 / -6.7%
tpcds_q14/datafusion:parquet	126566847 / 125220898 / +1.1%	148702868 / 150514031 / -1.2%	0.85 / 0.83 / +2.3%
tpcds_q15/datafusion:parquet	32703322 / 33301866 / -1.8%	52075194 / 49922390 / +4.3%	0.63 / 0.67 / -5.9%
tpcds_q16/datafusion:parquet	37836463 / 37257649 / +1.6%	56067871 / 54900341 / +2.1%	0.67 / 0.68 / -0.6%
tpcds_q17/datafusion:parquet	76898075 / 77095176 / -0.3%	104349468 / 103670973 / +0.7%	0.74 / 0.74 / -0.9%
tpcds_q18/datafusion:parquet	60645322 / 61799628 / -1.9%	81044920 / 82423748 / -1.7%	0.75 / 0.75 / -0.2%
tpcds_q19/datafusion:parquet	25897224 / 26039939 / -0.5%	46421369 / 46851972 / -0.9%	0.56 / 0.56 / +0.4%
tpcds_q20/datafusion:parquet	22849128 / 23733868 / -3.7%	36937602 / 36325973 / +1.7%	0.62 / 0.65 / -5.3%
tpcds_q21/datafusion:parquet	18395298 / 18277108 / +0.6%	34327922 / 32542718 / +5.5%	0.54 / 0.56 / -4.6%
tpcds_q22/datafusion:parquet	76723940 / 74778075 / +2.6%	92686634 / 90166195 / +2.8%	0.83 / 0.83 / -0.2%
tpcds_q23/datafusion:parquet	109666581 / 107162551 / +2.3%	142396808 / 139674282 / +1.9%	0.77 / 0.77 / +0.4%
tpcds_q24/datafusion:parquet	96550633 / 95951904 / +0.6%	122140496 / 123013726 / -0.7%	0.79 / 0.78 / +1.3%
tpcds_q25/datafusion:parquet	78864732 / 78559948 / +0.4%	105366565 / 104713096 / +0.6%	0.75 / 0.75 / -0.2%
tpcds_q26/datafusion:parquet	44463066 / 43294031 / +2.7%	62347462 / 62324414 / +0.0%	0.71 / 0.69 / +2.7%
tpcds_q27/datafusion:parquet	73847212 / 76315746 / -3.2%	101118385 / 96168381 / +5.1%	0.73 / 0.79 / -8.0%
tpcds_q28/datafusion:parquet	27490575 / 27175460 / +1.2%	43820806 / 43604296 / +0.5%	0.63 / 0.62 / +0.7%
tpcds_q29/datafusion:parquet	80209990 / 79597123 / +0.8%	105302650 / 104247941 / +1.0%	0.76 / 0.76 / -0.2%
tpcds_q30/datafusion:parquet	44368157 / 45305458 / -2.1%	62796026 / 64362866 / -2.4%	0.71 / 0.70 / +0.4%
tpcds_q31/datafusion:parquet	80497396 / 80181736 / +0.4%	103935263 / 101032366 / +2.9%	0.77 / 0.79 / -2.4%
tpcds_q32/datafusion:parquet	23712779 / 23136912 / +2.5%	41218672 / 40213196 / +2.5%	0.58 / 0.58 / -0.0%
tpcds_q33/datafusion:parquet	33307039 / 33217376 / +0.3%	50605273 / 51170790 / -1.1%	0.66 / 0.65 / +1.4%
tpcds_q34/datafusion:parquet	22692780 / 22791886 / -0.4%	38992627 / 38357567 / +1.7%	0.58 / 0.59 / -2.1%
tpcds_q35/datafusion:parquet	50001532 / 49631547 / +0.7%	70179488 / 69403266 / +1.1%	0.71 / 0.72 / -0.4%
tpcds_q36/datafusion:parquet	53244293 / 53263152 / -0.0%	73831137 / 74541331 / -1.0%	0.72 / 0.71 / +0.9%
tpcds_q37/datafusion:parquet	23066179 / 23324152 / -1.1%	37864785 / 37637413 / +0.6%	0.61 / 0.62 / -1.7%
tpcds_q38/datafusion:parquet	43973477 / 43407250 / +1.3%	64083694 / 61934331 / +3.5%	0.69 / 0.70 / -2.1%
tpcds_q39/datafusion:parquet	71926402 / 72093831 / -0.2%	90796344 / 90438543 / +0.4%	0.79 / 0.80 / -0.6%
tpcds_q40/datafusion:parquet	30671004 / 30337812 / +1.1%	51111311 / 49797821 / +2.6%	0.60 / 0.61 / -1.5%
tpcds_q41/datafusion:parquet	17218043 / 17664014 / -2.5%	29011531 / 28711013 / +1.0%	0.59 / 0.62 / -3.5%
tpcds_q42/datafusion:parquet	16050402 / 15670598 / +2.4%	29408009 / 30000361 / -2.0%	0.55 / 0.52 / +4.5%
tpcds_q43/datafusion:parquet	17190943 / 17160740 / +0.2%	32560413 / 32441507 / +0.4%	0.53 / 0.53 / -0.2%
tpcds_q44/datafusion:parquet	33157370 / 33582620 / -1.3%	52769886 / 52634884 / +0.3%	0.63 / 0.64 / -1.5%
tpcds_q45/datafusion:parquet	36838164 / 37622984 / -2.1%	54456944 / 53838564 / +1.1%	0.68 / 0.70 / -3.2%
tpcds_q46/datafusion:parquet	29049690 / 28952233 / +0.3%	49975676 / 49417087 / +1.1%	0.58 / 0.59 / -0.8%
tpcds_q47/datafusion:parquet	95909241 / 96382179 / -0.5%	124102964 / 123402701 / +0.6%	0.77 / 0.78 / -1.1%
tpcds_q48/datafusion:parquet	38837803 / 38025840 / +2.1%	60330176 / 58072373 / +3.9%	0.64 / 0.65 / -1.7%
tpcds_q49/datafusion:parquet	73252529 / 73459451 / -0.3%	100680942 / 99248018 / +1.4%	0.73 / 0.74 / -1.7%
tpcds_q50/datafusion:parquet	49823932 / 49097643 / +1.5%	72208737 / 72341122 / -0.2%	0.69 / 0.68 / +1.7%
tpcds_q51/datafusion:parquet	67680586 / 66689234 / +1.5%	91935891 / 89578639 / +2.6%	0.74 / 0.74 / -1.1%
tpcds_q52/datafusion:parquet	15897054 / 15776932 / +0.8%	30836106 / 30534674 / +1.0%	0.52 / 0.52 / -0.2%
tpcds_q53/datafusion:parquet	21947456 / 21877648 / +0.3%	38888483 / 38304791 / +1.5%	0.56 / 0.57 / -1.2%
tpcds_q54/datafusion:parquet	45066710 / 45017626 / +0.1%	68774096 / 65416796 / +5.1%	0.66 / 0.69 / -4.8%
tpcds_q55/datafusion:parquet	15263562 / 15231194 / +0.2%	30031619 / 29233333 / +2.7%	0.51 / 0.52 / -2.5%
tpcds_q56/datafusion:parquet	32505442 / 31125396 / +4.4%	53895922 / 52630723 / +2.4%	0.60 / 0.59 / +2.0%
tpcds_q57/datafusion:parquet	98756703 / 97956405 / +0.8%	121849602 / 121727968 / +0.1%	0.81 / 0.80 / +0.7%
tpcds_q58/datafusion:parquet	64341704 / 64532660 / -0.3%	88568376 / 85503484 / +3.6%	0.73 / 0.75 / -3.7%
tpcds_q59/datafusion:parquet	42918196 / 42678724 / +0.6%	62291428 / 61693463 / +1.0%	0.69 / 0.69 / -0.4%
tpcds_q60/datafusion:parquet	31664684 / 31579536 / +0.3%	54606217 / 55911451 / -2.3%	0.58 / 0.56 / +2.7%
tpcds_q61/datafusion:parquet	33113101 / 33996340 / -2.6%	56748443 / 55071752 / +3.0%	0.58 / 0.62 / -5.5%
tpcds_q62/datafusion:parquet	23833713 / 24075941 / -1.0%	39220190 / 38186360 / +2.7%	0.61 / 0.63 / -3.6%
tpcds_q63/datafusion:parquet	22118840 / 22012588 / +0.5%	38703158 / 37620794 / +2.9%	0.57 / 0.59 / -2.3%
tpcds_q64/datafusion:parquet	205959396 / 203996915 / +1.0%	243147422 / 234628232 / +3.6%	0.85 / 0.87 / -2.6%
tpcds_q65/datafusion:parquet	39365670 / 38664740 / +1.8%	59273613 / 60001871 / -1.2%	0.66 / 0.64 / +3.1%
tpcds_q66/datafusion:parquet	62579388 / 61914486 / +1.1%	79004097 / 79993288 / -1.2%	0.79 / 0.77 / +2.3%
tpcds_q67/datafusion:parquet	70679574 / 70109080 / +0.8%	96484213 / 95802539 / +0.7%	0.73 / 0.73 / +0.1%
tpcds_q68/datafusion:parquet	28749037 / 29234452 / -1.7%	51048473 / 51051251 / -0.0%	0.56 / 0.57 / -1.7%
tpcds_q69/datafusion:parquet	41260418 / 42145705 / -2.1%	61743491 / 61436528 / +0.5%	0.67 / 0.69 / -2.6%
tpcds_q70/datafusion:parquet	33051454 / 32767228 / +0.9%	55116763 / 51457211 / +7.1%	0.60 / 0.64 / -5.8%
tpcds_q71/datafusion:parquet	23277874 / 24342676 / -4.4%	38643074 / 39448403 / -2.0%	0.60 / 0.62 / -2.4%
tpcds_q72/datafusion:parquet	552368573 / 547326982 / +0.9%	572380725 / 568335574 / +0.7%	0.97 / 0.96 / +0.2%
tpcds_q73/datafusion:parquet	23006487 / 21616076 / +6.4%	38416589 / 37862726 / +1.5%	0.60 / 0.57 / +4.9%
tpcds_q74/datafusion:parquet	66768774 / 66573690 / +0.3%	85849510 / 88186209 / -2.6%	0.78 / 0.75 / +3.0%
tpcds_q75/datafusion:parquet	147015042 / 148510790 / -1.0%	174073375 / 180622450 / -3.6%	0.84 / 0.82 / +2.7%
tpcds_q76/datafusion:parquet	48649940 / 49104066 / -0.9%	65438654 / 63015175 / +3.8%	0.74 / 0.78 / -4.6%
tpcds_q77/datafusion:parquet	52284948 / 52548898 / -0.5%	74997410 / 74559824 / +0.6%	0.70 / 0.70 / -1.1%
tpcds_q78/datafusion:parquet	92454480 / 94582875 / -2.3%	127983343 / 123099701 / +4.0%	0.72 / 0.77 / -6.0%
tpcds_q79/datafusion:parquet	26157988 / 26147026 / +0.0%	45394996 / 45933297 / -1.2%	0.58 / 0.57 / +1.2%
tpcds_q80/datafusion:parquet	84025638 / 81843780 / +2.7%	113308860 / 110787025 / +2.3%	0.74 / 0.74 / +0.4%
tpcds_q81/datafusion:parquet	38563299 / 38214242 / +0.9%	61291882 / 60250200 / +1.7%	0.63 / 0.63 / -0.8%
tpcds_q82/datafusion:parquet	25500428 / 25915258 / -1.6%	40612311 / 40117281 / +1.2%	0.63 / 0.65 / -2.8%
tpcds_q83/datafusion:parquet	47355802 / 47938228 / -1.2%	67189671 / 66938190 / +0.4%	0.70 / 0.72 / -1.6%
tpcds_q84/datafusion:parquet	29333692 / 29313590 / +0.1%	47368738 / 47990756 / -1.3%	0.62 / 0.61 / +1.4%
tpcds_q85/datafusion:parquet	85476110 / 86627113 / -1.3%	108607917 / 111551467 / -2.6%	0.79 / 0.78 / +1.3%
tpcds_q86/datafusion:parquet	20679186 / 20602028 / +0.4%	33758804 / 33481604 / +0.8%	0.61 / 0.62 / -0.4%
tpcds_q87/datafusion:parquet	42816916 / 42373536 / +1.0%	62670269 / 62047164 / +1.0%	0.68 / 0.68 / +0.0%
tpcds_q88/datafusion:parquet	37618358 / 39126682 / -3.9%	61397649 / 66060958 / -7.1%	0.61 / 0.59 / +3.4%
tpcds_q89/datafusion:parquet	25069578 / 25348312 / -1.1%	43176904 / 43238764 / -0.1%	0.58 / 0.59 / -1.0%
tpcds_q90/datafusion:parquet	15578581 / 15936496 / -2.2%	30885873 / 30135088 / +2.5%	0.50 / 0.53 / -4.6%
tpcds_q91/datafusion:parquet	32060038 / 31729586 / +1.0%	49363780 / 49666404 / -0.6%	0.65 / 0.64 / +1.7%
tpcds_q92/datafusion:parquet	23251060 / 23788542 / -2.3%	40760894 / 40306937 / +1.1%	0.57 / 0.59 / -3.3%
tpcds_q93/datafusion:parquet	27674388 / 27581443 / +0.3%	49547538 / 49016289 / +1.1%	0.56 / 0.56 / -0.7%
tpcds_q94/datafusion:parquet	31699599 / 31888048 / -0.6%	50328243 / 48798646 / +3.1%	0.63 / 0.65 / -3.6%
tpcds_q95/datafusion:parquet	66003046 / 67923252 / -2.8%	80255202 / 80832904 / -0.7%	0.82 / 0.84 / -2.1%
tpcds_q96/datafusion:parquet	13438128 / 12641378 / +6.3%	28980637 / 27761015 / +4.4%	0.46 / 0.46 / +1.8%
tpcds_q97/datafusion:parquet	32211668 / 31777358 / +1.4%	52137888 / 51798756 / +0.7%	0.62 / 0.61 / +0.7%
tpcds_q98/datafusion:parquet	22651741 / 22441867 / +0.9%	39014913 / 37406893 / +4.3%	0.58 / 0.60 / -3.2%
tpcds_q99/datafusion:parquet	28664883 / 28763192 / -0.3%	43446520 / 42445752 / +2.4%	0.66 / 0.68 / -2.6%

duckdb / vortex-file-compressed / ns (0.997x ➖, 4↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed	15205456 / 15002752 / +1.4%	22622891 / 22018821 / +2.7%	0.67 / 0.68 / -1.4%
tpcds_q02/duckdb:vortex-file-compressed	15232640 / 14843448 / +2.6%	20353664 / 20058745 / +1.5%	0.75 / 0.74 / +1.1%
tpcds_q03/duckdb:vortex-file-compressed	12376984 / 11033230 / +12.2% 🔴	21470514 / 21964501 / -2.2%	0.58 / 0.50 / +14.8%
tpcds_q04/duckdb:vortex-file-compressed	50497205 / 50108452 / +0.8%	61713983 / 59996566 / +2.9%	0.82 / 0.84 / -2.0%
tpcds_q05/duckdb:vortex-file-compressed	19021387 / 18647025 / +2.0%	26288527 / 26472937 / -0.7%	0.72 / 0.70 / +2.7%
tpcds_q06/duckdb:vortex-file-compressed	26629580 / 26531120 / +0.4%	39180249 / 39754497 / -1.4%	0.68 / 0.67 / +1.8%
tpcds_q07/duckdb:vortex-file-compressed	15557442 / 15736117 / -1.1%	28925930 / 35030596 / -17.4% 🟢	0.54 / 0.45 / +19.7%
tpcds_q08/duckdb:vortex-file-compressed	18716096 / 19086601 / -1.9%	28498967 / 26212753 / +8.7%	0.66 / 0.73 / -9.8%
tpcds_q09/duckdb:vortex-file-compressed	13703989 / 13396412 / +2.3%	21577098 / 21176001 / +1.9%	0.64 / 0.63 / +0.4%
tpcds_q10/duckdb:vortex-file-compressed	27394844 / 27508244 / -0.4%	41001727 / 40831130 / +0.4%	0.67 / 0.67 / -0.8%
tpcds_q11/duckdb:vortex-file-compressed	41081154 / 40383742 / +1.7%	51059247 / 51248503 / -0.4%	0.80 / 0.79 / +2.1%
tpcds_q12/duckdb:vortex-file-compressed	10391826 / 10202384 / +1.9%	18039599 / 15848767 / +13.8% 🔴	0.58 / 0.64 / -10.5%
tpcds_q13/duckdb:vortex-file-compressed	22004812 / 22247756 / -1.1%	33648055 / 33086918 / +1.7%	0.65 / 0.67 / -2.7%
tpcds_q14/duckdb:vortex-file-compressed	58008756 / 58377906 / -0.6%	68656074 / 72432093 / -5.2%	0.84 / 0.81 / +4.8%
tpcds_q15/duckdb:vortex-file-compressed	20780147 / 20828594 / -0.2%	26186826 / 24913620 / +5.1%	0.79 / 0.84 / -5.1%
tpcds_q16/duckdb:vortex-file-compressed	17332122 / 17260601 / +0.4%	25367330 / 28319639 / -10.4% 🟢	0.68 / 0.61 / +12.1%
tpcds_q17/duckdb:vortex-file-compressed	30171744 / 29919950 / +0.8%	43029456 / 43230555 / -0.5%	0.70 / 0.69 / +1.3%
tpcds_q18/duckdb:vortex-file-compressed	28327072 / 28459909 / -0.5%	37252888 / 37624678 / -1.0%	0.76 / 0.76 / +0.5%
tpcds_q19/duckdb:vortex-file-compressed	23408093 / 23290999 / +0.5%	32861540 / 34267768 / -4.1%	0.71 / 0.68 / +4.8%
tpcds_q20/duckdb:vortex-file-compressed	10829438 / 10587730 / +2.3%	14756706 / 15375239 / -4.0%	0.73 / 0.69 / +6.6%
tpcds_q21/duckdb:vortex-file-compressed	9611276 / 9433160 / +1.9%	19525548 / 17581042 / +11.1% 🔴	0.49 / 0.54 / -8.3%
tpcds_q22/duckdb:vortex-file-compressed	28903340 / 29368019 / -1.6%	38722929 / 38028480 / +1.8%	0.75 / 0.77 / -3.3%
tpcds_q23/duckdb:vortex-file-compressed	38494579 / 36377160 / +5.8%	47855937 / 48324292 / -1.0%	0.80 / 0.75 / +6.9%
tpcds_q24/duckdb:vortex-file-compressed	28081336 / 27286456 / +2.9%	37640499 / 37185349 / +1.2%	0.75 / 0.73 / +1.7%
tpcds_q25/duckdb:vortex-file-compressed	25648564 / 25005614 / +2.6%	38028619 / 38445691 / -1.1%	0.67 / 0.65 / +3.7%
tpcds_q26/duckdb:vortex-file-compressed	13557701 / 13240342 / +2.4%	19863085 / 21266865 / -6.6%	0.68 / 0.62 / +9.6%
tpcds_q27/duckdb:vortex-file-compressed	17603877 / 16995450 / +3.6%	29836487 / 29753451 / +0.3%	0.59 / 0.57 / +3.3%
tpcds_q28/duckdb:vortex-file-compressed	11118430 / 12556274 / -11.5% 🟢	17843317 / 21957824 / -18.7% 🟢	0.62 / 0.57 / +9.0%
tpcds_q29/duckdb:vortex-file-compressed	28383478 / 28660602 / -1.0%	44282994 / 40577326 / +9.1%	0.64 / 0.71 / -9.3%
tpcds_q30/duckdb:vortex-file-compressed	19533854 / 19132122 / +2.1%	29565224 / 26804257 / +10.3% 🔴	0.66 / 0.71 / -7.4%
tpcds_q31/duckdb:vortex-file-compressed	19126190 / 19421876 / -1.5%	26834576 / 27207066 / -1.4%	0.71 / 0.71 / -0.2%
tpcds_q32/duckdb:vortex-file-compressed	9693042 / 9825202 / -1.3%	16023562 / 21937236 / -27.0% 🟢	0.60 / 0.45 / +35.1%
tpcds_q33/duckdb:vortex-file-compressed	16539658 / 16854940 / -1.9%	26736279 / 27731313 / -3.6%	0.62 / 0.61 / +1.8%
tpcds_q34/duckdb:vortex-file-compressed	15186318 / 15154160 / +0.2%	22568014 / 24553094 / -8.1%	0.67 / 0.62 / +9.0%
tpcds_q35/duckdb:vortex-file-compressed	45855384 / 46221608 / -0.8%	60180935 / 64165695 / -6.2%	0.76 / 0.72 / +5.8%
tpcds_q36/duckdb:vortex-file-compressed	15032450 / 14593092 / +3.0%	28501092 / 28765160 / -0.9%	0.53 / 0.51 / +4.0%
tpcds_q37/duckdb:vortex-file-compressed	13986993 / 14104340 / -0.8%	22460051 / 22072327 / +1.8%	0.62 / 0.64 / -2.5%
tpcds_q38/duckdb:vortex-file-compressed	22309680 / 22221250 / +0.4%	28761730 / 27784479 / +3.5%	0.78 / 0.80 / -3.0%
tpcds_q39/duckdb:vortex-file-compressed	18366931 / 18397704 / -0.2%	29662879 / 30935165 / -4.1%	0.62 / 0.59 / +4.1%
tpcds_q40/duckdb:vortex-file-compressed	13203201 / 13125852 / +0.6%	18214893 / 20221824 / -9.9%	0.72 / 0.65 / +11.7%
tpcds_q41/duckdb:vortex-file-compressed	6151510 / 6188825 / -0.6%	9051613 / 8645347 / +4.7%	0.68 / 0.72 / -5.1%
tpcds_q42/duckdb:vortex-file-compressed	8015029 / 8111714 / -1.2%	16643598 / 16429309 / +1.3%	0.48 / 0.49 / -2.5%
tpcds_q43/duckdb:vortex-file-compressed	10029758 / 10096330 / -0.7%	20122744 / 18801202 / +7.0%	0.50 / 0.54 / -7.2%
tpcds_q44/duckdb:vortex-file-compressed	15572823 / 15149308 / +2.8%	26984146 / 25718527 / +4.9%	0.58 / 0.59 / -2.0%
tpcds_q45/duckdb:vortex-file-compressed	22241508 / 22112638 / +0.6%	30016774 / 28559583 / +5.1%	0.74 / 0.77 / -4.3%
tpcds_q46/duckdb:vortex-file-compressed	18447400 / 18506830 / -0.3%	27874277 / 28253172 / -1.3%	0.66 / 0.66 / +1.0%
tpcds_q47/duckdb:vortex-file-compressed	30363472 / 30220072 / +0.5%	43622785 / 41348583 / +5.5%	0.70 / 0.73 / -4.8%
tpcds_q48/duckdb:vortex-file-compressed	19480322 / 18644623 / +4.5%	29549529 / 32519992 / -9.1%	0.66 / 0.57 / +15.0%
tpcds_q49/duckdb:vortex-file-compressed	16333938 / 17131288 / -4.7%	26996379 / 29176948 / -7.5%	0.61 / 0.59 / +3.0%
tpcds_q50/duckdb:vortex-file-compressed	16518206 / 16558674 / -0.2%	26984732 / 26187038 / +3.0%	0.61 / 0.63 / -3.2%
tpcds_q51/duckdb:vortex-file-compressed	64278803 / 76814784 / -16.3% 🟢	86619347 / 65010856 / +33.2% 🔴	0.74 / 1.18 / -37.2%
tpcds_q52/duckdb:vortex-file-compressed	8556308 / 8487855 / +0.8%	17297768 / 17172903 / +0.7%	0.49 / 0.49 / +0.1%
tpcds_q53/duckdb:vortex-file-compressed	13875848 / 14622214 / -5.1%	26286899 / 26107801 / +0.7%	0.53 / 0.56 / -5.8%
tpcds_q54/duckdb:vortex-file-compressed	20661090 / 20484586 / +0.9%	28549755 / 28550353 / -0.0%	0.72 / 0.72 / +0.9%
tpcds_q55/duckdb:vortex-file-compressed	7951468 / 8189614 / -2.9%	16212346 / 16570854 / -2.2%	0.49 / 0.49 / -0.8%
tpcds_q56/duckdb:vortex-file-compressed	17523142 / 17149590 / +2.2%	27712472 / 29844263 / -7.1%	0.63 / 0.57 / +10.0%
tpcds_q57/duckdb:vortex-file-compressed	24163330 / 24081956 / +0.3%	30984292 / 33152981 / -6.5%	0.78 / 0.73 / +7.4%
tpcds_q58/duckdb:vortex-file-compressed	17569164 / 17453730 / +0.7%	29391479 / 27572263 / +6.6%	0.60 / 0.63 / -5.6%
tpcds_q59/duckdb:vortex-file-compressed	18424072 / 18566160 / -0.8%	23643186 / 25025410 / -5.5%	0.78 / 0.74 / +5.0%
tpcds_q60/duckdb:vortex-file-compressed	18058611 / 17759928 / +1.7%	28887198 / 28561409 / +1.1%	0.63 / 0.62 / +0.5%
tpcds_q61/duckdb:vortex-file-compressed	19568910 / 20042892 / -2.4%	30901557 / 30392231 / +1.7%	0.63 / 0.66 / -4.0%
tpcds_q62/duckdb:vortex-file-compressed	10139597 / 10302847 / -1.6%	15430608 / 24353568 / -36.6% 🟢	0.66 / 0.42 / +55.3%
tpcds_q63/duckdb:vortex-file-compressed	13878390 / 13071890 / +6.2%	22419475 / 21741627 / +3.1%	0.62 / 0.60 / +3.0%
tpcds_q64/duckdb:vortex-file-compressed	62249350 / 61459756 / +1.3%	75362761 / 78014174 / -3.4%	0.83 / 0.79 / +4.8%
tpcds_q65/duckdb:vortex-file-compressed	15202282 / 16171732 / -6.0%	26692086 / 26148918 / +2.1%	0.57 / 0.62 / -7.9%
tpcds_q66/duckdb:vortex-file-compressed	21112201 / 21723967 / -2.8%	34021605 / 30611898 / +11.1% 🔴	0.62 / 0.71 / -12.6%
tpcds_q67/duckdb:vortex-file-compressed	65471190 / 66720994 / -1.9%	84882594 / 92648018 / -8.4%	0.77 / 0.72 / +7.1%
tpcds_q68/duckdb:vortex-file-compressed	18219694 / 18467204 / -1.3%	28186024 / 29782555 / -5.4%	0.65 / 0.62 / +4.2%
tpcds_q69/duckdb:vortex-file-compressed	28682371 / 28734999 / -0.2%	42300792 / 41740807 / +1.3%	0.68 / 0.69 / -1.5%
tpcds_q70/duckdb:vortex-file-compressed	18757486 / 18544049 / +1.2%	30392552 / 30066357 / +1.1%	0.62 / 0.62 / +0.1%
tpcds_q71/duckdb:vortex-file-compressed	12835816 / 12739998 / +0.8%	20882885 / 21657206 / -3.6%	0.61 / 0.59 / +4.5%
tpcds_q72/duckdb:vortex-file-compressed	61567048 / 62088674 / -0.8%	76391808 / 76044603 / +0.5%	0.81 / 0.82 / -1.3%
tpcds_q73/duckdb:vortex-file-compressed	14857298 / 15107879 / -1.7%	20650236 / 20314562 / +1.7%	0.72 / 0.74 / -3.3%
tpcds_q74/duckdb:vortex-file-compressed	27130339 / 27676666 / -2.0%	35709584 / 39017509 / -8.5%	0.76 / 0.71 / +7.1%
tpcds_q75/duckdb:vortex-file-compressed	29131106 / 28375176 / +2.7%	40974359 / 38195159 / +7.3%	0.71 / 0.74 / -4.3%
tpcds_q76/duckdb:vortex-file-compressed	12348202 / 12474064 / -1.0%	23437683 / 24270281 / -3.4%	0.53 / 0.51 / +2.5%
tpcds_q77/duckdb:vortex-file-compressed	15955242 / 15654742 / +1.9%	24838360 / 23348060 / +6.4%	0.64 / 0.67 / -4.2%
tpcds_q78/duckdb:vortex-file-compressed	38882199 / 37658736 / +3.2%	45111031 / 45424221 / -0.7%	0.86 / 0.83 / +4.0%
tpcds_q79/duckdb:vortex-file-compressed	14141328 / 14125886 / +0.1%	23382495 / 23558403 / -0.7%	0.60 / 0.60 / +0.9%
tpcds_q80/duckdb:vortex-file-compressed	27717618 / 27769090 / -0.2%	41223917 / 39485622 / +4.4%	0.67 / 0.70 / -4.4%
tpcds_q81/duckdb:vortex-file-compressed	22296490 / 22315440 / -0.1%	31856763 / 29728878 / +7.2%	0.70 / 0.75 / -6.8%
tpcds_q82/duckdb:vortex-file-compressed	32542866 / 32515294 / +0.1%	42252165 / 41566636 / +1.6%	0.77 / 0.78 / -1.5%
tpcds_q83/duckdb:vortex-file-compressed	19107068 / 19183096 / -0.4%	28418351 / 24787811 / +14.6% 🔴	0.67 / 0.77 / -13.1%
tpcds_q84/duckdb:vortex-file-compressed	12851640 / 12854612 / -0.0%	24687458 / 19212041 / +28.5% 🔴	0.52 / 0.67 / -22.2%
tpcds_q85/duckdb:vortex-file-compressed	30790672 / 30852027 / -0.2%	38574489 / 38304721 / +0.7%	0.80 / 0.81 / -0.9%
tpcds_q86/duckdb:vortex-file-compressed	10823773 / 10895157 / -0.7%	18370844 / 17651563 / +4.1%	0.59 / 0.62 / -4.5%
tpcds_q87/duckdb:vortex-file-compressed	23840737 / 24798672 / -3.9%	29859423 / 30312629 / -1.5%	0.80 / 0.82 / -2.4%
tpcds_q88/duckdb:vortex-file-compressed	31128514 / 31622960 / -1.6%	43710020 / 42838518 / +2.0%	0.71 / 0.74 / -3.5%
tpcds_q89/duckdb:vortex-file-compressed	13799000 / 13571156 / +1.7%	22555181 / 23085025 / -2.3%	0.61 / 0.59 / +4.1%
tpcds_q90/duckdb:vortex-file-compressed	8178133 / 8298057 / -1.4%	12457130 / 13790995 / -9.7%	0.66 / 0.60 / +9.1%
tpcds_q91/duckdb:vortex-file-compressed	14989336 / 15168080 / -1.2%	23074386 / 21462340 / +7.5%	0.65 / 0.71 / -8.1%
tpcds_q92/duckdb:vortex-file-compressed	12809680 / 12860374 / -0.4%	20833889 / 20830876 / +0.0%	0.61 / 0.62 / -0.4%
tpcds_q93/duckdb:vortex-file-compressed	18428476 / 16837168 / +9.5%	26533699 / 27304424 / -2.8%	0.69 / 0.62 / +12.6%
tpcds_q94/duckdb:vortex-file-compressed	16068606 / 15955177 / +0.7%	26790885 / 26829179 / -0.1%	0.60 / 0.59 / +0.9%
tpcds_q95/duckdb:vortex-file-compressed	42486150 / 45026946 / -5.6%	53860917 / 52343483 / +2.9%	0.79 / 0.86 / -8.3%
tpcds_q96/duckdb:vortex-file-compressed	7447996 / 8425192 / -11.6% 🟢	17547765 / 18922728 / -7.3%	0.42 / 0.45 / -4.7%
tpcds_q97/duckdb:vortex-file-compressed	22276766 / 22201168 / +0.3%	35828350 / 29221703 / +22.6% 🔴	0.62 / 0.76 / -18.2%
tpcds_q98/duckdb:vortex-file-compressed	13110608 / 14764670 / -11.2% 🟢	20546244 / 20789959 / -1.2%	0.64 / 0.71 / -10.1%
tpcds_q99/duckdb:vortex-file-compressed	13503728 / 13225488 / +2.1%	19611302 / 18989959 / +3.3%	0.69 / 0.70 / -1.1%

duckdb / vortex-compact / ns (1.003x ➖, 2↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact	16451167 / 16576664 / -0.8%	23698560 / 24304074 / -2.5%	0.69 / 0.68 / +1.8%
tpcds_q02/duckdb:vortex-compact	16284372 / 16190870 / +0.6%	22667760 / 21296976 / +6.4%	0.72 / 0.76 / -5.5%
tpcds_q03/duckdb:vortex-compact	25542282 / 22123944 / +15.5% 🔴	28419510 / 28619206 / -0.7%	0.90 / 0.77 / +16.3%
tpcds_q04/duckdb:vortex-compact	54010224 / 53930746 / +0.1%	65427038 / 64841318 / +0.9%	0.83 / 0.83 / -0.7%
tpcds_q05/duckdb:vortex-compact	23671786 / 22345753 / +5.9%	31201391 / 32028632 / -2.6%	0.76 / 0.70 / +8.7%
tpcds_q06/duckdb:vortex-compact	33234496 / 33482062 / -0.7%	43156175 / 43956182 / -1.8%	0.77 / 0.76 / +1.1%
tpcds_q07/duckdb:vortex-compact	25271406 / 25163460 / +0.4%	32809524 / 33651116 / -2.5%	0.77 / 0.75 / +3.0%
tpcds_q08/duckdb:vortex-compact	48702036 / 48636348 / +0.1%	65718691 / 56428359 / +16.5% 🔴	0.74 / 0.86 / -14.0%
tpcds_q09/duckdb:vortex-compact	19392820 / 19035855 / +1.9%	27674857 / 28107877 / -1.5%	0.70 / 0.68 / +3.5%
tpcds_q10/duckdb:vortex-compact	45257718 / 45106970 / +0.3%	56248627 / 56358537 / -0.2%	0.80 / 0.80 / +0.5%
tpcds_q11/duckdb:vortex-compact	45467209 / 45100027 / +0.8%	60242145 / 56725430 / +6.2%	0.75 / 0.80 / -5.1%
tpcds_q12/duckdb:vortex-compact	13442418 / 13506726 / -0.5%	18312600 / 18375460 / -0.3%	0.73 / 0.74 / -0.1%
tpcds_q13/duckdb:vortex-compact	36463145 / 36226172 / +0.7%	48340035 / 46195835 / +4.6%	0.75 / 0.78 / -3.8%
tpcds_q14/duckdb:vortex-compact	68672430 / 68158837 / +0.8%	84206259 / 78416233 / +7.4%	0.82 / 0.87 / -6.2%
tpcds_q15/duckdb:vortex-compact	26143060 / 26241378 / -0.4%	30253185 / 30876610 / -2.0%	0.86 / 0.85 / +1.7%
tpcds_q16/duckdb:vortex-compact	24922543 / 24787614 / +0.5%	35818561 / 31708053 / +13.0% 🔴	0.70 / 0.78 / -11.0%
tpcds_q17/duckdb:vortex-compact	44826461 / 45582248 / -1.7%	57760265 / 56638394 / +2.0%	0.78 / 0.80 / -3.6%
tpcds_q18/duckdb:vortex-compact	35368278 / 36173924 / -2.2%	43285148 / 45612703 / -5.1%	0.82 / 0.79 / +3.0%
tpcds_q19/duckdb:vortex-compact	36187368 / 35256596 / +2.6%	44603986 / 46145250 / -3.3%	0.81 / 0.76 / +6.2%
tpcds_q20/duckdb:vortex-compact	14412466 / 13984515 / +3.1%	18434638 / 18706627 / -1.5%	0.78 / 0.75 / +4.6%
tpcds_q21/duckdb:vortex-compact	10624061 / 10349038 / +2.7%	24432839 / 19804469 / +23.4% 🔴	0.43 / 0.52 / -16.8%
tpcds_q22/duckdb:vortex-compact	30545910 / 30474772 / +0.2%	41047155 / 40601891 / +1.1%	0.74 / 0.75 / -0.9%
tpcds_q23/duckdb:vortex-compact	44551091 / 42211132 / +5.5%	59493835 / 51376284 / +15.8% 🔴	0.75 / 0.82 / -8.9%
tpcds_q24/duckdb:vortex-compact	39314046 / 39774872 / -1.2%	46777955 / 47065142 / -0.6%	0.84 / 0.85 / -0.6%
tpcds_q25/duckdb:vortex-compact	43076355 / 43148592 / -0.2%	52923363 / 55912138 / -5.3%	0.81 / 0.77 / +5.5%
tpcds_q26/duckdb:vortex-compact	22289166 / 21945394 / +1.6%	28456445 / 27656477 / +2.9%	0.78 / 0.79 / -1.3%
tpcds_q27/duckdb:vortex-compact	29729572 / 30118008 / -1.3%	36493089 / 37650126 / -3.1%	0.81 / 0.80 / +1.8%
tpcds_q28/duckdb:vortex-compact	22960785 / 23216714 / -1.1%	30706459 / 30972640 / -0.9%	0.75 / 0.75 / -0.2%
tpcds_q29/duckdb:vortex-compact	44741356 / 44287966 / +1.0%	55750367 / 56104768 / -0.6%	0.80 / 0.79 / +1.7%
tpcds_q30/duckdb:vortex-compact	22402023 / 22814468 / -1.8%	29129977 / 28957129 / +0.6%	0.77 / 0.79 / -2.4%
tpcds_q31/duckdb:vortex-compact	24697248 / 23595290 / +4.7%	30779300 / 30259820 / +1.7%	0.80 / 0.78 / +2.9%
tpcds_q32/duckdb:vortex-compact	14003928 / 14173354 / -1.2%	20959117 / 19957580 / +5.0%	0.67 / 0.71 / -5.9%
tpcds_q33/duckdb:vortex-compact	22716404 / 24711192 / -8.1%	31562060 / 35758722 / -11.7% 🟢	0.72 / 0.69 / +4.2%
tpcds_q34/duckdb:vortex-compact	21871234 / 21923968 / -0.2%	28188091 / 29281533 / -3.7%	0.78 / 0.75 / +3.6%
tpcds_q35/duckdb:vortex-compact	62006541 / 61651678 / +0.6%	74938474 / 77512834 / -3.3%	0.83 / 0.80 / +4.0%
tpcds_q36/duckdb:vortex-compact	22093798 / 22638570 / -2.4%	32770088 / 35439991 / -7.5%	0.67 / 0.64 / +5.5%
tpcds_q37/duckdb:vortex-compact	15105877 / 15423884 / -2.1%	27616093 / 24184388 / +14.2% 🔴	0.55 / 0.64 / -14.2%
tpcds_q38/duckdb:vortex-compact	26252734 / 26071676 / +0.7%	35354606 / 35040345 / +0.9%	0.74 / 0.74 / -0.2%
tpcds_q39/duckdb:vortex-compact	19684167 / 19887430 / -1.0%	33553986 / 28672458 / +17.0% 🔴	0.59 / 0.69 / -15.4%
tpcds_q40/duckdb:vortex-compact	15797564 / 16065706 / -1.7%	20627045 / 23571371 / -12.5% 🟢	0.77 / 0.68 / +12.4%
tpcds_q41/duckdb:vortex-compact	7340442 / 7351574 / -0.2%	10019031 / 9890494 / +1.3%	0.73 / 0.74 / -1.4%
tpcds_q42/duckdb:vortex-compact	11944815 / 12903964 / -7.4%	19264097 / 19067627 / +1.0%	0.62 / 0.68 / -8.4%
tpcds_q43/duckdb:vortex-compact	16236814 / 16418488 / -1.1%	22948800 / 23107327 / -0.7%	0.71 / 0.71 / -0.4%
tpcds_q44/duckdb:vortex-compact	21914744 / 23340278 / -6.1%	32735475 / 30542826 / +7.2%	0.67 / 0.76 / -12.4%
tpcds_q45/duckdb:vortex-compact	27245518 / 27190190 / +0.2%	32854043 / 32763070 / +0.3%	0.83 / 0.83 / -0.1%
tpcds_q46/duckdb:vortex-compact	29152048 / 28854396 / +1.0%	37566235 / 43280927 / -13.2% 🟢	0.78 / 0.67 / +16.4%
tpcds_q47/duckdb:vortex-compact	36038768 / 37055705 / -2.7%	44125471 / 49292664 / -10.5% 🟢	0.82 / 0.75 / +8.6%
tpcds_q48/duckdb:vortex-compact	33023558 / 33159629 / -0.4%	41342798 / 44503343 / -7.1%	0.80 / 0.75 / +7.2%
tpcds_q49/duckdb:vortex-compact	24048378 / 22470747 / +7.0%	39425614 / 36009758 / +9.5%	0.61 / 0.62 / -2.3%
tpcds_q50/duckdb:vortex-compact	27884629 / 27191762 / +2.5%	34911631 / 35404651 / -1.4%	0.80 / 0.77 / +4.0%
tpcds_q51/duckdb:vortex-compact	54409755 / 52845246 / +3.0%	63316179 / 65509924 / -3.3%	0.86 / 0.81 / +6.5%
tpcds_q52/duckdb:vortex-compact	12258082 / 11908406 / +2.9%	20612774 / 20660047 / -0.2%	0.59 / 0.58 / +3.2%
tpcds_q53/duckdb:vortex-compact	21986574 / 21377676 / +2.8%	27712747 / 28106265 / -1.4%	0.79 / 0.76 / +4.3%
tpcds_q54/duckdb:vortex-compact	27100526 / 26954482 / +0.5%	35004690 / 34769817 / +0.7%	0.77 / 0.78 / -0.1%
tpcds_q55/duckdb:vortex-compact	13928362 / 11920781 / +16.8% 🔴	19982769 / 19927064 / +0.3%	0.70 / 0.60 / +16.5%
tpcds_q56/duckdb:vortex-compact	24146786 / 24639164 / -2.0%	36286195 / 33163717 / +9.4%	0.67 / 0.74 / -10.4%
tpcds_q57/duckdb:vortex-compact	28761953 / 27463063 / +4.7%	33451608 / 35000634 / -4.4%	0.86 / 0.78 / +9.6%
tpcds_q58/duckdb:vortex-compact	23931744 / 24498920 / -2.3%	35351330 / 34505176 / +2.5%	0.68 / 0.71 / -4.7%
tpcds_q59/duckdb:vortex-compact	23251418 / 23729125 / -2.0%	28942195 / 37199207 / -22.2% 🟢	0.80 / 0.64 / +25.9%
tpcds_q60/duckdb:vortex-compact	24893764 / 24491030 / +1.6%	37841831 / 36699121 / +3.1%	0.66 / 0.67 / -1.4%
tpcds_q61/duckdb:vortex-compact	31370035 / 31745152 / -1.2%	42739654 / 43220523 / -1.1%	0.73 / 0.73 / -0.1%
tpcds_q62/duckdb:vortex-compact	11644078 / 11722734 / -0.7%	18978960 / 17871997 / +6.2%	0.61 / 0.66 / -6.5%
tpcds_q63/duckdb:vortex-compact	20064366 / 20401228 / -1.7%	27645547 / 27214389 / +1.6%	0.73 / 0.75 / -3.2%
tpcds_q64/duckdb:vortex-compact	85358578 / 84365425 / +1.2%	98659931 / 97311995 / +1.4%	0.87 / 0.87 / -0.2%
tpcds_q65/duckdb:vortex-compact	19743120 / 21467414 / -8.0%	31026912 / 32370298 / -4.2%	0.64 / 0.66 / -4.1%
tpcds_q66/duckdb:vortex-compact	25720640 / 25363092 / +1.4%	33932573 / 37091625 / -8.5%	0.76 / 0.68 / +10.9%
tpcds_q67/duckdb:vortex-compact	71213051 / 74238778 / -4.1%	86233135 / 83636597 / +3.1%	0.83 / 0.89 / -7.0%
tpcds_q68/duckdb:vortex-compact	28899435 / 28808269 / +0.3%	37264164 / 38591077 / -3.4%	0.78 / 0.75 / +3.9%
tpcds_q69/duckdb:vortex-compact	46593036 / 46082034 / +1.1%	58019383 / 58172957 / -0.3%	0.80 / 0.79 / +1.4%
tpcds_q70/duckdb:vortex-compact	31224206 / 30888058 / +1.1%	38547096 / 38288983 / +0.7%	0.81 / 0.81 / +0.4%
tpcds_q71/duckdb:vortex-compact	20487001 / 20444285 / +0.2%	27728928 / 28908183 / -4.1%	0.74 / 0.71 / +4.5%
tpcds_q72/duckdb:vortex-compact	68815277 / 69379489 / -0.8%	80264572 / 82936362 / -3.2%	0.86 / 0.84 / +2.5%
tpcds_q73/duckdb:vortex-compact	21433788 / 21336334 / +0.5%	27602760 / 28595121 / -3.5%	0.78 / 0.75 / +4.1%
tpcds_q74/duckdb:vortex-compact	31873001 / 31857106 / +0.0%	39956141 / 40176438 / -0.5%	0.80 / 0.79 / +0.6%
tpcds_q75/duckdb:vortex-compact	32457387 / 32548656 / -0.3%	44642903 / 42201374 / +5.8%	0.73 / 0.77 / -5.7%
tpcds_q76/duckdb:vortex-compact	16186889 / 16316176 / -0.8%	26368589 / 27268186 / -3.3%	0.61 / 0.60 / +2.6%
tpcds_q77/duckdb:vortex-compact	22947255 / 22482829 / +2.1%	29154416 / 30704612 / -5.0%	0.79 / 0.73 / +7.5%
tpcds_q78/duckdb:vortex-compact	41661266 / 41703630 / -0.1%	49046388 / 57793370 / -15.1% 🟢	0.85 / 0.72 / +17.7%
tpcds_q79/duckdb:vortex-compact	37604484 / 38361988 / -2.0%	43379923 / 46972562 / -7.6%	0.87 / 0.82 / +6.1%
tpcds_q80/duckdb:vortex-compact	36257477 / 36247512 / +0.0%	47174583 / 47558399 / -0.8%	0.77 / 0.76 / +0.8%
tpcds_q81/duckdb:vortex-compact	24527044 / 24248944 / +1.1%	31362565 / 31410040 / -0.2%	0.78 / 0.77 / +1.3%
tpcds_q82/duckdb:vortex-compact	35576018 / 36842104 / -3.4%	42795902 / 42544272 / +0.6%	0.83 / 0.87 / -4.0%
tpcds_q83/duckdb:vortex-compact	29293790 / 28520448 / +2.7%	32902985 / 32802715 / +0.3%	0.89 / 0.87 / +2.4%
tpcds_q84/duckdb:vortex-compact	18071018 / 14652711 / +23.3% 🔴	18671885 / 20542199 / -9.1%	0.97 / 0.71 / +35.7%
tpcds_q85/duckdb:vortex-compact	41205346 / 41292580 / -0.2%	48308775 / 51836668 / -6.8%	0.85 / 0.80 / +7.1%
tpcds_q86/duckdb:vortex-compact	12292693 / 14866562 / -17.3% 🟢	18101307 / 18048966 / +0.3%	0.68 / 0.82 / -17.6%
tpcds_q87/duckdb:vortex-compact	28021275 / 28618460 / -2.1%	35196229 / 34931415 / +0.8%	0.80 / 0.82 / -2.8%
tpcds_q88/duckdb:vortex-compact	70519580 / 66178077 / +6.6%	78258608 / 77100523 / +1.5%	0.90 / 0.86 / +5.0%
tpcds_q89/duckdb:vortex-compact	21337171 / 20840148 / +2.4%	29927616 / 29429299 / +1.7%	0.71 / 0.71 / +0.7%
tpcds_q90/duckdb:vortex-compact	13201051 / 12294337 / +7.4%	18366677 / 19041294 / -3.5%	0.72 / 0.65 / +11.3%
tpcds_q91/duckdb:vortex-compact	30026202 / 30086193 / -0.2%	36264068 / 36411738 / -0.4%	0.83 / 0.83 / +0.2%
tpcds_q92/duckdb:vortex-compact	20182335 / 20281639 / -0.5%	27957679 / 25664205 / +8.9%	0.72 / 0.79 / -8.7%
tpcds_q93/duckdb:vortex-compact	18249746 / 18351558 / -0.6%	27298193 / 28344875 / -3.7%	0.67 / 0.65 / +3.3%
tpcds_q94/duckdb:vortex-compact	21838774 / 24707318 / -11.6% 🟢	30891079 / 29650330 / +4.2%	0.71 / 0.83 / -15.2%
tpcds_q95/duckdb:vortex-compact	46936302 / 46352452 / +1.3%	54297022 / 57023341 / -4.8%	0.86 / 0.81 / +6.3%
tpcds_q96/duckdb:vortex-compact	17077795 / 16929898 / +0.9%	23067259 / 25560658 / -9.8%	0.74 / 0.66 / +11.8%
tpcds_q97/duckdb:vortex-compact	25290870 / 25286598 / +0.0%	31300377 / 30951373 / +1.1%	0.81 / 0.82 / -1.1%
tpcds_q98/duckdb:vortex-compact	18135350 / 18032263 / +0.6%	27023813 / 26946862 / +0.3%	0.67 / 0.67 / +0.3%
tpcds_q99/duckdb:vortex-compact	16974242 / 16588358 / +2.3%	22244237 / 22397667 / -0.7%	0.76 / 0.74 / +3.0%

duckdb / parquet / ns (0.994x ➖, 4↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet	24638880 / 26956658 / -8.6%	31940255 / 31925605 / +0.0%	0.77 / 0.84 / -8.6%
tpcds_q02/duckdb:parquet	16294620 / 15712780 / +3.7%	20505111 / 20137192 / +1.8%	0.79 / 0.78 / +1.8%
tpcds_q03/duckdb:parquet	9217593 / 9053672 / +1.8%	15791914 / 16469508 / -4.1%	0.58 / 0.55 / +6.2%
tpcds_q04/duckdb:parquet	130733792 / 130635108 / +0.1%	135378917 / 134610202 / +0.6%	0.97 / 0.97 / -0.5%
tpcds_q05/duckdb:parquet	22009645 / 22272208 / -1.2%	26620972 / 25639081 / +3.8%	0.83 / 0.87 / -4.8%
tpcds_q06/duckdb:parquet	27070169 / 27232070 / -0.6%	37362785 / 41247876 / -9.4%	0.72 / 0.66 / +9.7%
tpcds_q07/duckdb:parquet	15412234 / 15593382 / -1.2%	23901084 / 23456346 / +1.9%	0.64 / 0.66 / -3.0%
tpcds_q08/duckdb:parquet	27800376 / 25493988 / +9.0%	36292441 / 33048380 / +9.8%	0.77 / 0.77 / -0.7%
tpcds_q09/duckdb:parquet	18900956 / 18766907 / +0.7%	22015654 / 26988641 / -18.4% 🟢	0.86 / 0.70 / +23.5%
tpcds_q10/duckdb:parquet	28169974 / 28824818 / -2.3%	37763937 / 40080659 / -5.8%	0.75 / 0.72 / +3.7%
tpcds_q11/duckdb:parquet	73386918 / 73267545 / +0.2%	78525430 / 77743406 / +1.0%	0.93 / 0.94 / -0.8%
tpcds_q12/duckdb:parquet	13065276 / 13970981 / -6.5%	17793908 / 20194269 / -11.9% 🟢	0.73 / 0.69 / +6.1%
tpcds_q13/duckdb:parquet	24220224 / 24392226 / -0.7%	30783985 / 30813801 / -0.1%	0.79 / 0.79 / -0.6%
tpcds_q14/duckdb:parquet	61122246 / 62121991 / -1.6%	71134934 / 68839359 / +3.3%	0.86 / 0.90 / -4.8%
tpcds_q15/duckdb:parquet	25275214 / 25611900 / -1.3%	31372621 / 30757899 / +2.0%	0.81 / 0.83 / -3.2%
tpcds_q16/duckdb:parquet	21071398 / 20893728 / +0.9%	29164884 / 29352358 / -0.6%	0.72 / 0.71 / +1.5%
tpcds_q17/duckdb:parquet	32724280 / 32719568 / +0.0%	40184468 / 39940487 / +0.6%	0.81 / 0.82 / -0.6%
tpcds_q18/duckdb:parquet	42042241 / 40178320 / +4.6%	51322505 / 50350154 / +1.9%	0.82 / 0.80 / +2.7%
tpcds_q19/duckdb:parquet	25111776 / 25670733 / -2.2%	31834533 / 38980949 / -18.3% 🟢	0.79 / 0.66 / +19.8%
tpcds_q20/duckdb:parquet	13817294 / 14000616 / -1.3%	22263236 / 21373905 / +4.2%	0.62 / 0.66 / -5.3%
tpcds_q21/duckdb:parquet	9497688 / 9451030 / +0.5%	12105375 / 15589494 / -22.3% 🟢	0.78 / 0.61 / +29.4%
tpcds_q22/duckdb:parquet	36281199 / 34787432 / +4.3%	39899503 / 39481074 / +1.1%	0.91 / 0.88 / +3.2%
tpcds_q23/duckdb:parquet	41376614 / 41526985 / -0.4%	48101829 / 48728936 / -1.3%	0.86 / 0.85 / +0.9%
tpcds_q24/duckdb:parquet	33968090 / 33822930 / +0.4%	45233850 / 42474894 / +6.5%	0.75 / 0.80 / -5.7%
tpcds_q25/duckdb:parquet	31455682 / 31496437 / -0.1%	40342840 / 39427841 / +2.3%	0.78 / 0.80 / -2.4%
tpcds_q26/duckdb:parquet	31719385 / 32108754 / -1.2%	39230895 / 41747061 / -6.0%	0.81 / 0.77 / +5.1%
tpcds_q27/duckdb:parquet	32091767 / 32060554 / +0.1%	39915396 / 39526642 / +1.0%	0.80 / 0.81 / -0.9%
tpcds_q28/duckdb:parquet	17461450 / 17650962 / -1.1%	23469987 / 21678485 / +8.3%	0.74 / 0.81 / -8.6%
tpcds_q29/duckdb:parquet	31580222 / 31158077 / +1.4%	39286596 / 41989007 / -6.4%	0.80 / 0.74 / +8.3%
tpcds_q30/duckdb:parquet	34236779 / 35842704 / -4.5%	42234983 / 42256278 / -0.1%	0.81 / 0.85 / -4.4%
tpcds_q31/duckdb:parquet	20741892 / 20662158 / +0.4%	26306527 / 25879372 / +1.7%	0.79 / 0.80 / -1.2%
tpcds_q32/duckdb:parquet	12101290 / 12174482 / -0.6%	18515184 / 18870417 / -1.9%	0.65 / 0.65 / +1.3%
tpcds_q33/duckdb:parquet	17974908 / 16668626 / +7.8%	26573924 / 23292461 / +14.1% 🔴	0.68 / 0.72 / -5.5%
tpcds_q34/duckdb:parquet	16461857 / 16477442 / -0.1%	22271260 / 22316574 / -0.2%	0.74 / 0.74 / +0.1%
tpcds_q35/duckdb:parquet	46981739 / 48182414 / -2.5%	55962343 / 56179082 / -0.4%	0.84 / 0.86 / -2.1%
tpcds_q36/duckdb:parquet	16120244 / 15865838 / +1.6%	24066800 / 26571046 / -9.4%	0.67 / 0.60 / +12.2%
tpcds_q37/duckdb:parquet	11503878 / 12938672 / -11.1% 🟢	16876503 / 16489376 / +2.3%	0.68 / 0.78 / -13.1%
tpcds_q38/duckdb:parquet	26610982 / 26907158 / -1.1%	30897809 / 31778747 / -2.8%	0.86 / 0.85 / +1.7%
tpcds_q39/duckdb:parquet	24781278 / 24683538 / +0.4%	28616353 / 29223536 / -2.1%	0.87 / 0.84 / +2.5%
tpcds_q40/duckdb:parquet	16379544 / 16427738 / -0.3%	22095648 / 21312269 / +3.7%	0.74 / 0.77 / -3.8%
tpcds_q41/duckdb:parquet	7809842 / 7879470 / -0.9%	13369785 / 13452893 / -0.6%	0.58 / 0.59 / -0.3%
tpcds_q42/duckdb:parquet	8748618 / 8761266 / -0.1%	15518215 / 15738878 / -1.4%	0.56 / 0.56 / +1.3%
tpcds_q43/duckdb:parquet	10721931 / 10778515 / -0.5%	14772778 / 15139898 / -2.4%	0.73 / 0.71 / +1.9%
tpcds_q44/duckdb:parquet	16699484 / 16026177 / +4.2%	21077703 / 23805529 / -11.5% 🟢	0.79 / 0.67 / +17.7%
tpcds_q45/duckdb:parquet	23712539 / 23429417 / +1.2%	28677040 / 28833548 / -0.5%	0.83 / 0.81 / +1.8%
tpcds_q46/duckdb:parquet	37170282 / 38696288 / -3.9%	44658709 / 44820720 / -0.4%	0.83 / 0.86 / -3.6%
tpcds_q47/duckdb:parquet	31276644 / 31409795 / -0.4%	37235018 / 37139178 / +0.3%	0.84 / 0.85 / -0.7%
tpcds_q48/duckdb:parquet	21197048 / 21255318 / -0.3%	27710498 / 27191651 / +1.9%	0.76 / 0.78 / -2.1%
tpcds_q49/duckdb:parquet	20301302 / 20306968 / -0.0%	27956579 / 27879149 / +0.3%	0.73 / 0.73 / -0.3%
tpcds_q50/duckdb:parquet	17930775 / 17997168 / -0.4%	24140497 / 23597101 / +2.3%	0.74 / 0.76 / -2.6%
tpcds_q51/duckdb:parquet	54946780 / 53611218 / +2.5%	64746841 / 60069185 / +7.8%	0.85 / 0.89 / -4.9%
tpcds_q52/duckdb:parquet	9088963 / 8923962 / +1.8%	18823620 / 16185440 / +16.3% 🔴	0.48 / 0.55 / -12.4%
tpcds_q53/duckdb:parquet	11660242 / 11896522 / -2.0%	16667387 / 16718704 / -0.3%	0.70 / 0.71 / -1.7%
tpcds_q54/duckdb:parquet	21039241 / 20680196 / +1.7%	29061578 / 29174669 / -0.4%	0.72 / 0.71 / +2.1%
tpcds_q55/duckdb:parquet	8915928 / 8813304 / +1.2%	15319876 / 15884400 / -3.6%	0.58 / 0.55 / +4.9%
tpcds_q56/duckdb:parquet	17195766 / 16876818 / +1.9%	23661419 / 23808275 / -0.6%	0.73 / 0.71 / +2.5%
tpcds_q57/duckdb:parquet	28918742 / 29006792 / -0.3%	37718431 / 34458570 / +9.5%	0.77 / 0.84 / -8.9%
tpcds_q58/duckdb:parquet	19457068 / 19215420 / +1.3%	26823926 / 26684468 / +0.5%	0.73 / 0.72 / +0.7%
tpcds_q59/duckdb:parquet	19997332 / 20247573 / -1.2%	25217149 / 25305190 / -0.3%	0.79 / 0.80 / -0.9%
tpcds_q60/duckdb:parquet	18556098 / 17602131 / +5.4%	28452838 / 24514254 / +16.1% 🔴	0.65 / 0.72 / -9.2%
tpcds_q61/duckdb:parquet	22159544 / 22321678 / -0.7%	28240101 / 29297290 / -3.6%	0.78 / 0.76 / +3.0%
tpcds_q62/duckdb:parquet	10913306 / 10894916 / +0.2%	14928082 / 14738305 / +1.3%	0.73 / 0.74 / -1.1%
tpcds_q63/duckdb:parquet	11207886 / 11275326 / -0.6%	16195557 / 16372510 / -1.1%	0.69 / 0.69 / +0.5%
tpcds_q64/duckdb:parquet	53455229 / 53391096 / +0.1%	63424664 / 67584742 / -6.2%	0.84 / 0.79 / +6.7%
tpcds_q65/duckdb:parquet	14742412 / 17319802 / -14.9% 🟢	20537460 / 24932344 / -17.6% 🟢	0.72 / 0.69 / +3.3%
tpcds_q66/duckdb:parquet	24779216 / 25029896 / -1.0%	31081700 / 30558978 / +1.7%	0.80 / 0.82 / -2.7%
tpcds_q67/duckdb:parquet	78410714 / 78984742 / -0.7%	89445843 / 84148527 / +6.3%	0.88 / 0.94 / -6.6%
tpcds_q68/duckdb:parquet	30382023 / 31097649 / -2.3%	39772903 / 38740235 / +2.7%	0.76 / 0.80 / -4.8%
tpcds_q69/duckdb:parquet	29323506 / 30425000 / -3.6%	39635579 / 38971668 / +1.7%	0.74 / 0.78 / -5.2%
tpcds_q70/duckdb:parquet	16092456 / 16229854 / -0.8%	28155797 / 24681884 / +14.1% 🔴	0.57 / 0.66 / -13.1%
tpcds_q71/duckdb:parquet	15294965 / 15001563 / +2.0%	21053792 / 20769317 / +1.4%	0.73 / 0.72 / +0.6%
tpcds_q72/duckdb:parquet	81556408 / 81646358 / -0.1%	86151293 / 86641030 / -0.6%	0.95 / 0.94 / +0.5%
tpcds_q73/duckdb:parquet	13762682 / 13836774 / -0.5%	20387929 / 19604856 / +4.0%	0.68 / 0.71 / -4.4%
tpcds_q74/duckdb:parquet	100212902 / 100275444 / -0.1%	108075232 / 110335207 / -2.0%	0.93 / 0.91 / +2.0%
tpcds_q75/duckdb:parquet	40907956 / 41043017 / -0.3%	51527248 / 50466873 / +2.1%	0.79 / 0.81 / -2.4%
tpcds_q76/duckdb:parquet	13730392 / 13723768 / +0.0%	20751109 / 20442303 / +1.5%	0.66 / 0.67 / -1.4%
tpcds_q77/duckdb:parquet	17552556 / 17406843 / +0.8%	24640799 / 25696434 / -4.1%	0.71 / 0.68 / +5.2%
tpcds_q78/duckdb:parquet	48733814 / 48595350 / +0.3%	53679556 / 61379279 / -12.5% 🟢	0.91 / 0.79 / +14.7%
tpcds_q79/duckdb:parquet	21261013 / 21171055 / +0.4%	28055699 / 28549859 / -1.7%	0.76 / 0.74 / +2.2%
tpcds_q80/duckdb:parquet	32921101 / 32806461 / +0.3%	40124507 / 39699621 / +1.1%	0.82 / 0.83 / -0.7%
tpcds_q81/duckdb:parquet	31682631 / 31985348 / -0.9%	40139261 / 42742751 / -6.1%	0.79 / 0.75 / +5.5%
tpcds_q82/duckdb:parquet	12674248 / 14101472 / -10.1% 🟢	17889274 / 19241429 / -7.0%	0.71 / 0.73 / -3.3%
tpcds_q83/duckdb:parquet	16736136 / 16591312 / +0.9%	21659004 / 21703623 / -0.2%	0.77 / 0.76 / +1.1%
tpcds_q84/duckdb:parquet	18538274 / 18683446 / -0.8%	24757702 / 24274772 / +2.0%	0.75 / 0.77 / -2.7%
tpcds_q85/duckdb:parquet	35796717 / 35472398 / +0.9%	45078752 / 44520725 / +1.3%	0.79 / 0.80 / -0.3%
tpcds_q86/duckdb:parquet	11422574 / 11375589 / +0.4%	16626380 / 16262735 / +2.2%	0.69 / 0.70 / -1.8%
tpcds_q87/duckdb:parquet	28633288 / 28318439 / +1.1%	33389754 / 33095421 / +0.9%	0.86 / 0.86 / +0.2%
tpcds_q88/duckdb:parquet	27217906 / 27203098 / +0.1%	31561493 / 32034139 / -1.5%	0.86 / 0.85 / +1.6%
tpcds_q89/duckdb:parquet	12872480 / 12868420 / +0.0%	18357361 / 21982032 / -16.5% 🟢	0.70 / 0.59 / +19.8%
tpcds_q90/duckdb:parquet	8468098 / 9120792 / -7.2%	13229135 / 11582046 / +14.2% 🔴	0.64 / 0.79 / -18.7%
tpcds_q91/duckdb:parquet	21457026 / 21594805 / -0.6%	29591154 / 31438070 / -5.9%	0.73 / 0.69 / +5.6%
tpcds_q92/duckdb:parquet	12455282 / 12400570 / +0.4%	19131854 / 18749242 / +2.0%	0.65 / 0.66 / -1.6%
tpcds_q93/duckdb:parquet	21459996 / 21792529 / -1.5%	26795706 / 26726166 / +0.3%	0.80 / 0.82 / -1.8%
tpcds_q94/duckdb:parquet	16903310 / 16993630 / -0.5%	26916516 / 28470748 / -5.5%	0.63 / 0.60 / +5.2%
tpcds_q95/duckdb:parquet	90909284 / 91467563 / -0.6%	96797404 / 98216877 / -1.4%	0.94 / 0.93 / +0.8%
tpcds_q96/duckdb:parquet	7180576 / 8177072 / -12.2% 🟢	10835512 / 16651453 / -34.9% 🟢	0.66 / 0.49 / +34.9%
tpcds_q97/duckdb:parquet	26188226 / 26158870 / +0.1%	32585693 / 31947630 / +2.0%	0.80 / 0.82 / -1.8%
tpcds_q98/duckdb:parquet	15206690 / 15397912 / -1.2%	22993319 / 22586455 / +1.8%	0.66 / 0.68 / -3.0%
tpcds_q99/duckdb:parquet	17237130 / 17454118 / -1.2%	21674340 / 21762319 / -0.4%	0.80 / 0.80 / -0.8%

duckdb / duckdb / ns (0.968x ➖, 13↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:duckdb	17047130 / 20426041 / -16.5% 🟢	24705633 / 27647032 / -10.6% 🟢	0.69 / 0.74 / -6.6%
tpcds_q02/duckdb:duckdb	11844304 / 11762635 / +0.7%	16643395 / 16103654 / +3.4%	0.71 / 0.73 / -2.6%
tpcds_q03/duckdb:duckdb	8252992 / 9272424 / -11.0% 🟢	16648966 / 14378334 / +15.8% 🔴	0.50 / 0.64 / -23.1%
tpcds_q04/duckdb:duckdb	140134588 / 141572866 / -1.0%	146878835 / 147759239 / -0.6%	0.95 / 0.96 / -0.4%
tpcds_q05/duckdb:duckdb	12884542 / 12850694 / +0.3%	17363731 / 17330620 / +0.2%	0.74 / 0.74 / +0.1%
tpcds_q06/duckdb:duckdb	21002978 / 20702898 / +1.4%	34154341 / 31459821 / +8.6%	0.61 / 0.66 / -6.6%
tpcds_q07/duckdb:duckdb	26267290 / 27875475 / -5.8%	33484713 / 35193954 / -4.9%	0.78 / 0.79 / -1.0%
tpcds_q08/duckdb:duckdb	111817048 / 111346916 / +0.4%	120519645 / 119782029 / +0.6%	0.93 / 0.93 / -0.2%
tpcds_q09/duckdb:duckdb	6789399 / 6522734 / +4.1%	9304059 / 9976910 / -6.7%	0.73 / 0.65 / +11.6%
tpcds_q10/duckdb:duckdb	20001375 / 18114634 / +10.4% 🔴	31133298 / 27770627 / +12.1% 🔴	0.64 / 0.65 / -1.5%
tpcds_q11/duckdb:duckdb	75609230 / 75619454 / -0.0%	82782814 / 80648148 / +2.6%	0.91 / 0.94 / -2.6%
tpcds_q12/duckdb:duckdb	9080155 / 9176858 / -1.1%	14602344 / 15260287 / -4.3%	0.62 / 0.60 / +3.4%
tpcds_q13/duckdb:duckdb	18000834 / 17913271 / +0.5%	24432080 / 31549672 / -22.6% 🟢	0.74 / 0.57 / +29.8%
tpcds_q14/duckdb:duckdb	55719442 / 56520434 / -1.4%	59161115 / 65910695 / -10.2% 🟢	0.94 / 0.86 / +9.8%
tpcds_q15/duckdb:duckdb	19332541 / 19313140 / +0.1%	24915756 / 24708756 / +0.8%	0.78 / 0.78 / -0.7%
tpcds_q16/duckdb:duckdb	15997728 / 17698295 / -9.6%	23897172 / 23328589 / +2.4%	0.67 / 0.76 / -11.8%
tpcds_q17/duckdb:duckdb	17825404 / 17735390 / +0.5%	26449835 / 26347562 / +0.4%	0.67 / 0.67 / +0.1%
tpcds_q18/duckdb:duckdb	34794366 / 36568520 / -4.9%	46536142 / 49110464 / -5.2%	0.75 / 0.74 / +0.4%
tpcds_q19/duckdb:duckdb	14579490 / 15034764 / -3.0%	22143538 / 25928606 / -14.6% 🟢	0.66 / 0.58 / +13.5%
tpcds_q20/duckdb:duckdb	9791164 / 12102982 / -19.1% 🟢	15122039 / 16241617 / -6.9%	0.65 / 0.75 / -13.1%
tpcds_q21/duckdb:duckdb	6121351 / 5772554 / +6.0%	11142768 / 7716777 / +44.4% 🔴	0.55 / 0.75 / -26.6%
tpcds_q22/duckdb:duckdb	32557430 / 32872626 / -1.0%	37467551 / 37838659 / -1.0%	0.87 / 0.87 / +0.0%
tpcds_q23/duckdb:duckdb	37543654 / 35945433 / +4.4%	46160907 / 55438323 / -16.7% 🟢	0.81 / 0.65 / +25.4%
tpcds_q24/duckdb:duckdb	19451988 / 19837302 / -1.9%	33811353 / 31797307 / +6.3%	0.58 / 0.62 / -7.8%
tpcds_q25/duckdb:duckdb	15624790 / 15765596 / -0.9%	24977380 / 25520267 / -2.1%	0.63 / 0.62 / +1.3%
tpcds_q26/duckdb:duckdb	20821806 / 23790430 / -12.5% 🟢	26720784 / 29818375 / -10.4% 🟢	0.78 / 0.80 / -2.3%
tpcds_q27/duckdb:duckdb	26508948 / 26941220 / -1.6%	36322317 / 38184321 / -4.9%	0.73 / 0.71 / +3.4%
tpcds_q28/duckdb:duckdb	8699620 / 9680362 / -10.1% 🟢	12778950 / 19341606 / -33.9% 🟢	0.68 / 0.50 / +36.0%
tpcds_q29/duckdb:duckdb	16291440 / 16264165 / +0.2%	25796878 / 29490136 / -12.5% 🟢	0.63 / 0.55 / +14.5%
tpcds_q30/duckdb:duckdb	25291912 / 25877956 / -2.3%	35183364 / 35248350 / -0.2%	0.72 / 0.73 / -2.1%
tpcds_q31/duckdb:duckdb	37619674 / 37647618 / -0.1%	41525767 / 42140921 / -1.5%	0.91 / 0.89 / +1.4%
tpcds_q32/duckdb:duckdb	6839052 / 9811740 / -30.3% 🟢	12843059 / 13204165 / -2.7%	0.53 / 0.74 / -28.3%
tpcds_q33/duckdb:duckdb	10739438 / 10742708 / -0.0%	15533574 / 15640305 / -0.7%	0.69 / 0.69 / +0.7%
tpcds_q34/duckdb:duckdb	12372123 / 12347778 / +0.2%	18570862 / 18818834 / -1.3%	0.67 / 0.66 / +1.5%
tpcds_q35/duckdb:duckdb	26256935 / 23938210 / +9.7%	30284895 / 29970404 / +1.0%	0.87 / 0.80 / +8.5%
tpcds_q36/duckdb:duckdb	60510804 / 59146758 / +2.3%	66967094 / 67467266 / -0.7%	0.90 / 0.88 / +3.1%
tpcds_q37/duckdb:duckdb	7891304 / 9219386 / -14.4% 🟢	12923007 / 15489243 / -16.6% 🟢	0.61 / 0.60 / +2.6%
tpcds_q38/duckdb:duckdb	23924922 / 24154470 / -1.0%	31334338 / 30699969 / +2.1%	0.76 / 0.79 / -3.0%
tpcds_q39/duckdb:duckdb	20919938 / 20846838 / +0.4%	23321040 / 23898332 / -2.4%	0.90 / 0.87 / +2.8%
tpcds_q40/duckdb:duckdb	11609556 / 11640612 / -0.3%	15801833 / 16347432 / -3.3%	0.73 / 0.71 / +3.2%
tpcds_q41/duckdb:duckdb	7796170 / 7637345 / +2.1%	16317268 / 16136345 / +1.1%	0.48 / 0.47 / +0.9%
tpcds_q42/duckdb:duckdb	5264320 / 7677116 / -31.4% 🟢	9339921 / 12516367 / -25.4% 🟢	0.56 / 0.61 / -8.1%
tpcds_q43/duckdb:duckdb	7575233 / 7600202 / -0.3%	11988562 / 14483139 / -17.2% 🟢	0.63 / 0.52 / +20.4%
tpcds_q44/duckdb:duckdb	9290974 / 9673502 / -4.0%	15287107 / 14288654 / +7.0%	0.61 / 0.68 / -10.2%
tpcds_q45/duckdb:duckdb	15373829 / 15835907 / -2.9%	22286610 / 22664578 / -1.7%	0.69 / 0.70 / -1.3%
tpcds_q46/duckdb:duckdb	30225806 / 30678694 / -1.5%	39100125 / 38971774 / +0.3%	0.77 / 0.79 / -1.8%
tpcds_q47/duckdb:duckdb	28583688 / 30579482 / -6.5%	35134362 / 47793856 / -26.5% 🟢	0.81 / 0.64 / +27.2%
tpcds_q48/duckdb:duckdb	16423512 / 16135299 / +1.8%	22141544 / 24926715 / -11.2% 🟢	0.74 / 0.65 / +14.6%
tpcds_q49/duckdb:duckdb	13237418 / 13200138 / +0.3%	21063961 / 22117751 / -4.8%	0.63 / 0.60 / +5.3%
tpcds_q50/duckdb:duckdb	11575834 / 11604130 / -0.2%	17972774 / 18511673 / -2.9%	0.64 / 0.63 / +2.7%
tpcds_q51/duckdb:duckdb	49516942 / 49863714 / -0.7%	62176805 / 56308363 / +10.4% 🔴	0.80 / 0.89 / -10.1%
tpcds_q52/duckdb:duckdb	5797420 / 6086419 / -4.7%	10206016 / 11190663 / -8.8%	0.57 / 0.54 / +4.4%
tpcds_q53/duckdb:duckdb	10585170 / 10699732 / -1.1%	16203800 / 16287074 / -0.5%	0.65 / 0.66 / -0.6%
tpcds_q54/duckdb:duckdb	14352086 / 14319707 / +0.2%	24962005 / 22708890 / +9.9%	0.57 / 0.63 / -8.8%
tpcds_q55/duckdb:duckdb	5824820 / 9284698 / -37.3% 🟢	10508513 / 10639787 / -1.2%	0.55 / 0.87 / -36.5%
tpcds_q56/duckdb:duckdb	11866336 / 11631000 / +2.0%	17047552 / 16940517 / +0.6%	0.70 / 0.69 / +1.4%
tpcds_q57/duckdb:duckdb	26483227 / 27360614 / -3.2%	31447123 / 38925059 / -19.2% 🟢	0.84 / 0.70 / +19.8%
tpcds_q58/duckdb:duckdb	10233794 / 10434094 / -1.9%	15833947 / 18663293 / -15.2% 🟢	0.65 / 0.56 / +15.6%
tpcds_q59/duckdb:duckdb	21340525 / 21014459 / +1.6%	26002646 / 25981316 / +0.1%	0.82 / 0.81 / +1.5%
tpcds_q60/duckdb:duckdb	12395702 / 12229556 / +1.4%	17854555 / 18277878 / -2.3%	0.69 / 0.67 / +3.8%
tpcds_q61/duckdb:duckdb	13297078 / 12689189 / +4.8%	19010382 / 19537558 / -2.7%	0.70 / 0.65 / +7.7%
tpcds_q62/duckdb:duckdb	7865260 / 7937164 / -0.9%	11667640 / 11897815 / -1.9%	0.67 / 0.67 / +1.0%
tpcds_q63/duckdb:duckdb	10223582 / 10361139 / -1.3%	15503379 / 16431618 / -5.6%	0.66 / 0.63 / +4.6%
tpcds_q64/duckdb:duckdb	39989159 / 40077988 / -0.2%	56810753 / 54280949 / +4.7%	0.70 / 0.74 / -4.7%
tpcds_q65/duckdb:duckdb	26997501 / 26226040 / +2.9%	34420444 / 33017048 / +4.3%	0.78 / 0.79 / -1.3%
tpcds_q66/duckdb:duckdb	20419906 / 20350602 / +0.3%	25777971 / 26066652 / -1.1%	0.79 / 0.78 / +1.5%
tpcds_q67/duckdb:duckdb	74550848 / 73550284 / +1.4%	84035958 / 81917681 / +2.6%	0.89 / 0.90 / -1.2%
tpcds_q68/duckdb:duckdb	20457640 / 21661417 / -5.6%	28400517 / 28372859 / +0.1%	0.72 / 0.76 / -5.6%
tpcds_q69/duckdb:duckdb	18923888 / 19111250 / -1.0%	30947795 / 27630133 / +12.0% 🔴	0.61 / 0.69 / -11.6%
tpcds_q70/duckdb:duckdb	11722281 / 11941553 / -1.8%	17639139 / 17649950 / -0.1%	0.66 / 0.68 / -1.8%
tpcds_q71/duckdb:duckdb	11111582 / 11164604 / -0.5%	17070497 / 18075389 / -5.6%	0.65 / 0.62 / +5.4%
tpcds_q72/duckdb:duckdb	34009341 / 34260436 / -0.7%	41888512 / 42520742 / -1.5%	0.81 / 0.81 / +0.8%
tpcds_q73/duckdb:duckdb	8609656 / 9884736 / -12.9% 🟢	15382422 / 14748071 / +4.3%	0.56 / 0.67 / -16.5%
tpcds_q74/duckdb:duckdb	124932701 / 124950222 / -0.0%	132212715 / 134266727 / -1.5%	0.94 / 0.93 / +1.5%
tpcds_q75/duckdb:duckdb	31509760 / 31713298 / -0.6%	40855644 / 40454842 / +1.0%	0.77 / 0.78 / -1.6%
tpcds_q76/duckdb:duckdb	8947878 / 8953918 / -0.1%	18900902 / 14782013 / +27.9% 🔴	0.47 / 0.61 / -21.8%
tpcds_q77/duckdb:duckdb	9670236 / 10080736 / -4.1%	14747283 / 16515780 / -10.7% 🟢	0.66 / 0.61 / +7.4%
tpcds_q78/duckdb:duckdb	38856254 / 39602724 / -1.9%	44333135 / 44438000 / -0.2%	0.88 / 0.89 / -1.7%
tpcds_q79/duckdb:duckdb	14960192 / 14916974 / +0.3%	21946354 / 22175199 / -1.0%	0.68 / 0.67 / +1.3%
tpcds_q80/duckdb:duckdb	21561339 / 21956850 / -1.8%	28315111 / 31517745 / -10.2% 🟢	0.76 / 0.70 / +9.3%
tpcds_q81/duckdb:duckdb	33143366 / 33372563 / -0.7%	43894362 / 44187679 / -0.7%	0.76 / 0.76 / -0.0%
tpcds_q82/duckdb:duckdb	7271028 / 8706515 / -16.5% 🟢	13314953 / 13765958 / -3.3%	0.55 / 0.63 / -13.7%
tpcds_q83/duckdb:duckdb	8723370 / 8479810 / +2.9%	12667457 / 12937219 / -2.1%	0.69 / 0.66 / +5.1%
tpcds_q84/duckdb:duckdb	12016780 / 12145854 / -1.1%	19094125 / 19645581 / -2.8%	0.63 / 0.62 / +1.8%
tpcds_q85/duckdb:duckdb	19350267 / 19625871 / -1.4%	28169810 / 28216358 / -0.2%	0.69 / 0.70 / -1.2%
tpcds_q86/duckdb:duckdb	9168946 / 11719890 / -21.8% 🟢	13504464 / 16046380 / -15.8% 🟢	0.68 / 0.73 / -7.0%
tpcds_q87/duckdb:duckdb	26105974 / 26016189 / +0.3%	32116078 / 30756187 / +4.4%	0.81 / 0.85 / -3.9%
tpcds_q88/duckdb:duckdb	15109520 / 15521036 / -2.7%	19880524 / 20245490 / -1.8%	0.76 / 0.77 / -0.9%
tpcds_q89/duckdb:duckdb	11466300 / 11982639 / -4.3%	16899123 / 18318660 / -7.7%	0.68 / 0.65 / +3.7%
tpcds_q90/duckdb:duckdb	5009548 / 5043840 / -0.7%	8968107 / 8650165 / +3.7%	0.56 / 0.58 / -4.2%
tpcds_q91/duckdb:duckdb	11547738 / 11688279 / -1.2%	19741906 / 20282475 / -2.7%	0.58 / 0.58 / +1.5%
tpcds_q92/duckdb:duckdb	8362954 / 8416990 / -0.6%	15112936 / 15505999 / -2.5%	0.55 / 0.54 / +1.9%
tpcds_q93/duckdb:duckdb	15525708 / 15961771 / -2.7%	20100098 / 20557603 / -2.2%	0.77 / 0.78 / -0.5%
tpcds_q94/duckdb:duckdb	12060743 / 12178449 / -1.0%	23727781 / 20722639 / +14.5% 🔴	0.51 / 0.59 / -13.5%
tpcds_q95/duckdb:duckdb	79500926 / 79878958 / -0.5%	86051353 / 87694084 / -1.9%	0.92 / 0.91 / +1.4%
tpcds_q96/duckdb:duckdb	3708679 / 3783360 / -2.0%	7521620 / 7309688 / +2.9%	0.49 / 0.52 / -4.7%
tpcds_q97/duckdb:duckdb	21773553 / 21589790 / +0.9%	26113016 / 28514704 / -8.4%	0.83 / 0.76 / +10.1%
tpcds_q98/duckdb:duckdb	11103227 / 13153936 / -15.6% 🟢	17012418 / 17990900 / -5.4%	0.65 / 0.73 / -10.7%
tpcds_q99/duckdb:duckdb	13580582 / 13650138 / -0.5%	17833515 / 17147307 / +4.0%	0.76 / 0.80 / -4.3%

No file size changes detected.

github-actions · 2026-10-09T15:22:47Z

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 1.003x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.012x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	97339942 / 93291149 / +4.3%	169689027 / 167253840 / +1.5%	0.57 / 0.56 / +2.8%
tpch_q02/datafusion:vortex-file-compressed	63654699 / 64987354 / -2.1%	95503074 / 101336068 / -5.8%	0.67 / 0.64 / +3.9%
tpch_q03/datafusion:vortex-file-compressed	64635822 / 64786290 / -0.2%	115119240 / 121167796 / -5.0%	0.56 / 0.53 / +5.0%
tpch_q04/datafusion:vortex-file-compressed	35226832 / 35201513 / +0.1%	78435158 / 81360538 / -3.6%	0.45 / 0.43 / +3.8%
tpch_q05/datafusion:vortex-file-compressed	114876222 / 116365897 / -1.3%	182364374 / 180959608 / +0.8%	0.63 / 0.64 / -2.0%
tpch_q06/datafusion:vortex-file-compressed	14267825 / 14141962 / +0.9%	75631899 / 74549805 / +1.5%	0.19 / 0.19 / -0.6%
tpch_q07/datafusion:vortex-file-compressed	138370252 / 140695662 / -1.7%	202272227 / 202115334 / +0.1%	0.68 / 0.70 / -1.7%
tpch_q08/datafusion:vortex-file-compressed	146122026 / 143492820 / +1.8%	203101603 / 209105540 / -2.9%	0.72 / 0.69 / +4.8%
tpch_q09/datafusion:vortex-file-compressed	189922456 / 186426493 / +1.9%	265446640 / 256769660 / +3.4%	0.72 / 0.73 / -1.5%
tpch_q10/datafusion:vortex-file-compressed	72801825 / 73606820 / -1.1%	138344113 / 142880559 / -3.2%	0.53 / 0.52 / +2.1%
tpch_q11/datafusion:vortex-file-compressed	43274029 / 42987138 / +0.7%	70458321 / 69464721 / +1.4%	0.61 / 0.62 / -0.8%
tpch_q12/datafusion:vortex-file-compressed	43689512 / 44665961 / -2.2%	93197516 / 94195810 / -1.1%	0.47 / 0.47 / -1.1%
tpch_q13/datafusion:vortex-file-compressed	46800438 / 46678780 / +0.3%	76708631 / 79889733 / -4.0%	0.61 / 0.58 / +4.4%
tpch_q14/datafusion:vortex-file-compressed	25487759 / 24865785 / +2.5%	99617783 / 100014853 / -0.4%	0.26 / 0.25 / +2.9%
tpch_q15/datafusion:vortex-file-compressed	36695924 / 36158558 / +1.5%	103687025 / 99371507 / +4.3%	0.35 / 0.36 / -2.7%
tpch_q16/datafusion:vortex-file-compressed	37471417 / 37316994 / +0.4%	68426074 / 71134789 / -3.8%	0.55 / 0.52 / +4.4%
tpch_q17/datafusion:vortex-file-compressed	172545215 / 176160767 / -2.1%	219884020 / 223386459 / -1.6%	0.78 / 0.79 / -0.5%
tpch_q18/datafusion:vortex-file-compressed	202200662 / 203276022 / -0.5%	263315259 / 262916736 / +0.2%	0.77 / 0.77 / -0.7%
tpch_q19/datafusion:vortex-file-compressed	34026121 / 33932671 / +0.3%	101228877 / 97046165 / +4.3%	0.34 / 0.35 / -3.9%
tpch_q20/datafusion:vortex-file-compressed	63152554 / 64100726 / -1.5%	126256669 / 124616983 / +1.3%	0.50 / 0.51 / -2.8%
tpch_q21/datafusion:vortex-file-compressed	180366629 / 181923942 / -0.9%	238094086 / 242015675 / -1.6%	0.76 / 0.75 / +0.8%
tpch_q22/datafusion:vortex-file-compressed	25714463 / 25764322 / -0.2%	56667253 / 55982851 / +1.2%	0.45 / 0.46 / -1.4%

datafusion / vortex-compact / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	99859438 / 101130497 / -1.3%	167495812 / 155500004 / +7.7%	0.60 / 0.65 / -8.3%
tpch_q02/datafusion:vortex-compact	65917807 / 66265412 / -0.5%	97890949 / 94915886 / +3.1%	0.67 / 0.70 / -3.5%
tpch_q03/datafusion:vortex-compact	65856575 / 65658971 / +0.3%	113306127 / 115393516 / -1.8%	0.58 / 0.57 / +2.1%
tpch_q04/datafusion:vortex-compact	41722517 / 41191716 / +1.3%	79498897 / 86873924 / -8.5%	0.52 / 0.47 / +10.7%
tpch_q05/datafusion:vortex-compact	118691772 / 119588927 / -0.8%	169858515 / 167345077 / +1.5%	0.70 / 0.71 / -2.2%
tpch_q06/datafusion:vortex-compact	17379011 / 18230718 / -4.7%	67079831 / 66873449 / +0.3%	0.26 / 0.27 / -5.0%
tpch_q07/datafusion:vortex-compact	142679580 / 143098943 / -0.3%	181459480 / 193784423 / -6.4%	0.79 / 0.74 / +6.5%
tpch_q08/datafusion:vortex-compact	142217232 / 143379391 / -0.8%	204164238 / 206215641 / -1.0%	0.70 / 0.70 / +0.2%
tpch_q09/datafusion:vortex-compact	182393915 / 186411286 / -2.2%	241724597 / 252286340 / -4.2%	0.75 / 0.74 / +2.1%
tpch_q10/datafusion:vortex-compact	77865419 / 78989545 / -1.4%	129764351 / 126799464 / +2.3%	0.60 / 0.62 / -3.7%
tpch_q11/datafusion:vortex-compact	43720478 / 43152364 / +1.3%	69537200 / 67314241 / +3.3%	0.63 / 0.64 / -1.9%
tpch_q12/datafusion:vortex-compact	57470190 / 56962604 / +0.9%	98777038 / 96582483 / +2.3%	0.58 / 0.59 / -1.4%
tpch_q13/datafusion:vortex-compact	53426885 / 53727155 / -0.6%	80265068 / 79322962 / +1.2%	0.67 / 0.68 / -1.7%
tpch_q14/datafusion:vortex-compact	27974765 / 27232335 / +2.7%	97169781 / 98545088 / -1.4%	0.29 / 0.28 / +4.2%
tpch_q15/datafusion:vortex-compact	44743930 / 45371636 / -1.4%	98590891 / 103059628 / -4.3%	0.45 / 0.44 / +3.1%
tpch_q16/datafusion:vortex-compact	39411149 / 40060011 / -1.6%	69841257 / 67429592 / +3.6%	0.56 / 0.59 / -5.0%
tpch_q17/datafusion:vortex-compact	171598294 / 169342121 / +1.3%	217941230 / 215006511 / +1.4%	0.79 / 0.79 / -0.0%
tpch_q18/datafusion:vortex-compact	205998048 / 203050007 / +1.5%	261451445 / 253973739 / +2.9%	0.79 / 0.80 / -1.4%
tpch_q19/datafusion:vortex-compact	40620200 / 41414433 / -1.9%	85179944 / 88217007 / -3.4%	0.48 / 0.47 / +1.6%
tpch_q20/datafusion:vortex-compact	66473721 / 65598068 / +1.3%	116498216 / 116290540 / +0.2%	0.57 / 0.56 / +1.2%
tpch_q21/datafusion:vortex-compact	191133833 / 191815729 / -0.4%	250622632 / 242891654 / +3.2%	0.76 / 0.79 / -3.4%
tpch_q22/datafusion:vortex-compact	26451334 / 26980659 / -2.0%	54856565 / 54338642 / +1.0%	0.48 / 0.50 / -2.9%

datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	86672800 / 87132828 / -0.5%	133826851 / 133479397 / +0.3%	0.65 / 0.65 / -0.8%
tpch_q02/datafusion:parquet	157585480 / 158260690 / -0.4%	188726552 / 186636621 / +1.1%	0.83 / 0.85 / -1.5%
tpch_q03/datafusion:parquet	143167828 / 142694662 / +0.3%	207352310 / 193470169 / +7.2%	0.69 / 0.74 / -6.4%
tpch_q04/datafusion:parquet	59248510 / 59638519 / -0.7%	103299931 / 103750220 / -0.4%	0.57 / 0.57 / -0.2%
tpch_q05/datafusion:parquet	181201761 / 179865367 / +0.7%	241471803 / 241363858 / +0.0%	0.75 / 0.75 / +0.7%
tpch_q06/datafusion:parquet	35421059 / 35185198 / +0.7%	84006427 / 82852895 / +1.4%	0.42 / 0.42 / -0.7%
tpch_q07/datafusion:parquet	233400937 / 230211079 / +1.4%	297932795 / 292213194 / +2.0%	0.78 / 0.79 / -0.6%
tpch_q08/datafusion:parquet	233808123 / 234781031 / -0.4%	302603600 / 304714483 / -0.7%	0.77 / 0.77 / +0.3%
tpch_q09/datafusion:parquet	314538711 / 312855862 / +0.5%	388278496 / 386008602 / +0.6%	0.81 / 0.81 / -0.0%
tpch_q10/datafusion:parquet	406698539 / 406701190 / -0.0%	467115430 / 465079586 / +0.4%	0.87 / 0.87 / -0.4%
tpch_q11/datafusion:parquet	104893763 / 104930246 / -0.0%	133122407 / 131598240 / +1.2%	0.79 / 0.80 / -1.2%
tpch_q12/datafusion:parquet	84362074 / 84856347 / -0.6%	132054196 / 129291102 / +2.1%	0.64 / 0.66 / -2.7%
tpch_q13/datafusion:parquet	227889475 / 228669430 / -0.3%	261237609 / 260745521 / +0.2%	0.87 / 0.88 / -0.5%
tpch_q14/datafusion:parquet	87389736 / 87607499 / -0.2%	200711027 / 192517434 / +4.3%	0.44 / 0.46 / -4.3%
tpch_q15/datafusion:parquet	90264117 / 89869959 / +0.4%	145935174 / 143254626 / +1.9%	0.62 / 0.63 / -1.4%
tpch_q16/datafusion:parquet	94404018 / 94419679 / -0.0%	123226822 / 124993176 / -1.4%	0.77 / 0.76 / +1.4%
tpch_q17/datafusion:parquet	217949783 / 215919463 / +0.9%	279592350 / 276732498 / +1.0%	0.78 / 0.78 / -0.1%
tpch_q18/datafusion:parquet	288642340 / 293455005 / -1.6%	335133145 / 334845721 / +0.1%	0.86 / 0.88 / -1.7%
tpch_q19/datafusion:parquet	109284447 / 109099047 / +0.2%	176208158 / 172671310 / +2.0%	0.62 / 0.63 / -1.8%
tpch_q20/datafusion:parquet	183742659 / 183793562 / -0.0%	247405211 / 244737762 / +1.1%	0.74 / 0.75 / -1.1%
tpch_q21/datafusion:parquet	243731440 / 243144424 / +0.2%	317573702 / 316916670 / +0.2%	0.77 / 0.77 / +0.0%
tpch_q22/datafusion:parquet	198775271 / 198986222 / -0.1%	222759932 / 224226040 / -0.7%	0.89 / 0.89 / +0.6%

duckdb / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	53623537 / 54617200 / -1.8%	101412102 / 102478102 / -1.0%	0.53 / 0.53 / -0.8%
tpch_q02/duckdb:vortex-file-compressed	34470190 / 31439398 / +9.6%	49136170 / 45634458 / +7.7%	0.70 / 0.69 / +1.8%
tpch_q03/duckdb:vortex-file-compressed	58554570 / 57626315 / +1.6%	128019601 / 113506463 / +12.8% 🔴	0.46 / 0.51 / -9.9%
tpch_q04/duckdb:vortex-file-compressed	80744315 / 82303246 / -1.9%	122937232 / 124691792 / -1.4%	0.66 / 0.66 / -0.5%
tpch_q05/duckdb:vortex-file-compressed	65411897 / 64861448 / +0.8%	138316019 / 124542498 / +11.1% 🔴	0.47 / 0.52 / -9.2%
tpch_q06/duckdb:vortex-file-compressed	21785989 / 22038093 / -1.1%	67274299 / 69052299 / -2.6%	0.32 / 0.32 / +1.5%
tpch_q07/duckdb:vortex-file-compressed	60773388 / 60298984 / +0.8%	142078470 / 134807659 / +5.4%	0.43 / 0.45 / -4.4%
tpch_q08/duckdb:vortex-file-compressed	81898966 / 86789982 / -5.6%	151998529 / 165016546 / -7.9%	0.54 / 0.53 / +2.4%
tpch_q09/duckdb:vortex-file-compressed	168429930 / 164869653 / +2.2%	244299489 / 248134080 / -1.5%	0.69 / 0.66 / +3.8%
tpch_q10/duckdb:vortex-file-compressed	109480316 / 108773914 / +0.6%	168187194 / 174758489 / -3.8%	0.65 / 0.62 / +4.6%
tpch_q11/duckdb:vortex-file-compressed	17425510 / 17027129 / +2.3%	31538263 / 31826713 / -0.9%	0.55 / 0.53 / +3.3%
tpch_q12/duckdb:vortex-file-compressed	53396651 / 53776073 / -0.7%	111491182 / 104449249 / +6.7%	0.48 / 0.51 / -7.0%
tpch_q13/duckdb:vortex-file-compressed	90489305 / 91821154 / -1.5%	140715048 / 142172488 / -1.0%	0.64 / 0.65 / -0.4%
tpch_q14/duckdb:vortex-file-compressed	32548734 / 31855834 / +2.2%	91382971 / 84092082 / +8.7%	0.36 / 0.38 / -6.0%
tpch_q15/duckdb:vortex-file-compressed	40409169 / 39575855 / +2.1%	96696926 / 91807692 / +5.3%	0.42 / 0.43 / -3.1%
tpch_q16/duckdb:vortex-file-compressed	42441491 / 42533427 / -0.2%	56000939 / 55143864 / +1.6%	0.76 / 0.77 / -1.7%
tpch_q17/duckdb:vortex-file-compressed	61331647 / 59073824 / +3.8%	132699663 / 125536009 / +5.7%	0.46 / 0.47 / -1.8%
tpch_q18/duckdb:vortex-file-compressed	132982343 / 139961309 / -5.0%	166755255 / 162203031 / +2.8%	0.80 / 0.86 / -7.6%
tpch_q19/duckdb:vortex-file-compressed	42426524 / 39564686 / +7.2%	100594900 / 95113825 / +5.8%	0.42 / 0.42 / +1.4%
tpch_q20/duckdb:vortex-file-compressed	59251051 / 60549000 / -2.1%	121787968 / 124227405 / -2.0%	0.49 / 0.49 / -0.2%
tpch_q21/duckdb:vortex-file-compressed	241072983 / 238884515 / +0.9%	296596556 / 279907346 / +6.0%	0.81 / 0.85 / -4.8%
tpch_q22/duckdb:vortex-file-compressed	41476624 / 42067868 / -1.4%	60953278 / 62551377 / -2.6%	0.68 / 0.67 / +1.2%

duckdb / vortex-compact / ns (0.992x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	64694633 / 69767779 / -7.3%	94837280 / 105704427 / -10.3% 🟢	0.68 / 0.66 / +3.4%
tpch_q02/duckdb:vortex-compact	34858090 / 35009734 / -0.4%	50520164 / 50430766 / +0.2%	0.69 / 0.69 / -0.6%
tpch_q03/duckdb:vortex-compact	61250267 / 63170850 / -3.0%	108631107 / 104086236 / +4.4%	0.56 / 0.61 / -7.1%
tpch_q04/duckdb:vortex-compact	88802166 / 90040902 / -1.4%	121894306 / 119712284 / +1.8%	0.73 / 0.75 / -3.1%
tpch_q05/duckdb:vortex-compact	70119377 / 70697229 / -0.8%	126858182 / 133489931 / -5.0%	0.55 / 0.53 / +4.4%
tpch_q06/duckdb:vortex-compact	23829418 / 23975971 / -0.6%	64142993 / 64869354 / -1.1%	0.37 / 0.37 / +0.5%
tpch_q07/duckdb:vortex-compact	71650056 / 71300434 / +0.5%	140363007 / 139757801 / +0.4%	0.51 / 0.51 / +0.1%
tpch_q08/duckdb:vortex-compact	88698394 / 92118774 / -3.7%	146719647 / 151369549 / -3.1%	0.60 / 0.61 / -0.7%
tpch_q09/duckdb:vortex-compact	171685605 / 174846361 / -1.8%	244973469 / 236993533 / +3.4%	0.70 / 0.74 / -5.0%
tpch_q10/duckdb:vortex-compact	116155474 / 116130056 / +0.0%	155940507 / 163170965 / -4.4%	0.74 / 0.71 / +4.7%
tpch_q11/duckdb:vortex-compact	18538860 / 18754724 / -1.2%	34904209 / 34595366 / +0.9%	0.53 / 0.54 / -2.0%
tpch_q12/duckdb:vortex-compact	70283107 / 68909942 / +2.0%	112388704 / 109573990 / +2.6%	0.63 / 0.63 / -0.6%
tpch_q13/duckdb:vortex-compact	97729943 / 96612559 / +1.2%	145281419 / 149889042 / -3.1%	0.67 / 0.64 / +4.4%
tpch_q14/duckdb:vortex-compact	36058736 / 34576279 / +4.3%	78445575 / 76348220 / +2.7%	0.46 / 0.45 / +1.5%
tpch_q15/duckdb:vortex-compact	44468832 / 43482820 / +2.3%	111579608 / 99857262 / +11.7% 🔴	0.40 / 0.44 / -8.5%
tpch_q16/duckdb:vortex-compact	44362414 / 44728985 / -0.8%	57650046 / 55649810 / +3.6%	0.77 / 0.80 / -4.3%
tpch_q17/duckdb:vortex-compact	57422912 / 58126290 / -1.2%	105316625 / 106562018 / -1.2%	0.55 / 0.55 / -0.0%
tpch_q18/duckdb:vortex-compact	149140614 / 146579975 / +1.7%	161585442 / 164163041 / -1.6%	0.92 / 0.89 / +3.4%
tpch_q19/duckdb:vortex-compact	43539819 / 45359628 / -4.0%	86499218 / 93214202 / -7.2%	0.50 / 0.49 / +3.4%
tpch_q20/duckdb:vortex-compact	67280866 / 68798754 / -2.2%	132283268 / 136827739 / -3.3%	0.51 / 0.50 / +1.2%
tpch_q21/duckdb:vortex-compact	256496526 / 260153364 / -1.4%	292592077 / 292641208 / -0.0%	0.88 / 0.89 / -1.4%
tpch_q22/duckdb:vortex-compact	44194669 / 44059655 / +0.3%	66569032 / 67286745 / -1.1%	0.66 / 0.65 / +1.4%

duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	72702188 / 72442833 / +0.4%	93151853 / 87883030 / +6.0%	0.78 / 0.82 / -5.3%
tpch_q02/duckdb:parquet	80559663 / 81138906 / -0.7%	91904119 / 92253960 / -0.4%	0.88 / 0.88 / -0.3%
tpch_q03/duckdb:parquet	118431144 / 121735789 / -2.7%	148595593 / 147735196 / +0.6%	0.80 / 0.82 / -3.3%
tpch_q04/duckdb:parquet	76193859 / 76345675 / -0.2%	94812151 / 96800292 / -2.1%	0.80 / 0.79 / +1.9%
tpch_q05/duckdb:parquet	129481566 / 129107434 / +0.3%	191506704 / 163486679 / +17.1% 🔴	0.68 / 0.79 / -14.4%
tpch_q06/duckdb:parquet	33569715 / 33598280 / -0.1%	48325287 / 46909491 / +3.0%	0.69 / 0.72 / -3.0%
tpch_q07/duckdb:parquet	93308731 / 93280322 / +0.0%	129544806 / 129563916 / -0.0%	0.72 / 0.72 / +0.0%
tpch_q08/duckdb:parquet	150270478 / 150640540 / -0.2%	192126292 / 211600903 / -9.2%	0.78 / 0.71 / +9.9%
tpch_q09/duckdb:parquet	229220442 / 229087854 / +0.1%	264703304 / 289055842 / -8.4%	0.87 / 0.79 / +9.3%
tpch_q10/duckdb:parquet	512135319 / 513994066 / -0.4%	545283905 / 551214961 / -1.1%	0.94 / 0.93 / +0.7%
tpch_q11/duckdb:parquet	33603316 / 33793082 / -0.6%	38743523 / 39204378 / -1.2%	0.87 / 0.86 / +0.6%
tpch_q12/duckdb:parquet	76576618 / 75994564 / +0.8%	87855621 / 87065753 / +0.9%	0.87 / 0.87 / -0.1%
tpch_q13/duckdb:parquet	322321189 / 324303259 / -0.6%	341119899 / 333281026 / +2.4%	0.94 / 0.97 / -2.9%
tpch_q14/duckdb:parquet	109340073 / 111766463 / -2.2%	137005798 / 134754256 / +1.7%	0.80 / 0.83 / -3.8%
tpch_q15/duckdb:parquet	43416931 / 42952783 / +1.1%	78214019 / 70767699 / +10.5% 🔴	0.56 / 0.61 / -8.5%
tpch_q16/duckdb:parquet	118638985 / 119446077 / -0.7%	132057657 / 128438168 / +2.8%	0.90 / 0.93 / -3.4%
tpch_q17/duckdb:parquet	80170968 / 80230926 / -0.1%	119754624 / 105060949 / +14.0% 🔴	0.67 / 0.76 / -12.3%
tpch_q18/duckdb:parquet	207227596 / 214916782 / -3.6%	174201328 / 180231636 / -3.3%	1.19 / 1.19 / -0.2%
tpch_q19/duckdb:parquet	165859469 / 165583788 / +0.2%	195674937 / 194719329 / +0.5%	0.85 / 0.85 / -0.3%
tpch_q20/duckdb:parquet	135415583 / 135311872 / +0.1%	168879529 / 171796208 / -1.7%	0.80 / 0.79 / +1.8%
tpch_q21/duckdb:parquet	277628271 / 278217844 / -0.2%	297741049 / 296823757 / +0.3%	0.93 / 0.94 / -0.5%
tpch_q22/duckdb:parquet	269158689 / 269097700 / +0.0%	279718237 / 280509869 / -0.3%	0.96 / 0.96 / +0.3%

duckdb / duckdb / ns (1.005x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb	37761855 / 37765772 / -0.0%	60231457 / 61414821 / -1.9%	0.63 / 0.61 / +2.0%
tpch_q02/duckdb:duckdb	31672334 / 33838177 / -6.4%	47552728 / 48405452 / -1.8%	0.67 / 0.70 / -4.7%
tpch_q03/duckdb:duckdb	51371036 / 51650581 / -0.5%	80784271 / 85521618 / -5.5%	0.64 / 0.60 / +5.3%
tpch_q04/duckdb:duckdb	73142665 / 73272683 / -0.2%	98086834 / 99884023 / -1.8%	0.75 / 0.73 / +1.7%
tpch_q05/duckdb:duckdb	59739328 / 59749389 / -0.0%	95462122 / 91291556 / +4.6%	0.63 / 0.65 / -4.4%
tpch_q06/duckdb:duckdb	29447262 / 26372583 / +11.7% 🔴	49692302 / 46543288 / +6.8%	0.59 / 0.57 / +4.6%
tpch_q07/duckdb:duckdb	48961801 / 48582300 / +0.8%	85026118 / 89315536 / -4.8%	0.58 / 0.54 / +5.9%
tpch_q08/duckdb:duckdb	68832083 / 69365113 / -0.8%	106578055 / 113071471 / -5.7%	0.65 / 0.61 / +5.3%
tpch_q09/duckdb:duckdb	141143327 / 132033825 / +6.9%	168895841 / 177065997 / -4.6%	0.84 / 0.75 / +12.1%
tpch_q10/duckdb:duckdb	99499699 / 99174239 / +0.3%	134285403 / 134619419 / -0.2%	0.74 / 0.74 / +0.6%
tpch_q11/duckdb:duckdb	12216869 / 12159799 / +0.5%	18281126 / 17867726 / +2.3%	0.67 / 0.68 / -1.8%
tpch_q12/duckdb:duckdb	45906439 / 45476780 / +0.9%	70315859 / 66702277 / +5.4%	0.65 / 0.68 / -4.2%
tpch_q13/duckdb:duckdb	89852115 / 90537080 / -0.8%	116657216 / 119293418 / -2.2%	0.77 / 0.76 / +1.5%
tpch_q14/duckdb:duckdb	43863926 / 44230532 / -0.8%	69325421 / 75385279 / -8.0%	0.63 / 0.59 / +7.8%
tpch_q15/duckdb:duckdb	36998458 / 36857670 / +0.4%	65891273 / 62677736 / +5.1%	0.56 / 0.59 / -4.5%
tpch_q16/duckdb:duckdb	43461907 / 44728814 / -2.8%	49922217 / 56867683 / -12.2% 🟢	0.87 / 0.79 / +10.7%
tpch_q17/duckdb:duckdb	46590405 / 46307626 / +0.6%	75817175 / 73103628 / +3.7%	0.61 / 0.63 / -3.0%
tpch_q18/duckdb:duckdb	97509489 / 91806711 / +6.2%	107983715 / 105268679 / +2.6%	0.90 / 0.87 / +3.5%
tpch_q19/duckdb:duckdb	47450399 / 48466956 / -2.1%	80388786 / 82490184 / -2.5%	0.59 / 0.59 / +0.5%
tpch_q20/duckdb:duckdb	51851847 / 51917540 / -0.1%	89951704 / 95940928 / -6.2%	0.58 / 0.54 / +6.5%
tpch_q21/duckdb:duckdb	173509193 / 174809335 / -0.7%	202984305 / 202585232 / +0.2%	0.85 / 0.86 / -0.9%
tpch_q22/duckdb:duckdb	41287906 / 41544232 / -0.6%	48044176 / 50810909 / -5.4%	0.86 / 0.82 / +5.1%

No file size changes detected.

github-actions · 2026-10-09T15:22:51Z

Benchmarks: Statistical and Population Genetics 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.992x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.006x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed	1814310 / 1845013 / -1.7%	5995088 / 6435400 / -6.8%	0.30 / 0.29 / +5.6%
statpopgen_q01/datafusion:vortex-file-compressed	24658850 / 24646054 / +0.1%	23417276 / 22753451 / +2.9%	1.05 / 1.08 / -2.8%
statpopgen_q02/datafusion:vortex-file-compressed	108187788 / 110248709 / -1.9%	140295016 / 142271864 / -1.4%	0.77 / 0.77 / -0.5%
statpopgen_q03/datafusion:vortex-file-compressed	350401988 / 352330805 / -0.5%	385970284 / 383083517 / +0.8%	0.91 / 0.92 / -1.3%
statpopgen_q04/datafusion:vortex-file-compressed	375402784 / 380980592 / -1.5%	384659827 / 548348127 / -29.9% 🟢	0.98 / 0.69 / +40.5%
statpopgen_q05/datafusion:vortex-file-compressed	211956729 / 212427988 / -0.2%	254659228 / 255941544 / -0.5%	0.83 / 0.83 / +0.3%
statpopgen_q06/datafusion:vortex-file-compressed	804356092 / 745108499 / +8.0%	791779520 / 777456352 / +1.8%	1.02 / 0.96 / +6.0%
statpopgen_q07/datafusion:vortex-file-compressed	429526910 / 428116157 / +0.3%	448522661 / 449865754 / -0.3%	0.96 / 0.95 / +0.6%
statpopgen_q08/datafusion:vortex-file-compressed	429086442 / 429398018 / -0.1%	448609488 / 440103317 / +1.9%	0.96 / 0.98 / -2.0%
statpopgen_q09/datafusion:vortex-file-compressed	242264846 / 244794538 / -1.0%	284690148 / 278204410 / +2.3%	0.85 / 0.88 / -3.3%
statpopgen_q10/datafusion:vortex-file-compressed	758036220 / 750170092 / +1.0%	793776330 / 765406545 / +3.7%	0.95 / 0.98 / -2.6%

datafusion / vortex-compact / ns (1.005x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact	1862715 / 1797221 / +3.6%	5978933 / 6126713 / -2.4%	0.31 / 0.29 / +6.2%
statpopgen_q01/datafusion:vortex-compact	26053078 / 26126196 / -0.3%	23503754 / 23323373 / +0.8%	1.11 / 1.12 / -1.0%
statpopgen_q02/datafusion:vortex-compact	215359438 / 211226485 / +2.0%	231184842 / 231142199 / +0.0%	0.93 / 0.91 / +1.9%
statpopgen_q03/datafusion:vortex-compact	465048712 / 459396290 / +1.2%	482896411 / 486094928 / -0.7%	0.96 / 0.95 / +1.9%
statpopgen_q04/datafusion:vortex-compact	463861188 / 463047363 / +0.2%	479018148 / 484637972 / -1.2%	0.97 / 0.96 / +1.4%
statpopgen_q05/datafusion:vortex-compact	310582108 / 316090282 / -1.7%	335034523 / 340323332 / -1.6%	0.93 / 0.93 / -0.2%
statpopgen_q06/datafusion:vortex-compact	886875956 / 871249215 / +1.8%	902580813 / 896010640 / +0.7%	0.98 / 0.97 / +1.1%
statpopgen_q07/datafusion:vortex-compact	966431240 / 973680407 / -0.7%	987471582 / 980144614 / +0.7%	0.98 / 0.99 / -1.5%
statpopgen_q08/datafusion:vortex-compact	969397762 / 975804556 / -0.7%	970255515 / 985468391 / -1.5%	1.00 / 0.99 / +0.9%
statpopgen_q09/datafusion:vortex-compact	364239906 / 364387800 / -0.0%	383846874 / 382601725 / +0.3%	0.95 / 0.95 / -0.4%
statpopgen_q10/datafusion:vortex-compact	977048205 / 972619666 / +0.5%	994826203 / 989160340 / +0.6%	0.98 / 0.98 / -0.1%

datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet	1987431 / 1964400 / +1.2%	90763463 / 91052988 / -0.3%	0.02 / 0.02 / +1.5%
statpopgen_q01/datafusion:parquet	163095790 / 164155445 / -0.6%	174295891 / 172030569 / +1.3%	0.94 / 0.95 / -1.9%
statpopgen_q02/datafusion:parquet	277436655 / 290468775 / -4.5%	421269022 / 431850005 / -2.5%	0.66 / 0.67 / -2.1%
statpopgen_q03/datafusion:parquet	396878875 / 402039932 / -1.3%	529576280 / 518684977 / +2.1%	0.75 / 0.78 / -3.3%
statpopgen_q04/datafusion:parquet	399275751 / 382799592 / +4.3%	532521013 / 529628849 / +0.5%	0.75 / 0.72 / +3.7%
statpopgen_q05/datafusion:parquet	315616352 / 327748686 / -3.7%	436796323 / 457438838 / -4.5%	0.72 / 0.72 / +0.8%
statpopgen_q06/datafusion:parquet	524604695 / 509411672 / +3.0%	644240043 / 607899508 / +6.0%	0.81 / 0.84 / -2.8%
statpopgen_q07/datafusion:parquet	430134383 / 445330142 / -3.4%	551454204 / 543754594 / +1.4%	0.78 / 0.82 / -4.8%
statpopgen_q08/datafusion:parquet	446198718 / 436374002 / +2.3%	543301120 / 572578459 / -5.1%	0.82 / 0.76 / +7.8%
statpopgen_q09/datafusion:parquet	376346792 / 362248775 / +3.9%	486029798 / 473643185 / +2.6%	0.77 / 0.76 / +1.2%
statpopgen_q10/datafusion:parquet	574065728 / 556812390 / +3.1%	674944649 / 697015371 / -3.2%	0.85 / 0.80 / +6.5%

duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed	9043676 / 9063798 / -0.2%	9611671 / 9495485 / +1.2%	0.94 / 0.95 / -1.4%
statpopgen_q01/duckdb:vortex-file-compressed	10179676 / 10468786 / -2.8%	12967805 / 14127308 / -8.2%	0.78 / 0.74 / +5.9%
statpopgen_q02/duckdb:vortex-file-compressed	310615873 / 307572776 / +1.0%	337343640 / 333393781 / +1.2%	0.92 / 0.92 / -0.2%
statpopgen_q03/duckdb:vortex-file-compressed	814090968 / 808875450 / +0.6%	815985497 / 811469534 / +0.6%	1.00 / 1.00 / +0.1%
statpopgen_q04/duckdb:vortex-file-compressed	817230184 / 819993600 / -0.3%	830282553 / 823495346 / +0.8%	0.98 / 1.00 / -1.2%
statpopgen_q05/duckdb:vortex-file-compressed	320177862 / 321671590 / -0.5%	341731949 / 343900597 / -0.6%	0.94 / 0.94 / +0.2%
statpopgen_q06/duckdb:vortex-file-compressed	1160063024 / 1151288111 / +0.8%	1162524164 / 1171432925 / -0.8%	1.00 / 0.98 / +1.5%
statpopgen_q07/duckdb:vortex-file-compressed	371646700 / 376683370 / -1.3%	425814632 / 429026993 / -0.7%	0.87 / 0.88 / -0.6%
statpopgen_q08/duckdb:vortex-file-compressed	384350088 / 381334003 / +0.8%	433432193 / 379730719 / +14.1% 🔴	0.89 / 1.00 / -11.7%
statpopgen_q09/duckdb:vortex-file-compressed	614617800 / 608716161 / +1.0%	624201803 / 635239022 / -1.7%	0.98 / 0.96 / +2.8%
statpopgen_q10/duckdb:vortex-file-compressed	1913891037 / 1908342628 / +0.3%	1900736460 / 1878800765 / +1.2%	1.01 / 1.02 / -0.9%

duckdb / vortex-compact / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact	8996026 / 9077856 / -0.9%	9483867 / 9506824 / -0.2%	0.95 / 0.95 / -0.7%
statpopgen_q01/duckdb:vortex-compact	10271614 / 10243830 / +0.3%	12661286 / 13492348 / -6.2%	0.81 / 0.76 / +6.9%
statpopgen_q02/duckdb:vortex-compact	383633324 / 381756328 / +0.5%	401061116 / 401097841 / -0.0%	0.96 / 0.95 / +0.5%
statpopgen_q03/duckdb:vortex-compact	894211376 / 895379360 / -0.1%	905025460 / 917881655 / -1.4%	0.99 / 0.98 / +1.3%
statpopgen_q04/duckdb:vortex-compact	892687100 / 905057208 / -1.4%	905401875 / 904679262 / +0.1%	0.99 / 1.00 / -1.4%
statpopgen_q05/duckdb:vortex-compact	426890878 / 427148308 / -0.1%	435120296 / 440364044 / -1.2%	0.98 / 0.97 / +1.1%
statpopgen_q06/duckdb:vortex-compact	1170290555 / 1169539950 / +0.1%	1169989734 / 1172137290 / -0.2%	1.00 / 1.00 / +0.2%
statpopgen_q07/duckdb:vortex-compact	937103342 / 941393174 / -0.5%	950972030 / 939123734 / +1.3%	0.99 / 1.00 / -1.7%
statpopgen_q08/duckdb:vortex-compact	947504208 / 957940952 / -1.1%	957017457 / 949851606 / +0.8%	0.99 / 1.01 / -1.8%
statpopgen_q09/duckdb:vortex-compact	706193109 / 702595550 / +0.5%	712683903 / 708410016 / +0.6%	0.99 / 0.99 / -0.1%
statpopgen_q10/duckdb:vortex-compact	2014713383 / 2004472730 / +0.5%	2013710189 / 1979462349 / +1.7%	1.00 / 1.01 / -1.2%

duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet	245159675 / 246431826 / -0.5%	245535572 / 248111226 / -1.0%	1.00 / 0.99 / +0.5%
statpopgen_q01/duckdb:parquet	301526700 / 301117986 / +0.1%	301952731 / 302063574 / -0.0%	1.00 / 1.00 / +0.2%
statpopgen_q02/duckdb:parquet	533001087 / 540718662 / -1.4%	552978953 / 554232026 / -0.2%	0.96 / 0.98 / -1.2%
statpopgen_q03/duckdb:parquet	905428260 / 851634718 / +6.3%	914128957 / 850583930 / +7.5%	0.99 / 1.00 / -1.1%
statpopgen_q04/duckdb:parquet	829745726 / 832669622 / -0.4%	850810417 / 834652529 / +1.9%	0.98 / 1.00 / -2.2%
statpopgen_q05/duckdb:parquet	608742250 / 584068577 / +4.2%	605453161 / 594524114 / +1.8%	1.01 / 0.98 / +2.3%
statpopgen_q06/duckdb:parquet	696341024 / 727482668 / -4.3%	718806749 / 745170372 / -3.5%	0.97 / 0.98 / -0.8%
statpopgen_q07/duckdb:parquet	609160318 / 611527780 / -0.4%	732381993 / 709993664 / +3.2%	0.83 / 0.86 / -3.4%
statpopgen_q08/duckdb:parquet	619409690 / 619528578 / -0.0%	707207256 / 693031663 / +2.0%	0.88 / 0.89 / -2.0%
statpopgen_q09/duckdb:parquet	811149164 / 790716872 / +2.6%	836729496 / 808562916 / +3.5%	0.97 / 0.98 / -0.9%
statpopgen_q10/duckdb:parquet	1351535834 / 1480126984 / -8.7%	1277501685 / 1265338928 / +1.0%	1.06 / 1.17 / -9.6%

No file size changes detected.

github-actions · 2026-10-09T15:26:58Z

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.3%
Engines: DataFusion No clear signal (+4.9%, environment too noisy confidence) · DuckDB No clear signal (+7.7%, environment too noisy confidence)
Vortex (geomean): hot 1.099x ➖ · cold 1.076x ➖
Parquet (geomean): hot 1.034x ➖ · cold 1.071x ➖
Shifts: Parquet (control) +3.4% · Median polish +3.6%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.137x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	232648100 / 232469378 / +0.1%	700512764 / 692868868 / +1.1%	0.33 / 0.34 / -1.0%
tpch_q02/datafusion:vortex-file-compressed	399078833 / 396206380 / +0.7%	762539525 / 886290465 / -14.0%	0.52 / 0.45 / +17.1%
tpch_q03/datafusion:vortex-file-compressed	517332196 / 418217566 / +23.7%	1408098625 / 1093423804 / +28.8%	0.37 / 0.38 / -3.9%
tpch_q04/datafusion:vortex-file-compressed	248747696 / 196852493 / +26.4%	541995068 / 354186581 / +53.0% 🔴	0.46 / 0.56 / -17.4%
tpch_q05/datafusion:vortex-file-compressed	426461146 / 416356442 / +2.4%	759348739 / 812066057 / -6.5%	0.56 / 0.51 / +9.5%
tpch_q06/datafusion:vortex-file-compressed	293432974 / 290379125 / +1.1%	418406043 / 403746539 / +3.6%	0.70 / 0.72 / -2.5%
tpch_q07/datafusion:vortex-file-compressed	583418964 / 445723518 / +30.9% 🔴	669746018 / 677796369 / -1.2%	0.87 / 0.66 / +32.5%
tpch_q08/datafusion:vortex-file-compressed	464286125 / 458495349 / +1.3%	611049440 / 630307630 / -3.1%	0.76 / 0.73 / +4.5%
tpch_q09/datafusion:vortex-file-compressed	880249596 / 456925190 / +92.6% 🔴	930662191 / 484949350 / +91.9% 🔴	0.95 / 0.94 / +0.4%
tpch_q10/datafusion:vortex-file-compressed	744194914 / 365021819 / +103.9% 🔴	684486594 / 525434433 / +30.3% 🔴	1.09 / 0.69 / +56.5%
tpch_q11/datafusion:vortex-file-compressed	328725638 / 282069024 / +16.5%	432309235 / 395699694 / +9.3%	0.76 / 0.71 / +6.7%
tpch_q12/datafusion:vortex-file-compressed	385927343 / 317886301 / +21.4%	748519324 / 500908072 / +49.4% 🔴	0.52 / 0.63 / -18.8%
tpch_q13/datafusion:vortex-file-compressed	156828400 / 150427665 / +4.3%	515125715 / 320867671 / +60.5% 🔴	0.30 / 0.47 / -35.1%
tpch_q14/datafusion:vortex-file-compressed	216649657 / 184405505 / +17.5%	453692810 / 286216204 / +58.5% 🔴	0.48 / 0.64 / -25.9%
tpch_q15/datafusion:vortex-file-compressed	330327809 / 299554609 / +10.3%	510948421 / 468165679 / +9.1%	0.65 / 0.64 / +1.0%
tpch_q16/datafusion:vortex-file-compressed	187999450 / 173343498 / +8.5%	287733434 / 319600415 / -10.0%	0.65 / 0.54 / +20.5%
tpch_q17/datafusion:vortex-file-compressed	320108258 / 345329921 / -7.3%	628984212 / 514016316 / +22.4%	0.51 / 0.67 / -24.2%
tpch_q18/datafusion:vortex-file-compressed	320464506 / 303859603 / +5.5%	435076218 / 430034652 / +1.2%	0.74 / 0.71 / +4.2%
tpch_q19/datafusion:vortex-file-compressed	368046355 / 515095603 / -28.5%	491574504 / 520466927 / -5.6%	0.75 / 0.99 / -24.3%
tpch_q20/datafusion:vortex-file-compressed	297242550 / 275127271 / +8.0%	451177632 / 444787010 / +1.4%	0.66 / 0.62 / +6.5%
tpch_q21/datafusion:vortex-file-compressed	577886548 / 508390622 / +13.7%	754224766 / 630943817 / +19.5%	0.77 / 0.81 / -4.9%
tpch_q22/datafusion:vortex-file-compressed	200027644 / 179560660 / +11.4%	525901906 / 427275985 / +23.1%	0.38 / 0.42 / -9.5%

datafusion / vortex-compact / ns (1.094x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	219561149 / 227113342 / -3.3%	742450797 / 729741950 / +1.7%	0.30 / 0.31 / -5.0%
tpch_q02/datafusion:vortex-compact	343489056 / 330688716 / +3.9%	648926214 / 672200890 / -3.5%	0.53 / 0.49 / +7.6%
tpch_q03/datafusion:vortex-compact	340222559 / 376792620 / -9.7%	742106757 / 835489330 / -11.2%	0.46 / 0.45 / +1.7%
tpch_q04/datafusion:vortex-compact	160900480 / 153613842 / +4.7%	333803292 / 440850524 / -24.3%	0.48 / 0.35 / +38.3%
tpch_q05/datafusion:vortex-compact	406959468 / 373147839 / +9.1%	568441328 / 646052921 / -12.0%	0.72 / 0.58 / +24.0%
tpch_q06/datafusion:vortex-compact	281940334 / 273510876 / +3.1%	489633939 / 481175298 / +1.8%	0.58 / 0.57 / +1.3%
tpch_q07/datafusion:vortex-compact	381722332 / 360780584 / +5.8%	729663326 / 513939204 / +42.0% 🔴	0.52 / 0.70 / -25.5%
tpch_q08/datafusion:vortex-compact	490705891 / 481122321 / +2.0%	634534584 / 616649122 / +2.9%	0.77 / 0.78 / -0.9%
tpch_q09/datafusion:vortex-compact	503454115 / 304665417 / +65.2% 🔴	663848800 / 425087431 / +56.2% 🔴	0.76 / 0.72 / +5.8%
tpch_q10/datafusion:vortex-compact	366171294 / 330190426 / +10.9%	560932145 / 530260187 / +5.8%	0.65 / 0.62 / +4.8%
tpch_q11/datafusion:vortex-compact	290676258 / 290348806 / +0.1%	447551735 / 420135596 / +6.5%	0.65 / 0.69 / -6.0%
tpch_q12/datafusion:vortex-compact	321610978 / 315230436 / +2.0%	522923741 / 566486532 / -7.7%	0.62 / 0.56 / +10.5%
tpch_q13/datafusion:vortex-compact	229355334 / 116156186 / +97.5% 🔴	485496890 / 473039460 / +2.6%	0.47 / 0.25 / +92.4%
tpch_q14/datafusion:vortex-compact	199892007 / 212987099 / -6.1%	423576985 / 364523227 / +16.2%	0.47 / 0.58 / -19.2%
tpch_q15/datafusion:vortex-compact	452081010 / 349258441 / +29.4%	516018821 / 556033468 / -7.2%	0.88 / 0.63 / +39.5%
tpch_q16/datafusion:vortex-compact	172714356 / 158604434 / +8.9%	258894635 / 335722074 / -22.9%	0.67 / 0.47 / +41.2%
tpch_q17/datafusion:vortex-compact	305184583 / 314440486 / -2.9%	621224082 / 495732248 / +25.3%	0.49 / 0.63 / -22.5%
tpch_q18/datafusion:vortex-compact	292660774 / 269611119 / +8.5%	566599877 / 484909604 / +16.8%	0.52 / 0.56 / -7.1%
tpch_q19/datafusion:vortex-compact	518031327 / 444190707 / +16.6%	744684830 / 555560587 / +34.0% 🔴	0.70 / 0.80 / -13.0%
tpch_q20/datafusion:vortex-compact	299950804 / 321203967 / -6.6%	424612512 / 521157326 / -18.5%	0.71 / 0.62 / +14.6%
tpch_q21/datafusion:vortex-compact	498957558 / 491737368 / +1.5%	664268427 / 677239887 / -1.9%	0.75 / 0.73 / +3.4%
tpch_q22/datafusion:vortex-compact	179818659 / 162103356 / +10.9%	397525476 / 361250717 / +10.0%	0.45 / 0.45 / +0.8%

datafusion / parquet / ns (1.064x ➖, 1↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	161964414 / 157804532 / +2.6%	501798405 / 586340501 / -14.4%	0.32 / 0.27 / +19.9%
tpch_q02/datafusion:parquet	254646381 / 271296913 / -6.1%	463161563 / 483504738 / -4.2%	0.55 / 0.56 / -2.0%
tpch_q03/datafusion:parquet	265900990 / 261678419 / +1.6%	723288990 / 591171432 / +22.3%	0.37 / 0.44 / -16.9%
tpch_q04/datafusion:parquet	184213759 / 145523623 / +26.6%	429468831 / 334682295 / +28.3%	0.43 / 0.43 / -1.4%
tpch_q05/datafusion:parquet	392368571 / 343639667 / +14.2%	502919429 / 486488370 / +3.4%	0.78 / 0.71 / +10.4%
tpch_q06/datafusion:parquet	158798259 / 117074560 / +35.6% 🔴	227617357 / 236844823 / -3.9%	0.70 / 0.49 / +41.1%
tpch_q07/datafusion:parquet	342813408 / 341807548 / +0.3%	441237896 / 447596694 / -1.4%	0.78 / 0.76 / +1.7%
tpch_q08/datafusion:parquet	449205606 / 434691839 / +3.3%	562240069 / 570844580 / -1.5%	0.80 / 0.76 / +4.9%
tpch_q09/datafusion:parquet	411139154 / 396377226 / +3.7%	634292146 / 564119317 / +12.4%	0.65 / 0.70 / -7.8%
tpch_q10/datafusion:parquet	596917344 / 325932661 / +83.1% 🔴	536698253 / 466230076 / +15.1%	1.11 / 0.70 / +59.1%
tpch_q11/datafusion:parquet	272100814 / 248910236 / +9.3%	415889466 / 339448433 / +22.5%	0.65 / 0.73 / -10.8%
tpch_q12/datafusion:parquet	183342146 / 172417140 / +6.3%	401785092 / 368057888 / +9.2%	0.46 / 0.47 / -2.6%
tpch_q13/datafusion:parquet	370322553 / 364870288 / +1.5%	569178818 / 487913357 / +16.7%	0.65 / 0.75 / -13.0%
tpch_q14/datafusion:parquet	168200124 / 175015881 / -3.9%	295891855 / 317011600 / -6.7%	0.57 / 0.55 / +3.0%
tpch_q15/datafusion:parquet	288168378 / 291281731 / -1.1%	468420388 / 503929329 / -7.0%	0.62 / 0.58 / +6.4%
tpch_q16/datafusion:parquet	109779607 / 107776886 / +1.9%	270137217 / 229540391 / +17.7%	0.41 / 0.47 / -13.4%
tpch_q17/datafusion:parquet	341578757 / 277963917 / +22.9%	435528478 / 400352014 / +8.8%	0.78 / 0.69 / +13.0%
tpch_q18/datafusion:parquet	424885841 / 355848790 / +19.4%	766374060 / 462070296 / +65.9% 🔴	0.55 / 0.77 / -28.0%
tpch_q19/datafusion:parquet	167784116 / 182137860 / -7.9%	282958919 / 280797132 / +0.8%	0.59 / 0.65 / -8.6%
tpch_q20/datafusion:parquet	251561472 / 365385054 / -31.2% 🟢	410983047 / 846127960 / -51.4% 🟢	0.61 / 0.43 / +41.7%
tpch_q21/datafusion:parquet	319470267 / 338347414 / -5.6%	468525112 / 442591846 / +5.9%	0.68 / 0.76 / -10.8%
tpch_q22/datafusion:parquet	178502989 / 173906733 / +2.6%	425181980 / 324952330 / +30.8% 🔴	0.42 / 0.54 / -21.6%

duckdb / vortex-file-compressed / ns (1.137x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	208475640 / 195568647 / +6.6%	452850492 / 265098724 / +70.8% 🔴	0.46 / 0.74 / -37.6%
tpch_q02/duckdb:vortex-file-compressed	429851219 / 476183230 / -9.7%	445566488 / 465272850 / -4.2%	0.96 / 1.02 / -5.7%
tpch_q03/duckdb:vortex-file-compressed	559331181 / 433695609 / +29.0%	688461550 / 602702725 / +14.2%	0.81 / 0.72 / +12.9%
tpch_q04/duckdb:vortex-file-compressed	312613171 / 264724779 / +18.1%	340271558 / 304824560 / +11.6%	0.92 / 0.87 / +5.8%
tpch_q05/duckdb:vortex-file-compressed	424989753 / 470545627 / -9.7%	463700849 / 494137857 / -6.2%	0.92 / 0.95 / -3.8%
tpch_q06/duckdb:vortex-file-compressed	277260921 / 279547228 / -0.8%	334230594 / 277176218 / +20.6%	0.83 / 1.01 / -17.7%
tpch_q07/duckdb:vortex-file-compressed	493124822 / 463487746 / +6.4%	577667219 / 532463962 / +8.5%	0.85 / 0.87 / -1.9%
tpch_q08/duckdb:vortex-file-compressed	664050425 / 614504399 / +8.1%	652233768 / 673522513 / -3.2%	1.02 / 0.91 / +11.6%
tpch_q09/duckdb:vortex-file-compressed	579950160 / 500754935 / +15.8%	504496042 / 527153965 / -4.3%	1.15 / 0.95 / +21.0%
tpch_q10/duckdb:vortex-file-compressed	623586564 / 486874741 / +28.1%	552257600 / 488243340 / +13.1%	1.13 / 1.00 / +13.2%
tpch_q11/duckdb:vortex-file-compressed	189100905 / 189629388 / -0.3%	215437230 / 208255444 / +3.4%	0.88 / 0.91 / -3.6%
tpch_q12/duckdb:vortex-file-compressed	526872706 / 415957090 / +26.7%	522793467 / 584698136 / -10.6%	1.01 / 0.71 / +41.7%
tpch_q13/duckdb:vortex-file-compressed	332044646 / 349765868 / -5.1%	374506145 / 401595241 / -6.7%	0.89 / 0.87 / +1.8%
tpch_q14/duckdb:vortex-file-compressed	301723662 / 248549959 / +21.4%	327924707 / 504718542 / -35.0% 🟢	0.92 / 0.49 / +86.8%
tpch_q15/duckdb:vortex-file-compressed	295557163 / 138442528 / +113.5% 🔴	252645730 / 177427377 / +42.4% 🔴	1.17 / 0.78 / +49.9%
tpch_q16/duckdb:vortex-file-compressed	195777478 / 186974703 / +4.7%	208733526 / 236787544 / -11.8%	0.94 / 0.79 / +18.8%
tpch_q17/duckdb:vortex-file-compressed	459412705 / 432007672 / +6.3%	465516991 / 543983363 / -14.4%	0.99 / 0.79 / +24.3%
tpch_q18/duckdb:vortex-file-compressed	421184665 / 320072079 / +31.6% 🔴	376992093 / 363911910 / +3.6%	1.12 / 0.88 / +27.0%
tpch_q19/duckdb:vortex-file-compressed	334275587 / 313213176 / +6.7%	326269954 / 407143107 / -19.9%	1.02 / 0.77 / +33.2%
tpch_q20/duckdb:vortex-file-compressed	406926536 / 401948999 / +1.2%	656136492 / 604689790 / +8.5%	0.62 / 0.66 / -6.7%
tpch_q21/duckdb:vortex-file-compressed	1031921536 / 624381713 / +65.3% 🔴	1024067456 / 732899133 / +39.7% 🔴	1.01 / 0.85 / +18.3%
tpch_q22/duckdb:vortex-file-compressed	196185934 / 213923182 / -8.3%	251361035 / 198959799 / +26.3%	0.78 / 1.08 / -27.4%

duckdb / vortex-compact / ns (1.031x ➖, 1↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	218214390 / 211979874 / +2.9%	229699333 / 341517852 / -32.7% 🟢	0.95 / 0.62 / +53.1%
tpch_q02/duckdb:vortex-compact	401562971 / 393531488 / +2.0%	448664436 / 407219387 / +10.2%	0.90 / 0.97 / -7.4%
tpch_q03/duckdb:vortex-compact	408411600 / 416976507 / -2.1%	515100887 / 422087137 / +22.0%	0.79 / 0.99 / -19.7%
tpch_q04/duckdb:vortex-compact	294857932 / 212219204 / +38.9% 🔴	315540546 / 246389784 / +28.1%	0.93 / 0.86 / +8.5%
tpch_q05/duckdb:vortex-compact	382361674 / 393751803 / -2.9%	476340228 / 584555698 / -18.5%	0.80 / 0.67 / +19.2%
tpch_q06/duckdb:vortex-compact	292424657 / 294813717 / -0.8%	294672629 / 283135537 / +4.1%	0.99 / 1.04 / -4.7%
tpch_q07/duckdb:vortex-compact	450476976 / 422760978 / +6.6%	474638353 / 445974768 / +6.4%	0.95 / 0.95 / +0.1%
tpch_q08/duckdb:vortex-compact	573369836 / 570940127 / +0.4%	581224998 / 625069700 / -7.0%	0.99 / 0.91 / +8.0%
tpch_q09/duckdb:vortex-compact	477088747 / 443820631 / +7.5%	492025101 / 442065576 / +11.3%	0.97 / 1.00 / -3.4%
tpch_q10/duckdb:vortex-compact	437989334 / 405731760 / +8.0%	442204206 / 402401321 / +9.9%	0.99 / 1.01 / -1.8%
tpch_q11/duckdb:vortex-compact	252023050 / 183201367 / +37.6% 🔴	262032679 / 199452894 / +31.4% 🔴	0.96 / 0.92 / +4.7%
tpch_q12/duckdb:vortex-compact	386278097 / 429014734 / -10.0%	589927269 / 558957723 / +5.5%	0.65 / 0.77 / -14.7%
tpch_q13/duckdb:vortex-compact	257038259 / 393647088 / -34.7% 🟢	454132221 / 448514896 / +1.3%	0.57 / 0.88 / -35.5%
tpch_q14/duckdb:vortex-compact	234555020 / 228456689 / +2.7%	372698472 / 292525897 / +27.4%	0.63 / 0.78 / -19.4%
tpch_q15/duckdb:vortex-compact	146880263 / 142352903 / +3.2%	176776176 / 148978965 / +18.7%	0.83 / 0.96 / -13.0%
tpch_q16/duckdb:vortex-compact	176078819 / 170498625 / +3.3%	222622739 / 204878817 / +8.7%	0.79 / 0.83 / -5.0%
tpch_q17/duckdb:vortex-compact	429076861 / 409975415 / +4.7%	445685091 / 476600199 / -6.5%	0.96 / 0.86 / +11.9%
tpch_q18/duckdb:vortex-compact	284287482 / 281064999 / +1.1%	321331468 / 312256534 / +2.9%	0.88 / 0.90 / -1.7%
tpch_q19/duckdb:vortex-compact	377491686 / 342185380 / +10.3%	347414546 / 346984118 / +0.1%	1.09 / 0.99 / +10.2%
tpch_q20/duckdb:vortex-compact	401911944 / 393641848 / +2.1%	477408865 / 410402462 / +16.3%	0.84 / 0.96 / -12.2%
tpch_q21/duckdb:vortex-compact	582749235 / 598698675 / -2.7%	683315552 / 616349110 / +10.9%	0.85 / 0.97 / -12.2%
tpch_q22/duckdb:vortex-compact	179238432 / 161765568 / +10.8%	216956048 / 180603861 / +20.1%	0.83 / 0.90 / -7.8%

duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	303333748 / 313263046 / -3.2%	341998296 / 299108325 / +14.3%	0.89 / 1.05 / -15.3%
tpch_q02/duckdb:parquet	647910134 / 649822536 / -0.3%	666877864 / 629942262 / +5.9%	0.97 / 1.03 / -5.8%
tpch_q03/duckdb:parquet	786299579 / 750125756 / +4.8%	830341659 / 762328968 / +8.9%	0.95 / 0.98 / -3.8%
tpch_q04/duckdb:parquet	484998882 / 481782378 / +0.7%	649608767 / 440939446 / +47.3% 🔴	0.75 / 1.09 / -31.7%
tpch_q05/duckdb:parquet	944120280 / 922634045 / +2.3%	1201766510 / 891428521 / +34.8% 🔴	0.79 / 1.04 / -24.1%
tpch_q06/duckdb:parquet	309101200 / 318674265 / -3.0%	338830583 / 306941330 / +10.4%	0.91 / 1.04 / -12.1%
tpch_q07/duckdb:parquet	922174614 / 828481702 / +11.3%	1170314830 / 870112071 / +34.5% 🔴	0.79 / 0.95 / -17.2%
tpch_q08/duckdb:parquet	1102695862 / 982340578 / +12.3%	1249960176 / 1122700837 / +11.3%	0.88 / 0.87 / +0.8%
tpch_q09/duckdb:parquet	1053843999 / 1017496651 / +3.6%	1075812126 / 1019924186 / +5.5%	0.98 / 1.00 / -1.8%
tpch_q10/duckdb:parquet	1003771568 / 955253646 / +5.1%	1000066492 / 1013581134 / -1.3%	1.00 / 0.94 / +6.5%
tpch_q11/duckdb:parquet	431127108 / 424179412 / +1.6%	482940810 / 409732682 / +17.9%	0.89 / 1.04 / -13.8%
tpch_q12/duckdb:parquet	540672570 / 540114934 / +0.1%	624564321 / 552969345 / +12.9%	0.87 / 0.98 / -11.4%
tpch_q13/duckdb:parquet	730421652 / 679153350 / +7.5%	796132669 / 796391459 / -0.0%	0.92 / 0.85 / +7.6%
tpch_q14/duckdb:parquet	498955259 / 616524905 / -19.1%	545577326 / 532815887 / +2.4%	0.91 / 1.16 / -21.0%
tpch_q15/duckdb:parquet	361940869 / 404442595 / -10.5%	388813928 / 406052092 / -4.2%	0.93 / 1.00 / -6.5%
tpch_q16/duckdb:parquet	488076508 / 504921539 / -3.3%	515099096 / 469893925 / +9.6%	0.95 / 1.07 / -11.8%
tpch_q17/duckdb:parquet	493926571 / 454465581 / +8.7%	489161266 / 484504835 / +1.0%	1.01 / 0.94 / +7.6%
tpch_q18/duckdb:parquet	637669589 / 686177289 / -7.1%	654867985 / 703101585 / -6.9%	0.97 / 0.98 / -0.2%
tpch_q19/duckdb:parquet	586524846 / 546760269 / +7.3%	544082072 / 593685224 / -8.4%	1.08 / 0.92 / +17.1%
tpch_q20/duckdb:parquet	833422444 / 842190640 / -1.0%	775484287 / 1032650371 / -24.9%	1.07 / 0.82 / +31.8%
tpch_q21/duckdb:parquet	688578404 / 675406376 / +2.0%	772742520 / 665685426 / +16.1%	0.89 / 1.01 / -12.2%
tpch_q22/duckdb:parquet	407117629 / 417724642 / -2.5%	462543798 / 347962257 / +32.9% 🔴	0.88 / 1.20 / -26.7%

github-actions · 2026-10-09T15:39:07Z

Benchmarks: Vortex queries 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-1.1%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 1.195x ❌
Parquet (geomean): hot 1.008x ➖ · cold 1.045x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
vortex_q00/datafusion:vortex-file-compressed	151222572 / 151915791 / -0.5%	515303430 / 515457793 / -0.0%	0.29 / 0.29 / -0.4%
vortex_q01/datafusion:vortex-file-compressed	118882329 / 117873683 / +0.9%	365065343 / 368538154 / -0.9%	0.33 / 0.32 / +1.8%
vortex_q02/datafusion:vortex-file-compressed	174432183 / 174064896 / +0.2%	338814046 / 334120281 / +1.4%	0.51 / 0.52 / -1.2%

datafusion / parquet / ns (1.014x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
vortex_q00/datafusion:parquet	136462190 / 136424002 / +0.0%	1278978856 / 1364137269 / -6.2%	0.11 / 0.10 / +6.7%
vortex_q01/datafusion:parquet	71703729 / 69156826 / +3.7%	123944985 / 103414165 / +19.9% 🔴	0.58 / 0.67 / -13.5%
vortex_q02/datafusion:parquet	296846270 / 295707584 / +0.4%	730394812 / 760718016 / -4.0%	0.41 / 0.39 / +4.6%

duckdb / vortex-file-compressed / ns (1.008x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
vortex_q00/duckdb:vortex-file-compressed	229035382 / 234523016 / -2.3%	1019331364 / 778947953 / +30.9% 🔴	0.22 / 0.30 / -25.4%
vortex_q01/duckdb:vortex-file-compressed	139127132 / 132948680 / +4.6%	667619121 / 413822039 / +61.3% 🔴	0.21 / 0.32 / -35.1%
vortex_q02/duckdb:vortex-file-compressed	212911738 / 212290699 / +0.3%	583956416 / 425331896 / +37.3% 🔴	0.36 / 0.50 / -27.0%

duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
vortex_q00/duckdb:parquet	289922404 / 287594340 / +0.8%	1706039176 / 1610528626 / +5.9%	0.17 / 0.18 / -4.8%
vortex_q01/duckdb:parquet	204423184 / 203831018 / +0.3%	324066193 / 318035493 / +1.9%	0.63 / 0.64 / -1.6%
vortex_q02/duckdb:parquet	348703729 / 349310573 / -0.2%	1216329134 / 1089222302 / +11.7% 🔴	0.29 / 0.32 / -10.6%

No file size changes detected.

github-actions · 2026-10-09T15:41:58Z

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR f83e38f5 vs base 0ff1d1a6
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.8%
Engines: DataFusion No clear signal (-11.5%, environment too noisy confidence) · DuckDB No clear signal (-4.0%, environment too noisy confidence)
Vortex (geomean): hot 1.033x ➖ · cold 1.066x ➖
Parquet (geomean): hot 1.120x ➖ · cold 1.116x ➖
Shifts: Parquet (control) +12.0% · Median polish +7.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 2↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	362132602 / 372701060 / -2.8%	961144320 / 1005239977 / -4.4%	0.38 / 0.37 / +1.6%
tpch_q02/datafusion:vortex-file-compressed	534192021 / 936141574 / -42.9% 🟢	1092421566 / 1104820099 / -1.1%	0.49 / 0.85 / -42.3%
tpch_q03/datafusion:vortex-file-compressed	670080137 / 749198171 / -10.6%	1540691301 / 1668666866 / -7.7%	0.43 / 0.45 / -3.1%
tpch_q04/datafusion:vortex-file-compressed	345595026 / 377342575 / -8.4%	608860244 / 672197753 / -9.4%	0.57 / 0.56 / +1.1%
tpch_q05/datafusion:vortex-file-compressed	706518033 / 657797087 / +7.4%	1338554265 / 869279513 / +54.0% 🔴	0.53 / 0.76 / -30.2%
tpch_q06/datafusion:vortex-file-compressed	320809815 / 309500735 / +3.7%	533274368 / 594077902 / -10.2%	0.60 / 0.52 / +15.5%
tpch_q07/datafusion:vortex-file-compressed	671614071 / 590015317 / +13.8%	738048974 / 695299424 / +6.1%	0.91 / 0.85 / +7.2%
tpch_q08/datafusion:vortex-file-compressed	881374683 / 852161101 / +3.4%	1083161619 / 1086627033 / -0.3%	0.81 / 0.78 / +3.8%
tpch_q09/datafusion:vortex-file-compressed	744491135 / 815948604 / -8.8%	1076103697 / 1115946570 / -3.6%	0.69 / 0.73 / -5.4%
tpch_q10/datafusion:vortex-file-compressed	808508655 / 729823682 / +10.8%	1028859626 / 1331555951 / -22.7%	0.79 / 0.55 / +43.4%
tpch_q11/datafusion:vortex-file-compressed	390302251 / 743113723 / -47.5% 🟢	596373440 / 696443396 / -14.4%	0.65 / 1.07 / -38.7%
tpch_q12/datafusion:vortex-file-compressed	663252308 / 601732467 / +10.2%	941602825 / 720144248 / +30.8% 🔴	0.70 / 0.84 / -15.7%
tpch_q13/datafusion:vortex-file-compressed	250471394 / 311988203 / -19.7%	538356808 / 603403068 / -10.8%	0.47 / 0.52 / -10.0%
tpch_q14/datafusion:vortex-file-compressed	419428446 / 386924794 / +8.4%	519198690 / 635443779 / -18.3%	0.81 / 0.61 / +32.7%
tpch_q15/datafusion:vortex-file-compressed	658853499 / 683436474 / -3.6%	922512920 / 929757517 / -0.8%	0.71 / 0.74 / -2.8%
tpch_q16/datafusion:vortex-file-compressed	278134338 / 292981809 / -5.1%	466862413 / 440853999 / +5.9%	0.60 / 0.66 / -10.4%
tpch_q17/datafusion:vortex-file-compressed	789256012 / 803465652 / -1.8%	843414893 / 958272659 / -12.0%	0.94 / 0.84 / +11.6%
tpch_q18/datafusion:vortex-file-compressed	1027257450 / 724379238 / +41.8% 🔴	1608687368 / 1227955941 / +31.0% 🔴	0.64 / 0.59 / +8.2%
tpch_q19/datafusion:vortex-file-compressed	555119701 / 554339628 / +0.1%	693696064 / 734981252 / -5.6%	0.80 / 0.75 / +6.1%
tpch_q20/datafusion:vortex-file-compressed	672150704 / 629535914 / +6.8%	833177798 / 810968557 / +2.7%	0.81 / 0.78 / +3.9%
tpch_q21/datafusion:vortex-file-compressed	1368058446 / 978944049 / +39.7% 🔴	1144414814 / 1168089017 / -2.0%	1.20 / 0.84 / +42.6%
tpch_q22/datafusion:vortex-file-compressed	533027648 / 325585794 / +63.7% 🔴	1120305336 / 591136854 / +89.5% 🔴	0.48 / 0.55 / -13.6%

datafusion / vortex-compact / ns (0.996x ➖, 1↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	333189014 / 307484814 / +8.4%	1158178924 / 1022003693 / +13.3%	0.29 / 0.30 / -4.4%
tpch_q02/datafusion:vortex-compact	530526840 / 561394737 / -5.5%	1104159217 / 1083693202 / +1.9%	0.48 / 0.52 / -7.3%
tpch_q03/datafusion:vortex-compact	603758353 / 530411456 / +13.8%	1523525479 / 1365394244 / +11.6%	0.40 / 0.39 / +2.0%
tpch_q04/datafusion:vortex-compact	372879862 / 280853478 / +32.8% 🔴	752948020 / 717995593 / +4.9%	0.50 / 0.39 / +26.6%
tpch_q05/datafusion:vortex-compact	647802808 / 665162124 / -2.6%	795823496 / 846210291 / -6.0%	0.81 / 0.79 / +3.6%
tpch_q06/datafusion:vortex-compact	365312656 / 270856762 / +34.9% 🔴	527977216 / 439280089 / +20.2%	0.69 / 0.62 / +12.2%
tpch_q07/datafusion:vortex-compact	580657165 / 582481125 / -0.3%	753841362 / 828488699 / -9.0%	0.77 / 0.70 / +9.6%
tpch_q08/datafusion:vortex-compact	881045367 / 867869862 / +1.5%	1257678011 / 1023298230 / +22.9%	0.70 / 0.85 / -17.4%
tpch_q09/datafusion:vortex-compact	736959238 / 944659859 / -22.0%	982871608 / 935424763 / +5.1%	0.75 / 1.01 / -25.8%
tpch_q10/datafusion:vortex-compact	712573888 / 584821589 / +21.8%	1214890650 / 766864320 / +58.4% 🔴	0.59 / 0.76 / -23.1%
tpch_q11/datafusion:vortex-compact	364635342 / 401917510 / -9.3%	576653392 / 739323365 / -22.0%	0.63 / 0.54 / +16.3%
tpch_q12/datafusion:vortex-compact	531864826 / 624818931 / -14.9%	881656918 / 1153917624 / -23.6%	0.60 / 0.54 / +11.4%
tpch_q13/datafusion:vortex-compact	235528272 / 226237003 / +4.1%	673425230 / 576610605 / +16.8%	0.35 / 0.39 / -10.9%
tpch_q14/datafusion:vortex-compact	326475367 / 604696959 / -46.0% 🟢	474240979 / 750451559 / -36.8% 🟢	0.69 / 0.81 / -14.6%
tpch_q15/datafusion:vortex-compact	553739549 / 568341411 / -2.6%	850630916 / 808881989 / +5.2%	0.65 / 0.70 / -7.4%
tpch_q16/datafusion:vortex-compact	293514388 / 259177769 / +13.2%	512743113 / 414806259 / +23.6%	0.57 / 0.62 / -8.4%
tpch_q17/datafusion:vortex-compact	759323137 / 731945727 / +3.7%	1012938971 / 806416599 / +25.6%	0.75 / 0.91 / -17.4%
tpch_q18/datafusion:vortex-compact	664151051 / 563347283 / +17.9%	1119141966 / 611441773 / +83.0% 🔴	0.59 / 0.92 / -35.6%
tpch_q19/datafusion:vortex-compact	646193651 / 547129334 / +18.1%	993094878 / 667468348 / +48.8% 🔴	0.65 / 0.82 / -20.6%
tpch_q20/datafusion:vortex-compact	619516238 / 831110698 / -25.5%	858908444 / 1024547443 / -16.2%	0.72 / 0.81 / -11.1%
tpch_q21/datafusion:vortex-compact	809899991 / 857050198 / -5.5%	932629613 / 953521254 / -2.2%	0.87 / 0.90 / -3.4%
tpch_q22/datafusion:vortex-compact	350613341 / 363758017 / -3.6%	675001245 / 577182955 / +16.9%	0.52 / 0.63 / -17.6%

datafusion / parquet / ns (1.126x ➖, 0↑ 5↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	279659063 / 268853131 / +4.0%	644904042 / 848636769 / -24.0%	0.43 / 0.32 / +36.9%
tpch_q02/datafusion:parquet	537542852 / 510903683 / +5.2%	1070268605 / 1166744535 / -8.3%	0.50 / 0.44 / +14.7%
tpch_q03/datafusion:parquet	531149255 / 612038290 / -13.2%	1125591457 / 1079102656 / +4.3%	0.47 / 0.57 / -16.8%
tpch_q04/datafusion:parquet	403848658 / 283312507 / +42.5% 🔴	565500724 / 585458083 / -3.4%	0.71 / 0.48 / +47.6%
tpch_q05/datafusion:parquet	761313126 / 669751278 / +13.7%	1358750529 / 930405229 / +46.0% 🔴	0.56 / 0.72 / -22.2%
tpch_q06/datafusion:parquet	278716700 / 362282457 / -23.1%	554590070 / 452198577 / +22.6%	0.50 / 0.80 / -37.3%
tpch_q07/datafusion:parquet	963108500 / 623679951 / +54.4% 🔴	1042181560 / 773468337 / +34.7% 🔴	0.92 / 0.81 / +14.6%
tpch_q08/datafusion:parquet	955955664 / 848860734 / +12.6%	1308344454 / 1135332291 / +15.2%	0.73 / 0.75 / -2.3%
tpch_q09/datafusion:parquet	1446262299 / 867144653 / +66.8% 🔴	1285671747 / 1177831769 / +9.2%	1.12 / 0.74 / +52.8%
tpch_q10/datafusion:parquet	1530841891 / 1514726498 / +1.1%	1961962622 / 1702954223 / +15.2%	0.78 / 0.89 / -12.3%
tpch_q11/datafusion:parquet	487525832 / 432018732 / +12.8%	745632306 / 842902680 / -11.5%	0.65 / 0.51 / +27.6%
tpch_q12/datafusion:parquet	507220360 / 387313190 / +31.0% 🔴	972215731 / 563063561 / +72.7% 🔴	0.52 / 0.69 / -24.2%
tpch_q13/datafusion:parquet	462234466 / 432733291 / +6.8%	923992153 / 807995366 / +14.4%	0.50 / 0.54 / -6.6%
tpch_q14/datafusion:parquet	437751772 / 435037721 / +0.6%	775953823 / 665837901 / +16.5%	0.56 / 0.65 / -13.7%
tpch_q15/datafusion:parquet	710637051 / 642021140 / +10.7%	813307975 / 838129060 / -3.0%	0.87 / 0.77 / +14.1%
tpch_q16/datafusion:parquet	243736585 / 233088979 / +4.6%	715450068 / 480558522 / +48.9% 🔴	0.34 / 0.49 / -29.8%
tpch_q17/datafusion:parquet	606236528 / 604677873 / +0.3%	714553441 / 884814032 / -19.2%	0.85 / 0.68 / +24.1%
tpch_q18/datafusion:parquet	814788298 / 722259344 / +12.8%	1014007905 / 883535758 / +14.8%	0.80 / 0.82 / -1.7%
tpch_q19/datafusion:parquet	461587013 / 488826626 / -5.6%	577041458 / 617909066 / -6.6%	0.80 / 0.79 / +1.1%
tpch_q20/datafusion:parquet	1306542411 / 721404256 / +81.1% 🔴	1275910764 / 1004396787 / +27.0%	1.02 / 0.72 / +42.6%
tpch_q21/datafusion:parquet	931473219 / 933001306 / -0.2%	925814725 / 1202610373 / -23.0%	1.01 / 0.78 / +29.7%
tpch_q22/datafusion:parquet	608025585 / 549065254 / +10.7%	960080920 / 821440845 / +16.9%	0.63 / 0.67 / -5.3%

duckdb / vortex-file-compressed / ns (1.052x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	983826497 / 990759867 / -0.7%	2142660900 / 1686747004 / +27.0%	0.46 / 0.59 / -21.8%
tpch_q02/duckdb:vortex-file-compressed	631795491 / 554026264 / +14.0%	871167184 / 868480211 / +0.3%	0.73 / 0.64 / +13.7%
tpch_q03/duckdb:vortex-file-compressed	1401160949 / 1237699388 / +13.2%	2045045735 / 1838645704 / +11.2%	0.69 / 0.67 / +1.8%
tpch_q04/duckdb:vortex-file-compressed	1054845592 / 1054712254 / +0.0%	1224368503 / 1391993059 / -12.0%	0.86 / 0.76 / +13.7%
tpch_q05/duckdb:vortex-file-compressed	1322286651 / 1413307929 / -6.4%	1776883871 / 1479295049 / +20.1%	0.74 / 0.96 / -22.1%
tpch_q06/duckdb:vortex-file-compressed	1292995289 / 1119150895 / +15.5%	1506779082 / 1193950202 / +26.2%	0.86 / 0.94 / -8.5%
tpch_q07/duckdb:vortex-file-compressed	1672976234 / 1585200794 / +5.5%	1699284283 / 1574875167 / +7.9%	0.98 / 1.01 / -2.2%
tpch_q08/duckdb:vortex-file-compressed	1834989427 / 1756629401 / +4.5%	2106639479 / 2252005917 / -6.5%	0.87 / 0.78 / +11.7%
tpch_q09/duckdb:vortex-file-compressed	2121742349 / 1875309646 / +13.1%	2299103467 / 2038898818 / +12.8%	0.92 / 0.92 / +0.3%
tpch_q10/duckdb:vortex-file-compressed	1854930559 / 1714848374 / +8.2%	3092035756 / 2357492635 / +31.2% 🔴	0.60 / 0.73 / -17.5%
tpch_q11/duckdb:vortex-file-compressed	429309485 / 484109468 / -11.3%	592030795 / 579799453 / +2.1%	0.73 / 0.83 / -13.2%
tpch_q12/duckdb:vortex-file-compressed	2311696994 / 2308446975 / +0.1%	2688095085 / 2571307158 / +4.5%	0.86 / 0.90 / -4.2%
tpch_q13/duckdb:vortex-file-compressed	1460187594 / 1246295855 / +17.2%	2271849360 / 1760499679 / +29.0%	0.64 / 0.71 / -9.2%
tpch_q14/duckdb:vortex-file-compressed	929690192 / 839623435 / +10.7%	1036766638 / 1198864852 / -13.5%	0.90 / 0.70 / +28.0%
tpch_q15/duckdb:vortex-file-compressed	1026447615 / 1282791160 / -20.0%	1145342502 / 1135075747 / +0.9%	0.90 / 1.13 / -20.7%
tpch_q16/duckdb:vortex-file-compressed	305598637 / 285608550 / +7.0%	308102354 / 313945437 / -1.9%	0.99 / 0.91 / +9.0%
tpch_q17/duckdb:vortex-file-compressed	1620615798 / 1433475439 / +13.1%	1653297905 / 1469695278 / +12.5%	0.98 / 0.98 / +0.5%
tpch_q18/duckdb:vortex-file-compressed	1319823842 / 1384287998 / -4.7%	1528598920 / 1449323781 / +5.5%	0.86 / 0.96 / -9.6%
tpch_q19/duckdb:vortex-file-compressed	1234921459 / 1138069118 / +8.5%	1460314517 / 1197959180 / +21.9%	0.85 / 0.95 / -11.0%
tpch_q20/duckdb:vortex-file-compressed	1685345472 / 1571828323 / +7.2%	1894004761 / 1669548503 / +13.4%	0.89 / 0.94 / -5.5%
tpch_q21/duckdb:vortex-file-compressed	3378336225 / 3060217966 / +10.4%	3510002320 / 3202164911 / +9.6%	0.96 / 0.96 / +0.7%
tpch_q22/duckdb:vortex-file-compressed	548209918 / 461788171 / +18.7%	682917420 / 541454297 / +26.1%	0.80 / 0.85 / -5.9%

duckdb / vortex-compact / ns (1.089x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	1070307882 / 936824924 / +14.2%	2279232305 / 2014052514 / +13.2%	0.47 / 0.47 / +1.0%
tpch_q02/duckdb:vortex-compact	577629599 / 522624967 / +10.5%	742672889 / 1001350196 / -25.8%	0.78 / 0.52 / +49.0%
tpch_q03/duckdb:vortex-compact	1261883566 / 1100522099 / +14.7%	2220457348 / 1715590945 / +29.4%	0.57 / 0.64 / -11.4%
tpch_q04/duckdb:vortex-compact	782002146 / 712114822 / +9.8%	1107110074 / 972852372 / +13.8%	0.71 / 0.73 / -3.5%
tpch_q05/duckdb:vortex-compact	1234228081 / 1176200596 / +4.9%	1686259589 / 1568528115 / +7.5%	0.73 / 0.75 / -2.4%
tpch_q06/duckdb:vortex-compact	1210724535 / 1168865005 / +3.6%	1329756844 / 1188013425 / +11.9%	0.91 / 0.98 / -7.5%
tpch_q07/duckdb:vortex-compact	1658054843 / 1449591364 / +14.4%	1608616224 / 1548278018 / +3.9%	1.03 / 0.94 / +10.1%
tpch_q08/duckdb:vortex-compact	1571384081 / 1472436449 / +6.7%	1702228936 / 1673961608 / +1.7%	0.92 / 0.88 / +4.9%
tpch_q09/duckdb:vortex-compact	1788436426 / 1625928535 / +10.0%	2155111250 / 1944785169 / +10.8%	0.83 / 0.84 / -0.7%
tpch_q10/duckdb:vortex-compact	1710963502 / 1447218766 / +18.2%	2145932795 / 1765043736 / +21.6%	0.80 / 0.82 / -2.8%
tpch_q11/duckdb:vortex-compact	510587603 / 534682294 / -4.5%	656361582 / 696354009 / -5.7%	0.78 / 0.77 / +1.3%
tpch_q12/duckdb:vortex-compact	2097391393 / 2013809727 / +4.2%	2414345034 / 2402073551 / +0.5%	0.87 / 0.84 / +3.6%
tpch_q13/duckdb:vortex-compact	1157518599 / 1099982133 / +5.2%	1487406104 / 1614614061 / -7.9%	0.78 / 0.68 / +14.2%
tpch_q14/duckdb:vortex-compact	937404526 / 861091393 / +8.9%	1041018396 / 897250038 / +16.0%	0.90 / 0.96 / -6.2%
tpch_q15/duckdb:vortex-compact	1030740082 / 853223815 / +20.8%	1049960024 / 906740385 / +15.8%	0.98 / 0.94 / +4.3%
tpch_q16/duckdb:vortex-compact	253999545 / 226530431 / +12.1%	276990150 / 291964069 / -5.1%	0.92 / 0.78 / +18.2%
tpch_q17/duckdb:vortex-compact	1400997734 / 1338508455 / +4.7%	1591110489 / 1372932025 / +15.9%	0.88 / 0.97 / -9.7%
tpch_q18/duckdb:vortex-compact	1222053798 / 1177724665 / +3.8%	1244423474 / 1357052130 / -8.3%	0.98 / 0.87 / +13.2%
tpch_q19/duckdb:vortex-compact	1257936938 / 1222944170 / +2.9%	1332255026 / 1216011698 / +9.6%	0.94 / 1.01 / -6.1%
tpch_q20/duckdb:vortex-compact	2248308344 / 1687676447 / +33.2% 🔴	2292590710 / 1764594831 / +29.9%	0.98 / 0.96 / +2.5%
tpch_q21/duckdb:vortex-compact	2497942803 / 2453767335 / +1.8%	2818024391 / 2401099890 / +17.4%	0.89 / 1.02 / -13.3%
tpch_q22/duckdb:vortex-compact	502968029 / 493583652 / +1.9%	764024227 / 727091155 / +5.1%	0.66 / 0.68 / -3.0%

duckdb / parquet / ns (1.115x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	472244482 / 388449709 / +21.6%	719367459 / 464424414 / +54.9% 🔴	0.66 / 0.84 / -21.5%
tpch_q02/duckdb:parquet	807179279 / 735459715 / +9.8%	1393099706 / 1219433990 / +14.2%	0.58 / 0.60 / -3.9%
tpch_q03/duckdb:parquet	1044568201 / 899666442 / +16.1%	1806334291 / 1491461524 / +21.1%	0.58 / 0.60 / -4.1%
tpch_q04/duckdb:parquet	583692494 / 509380569 / +14.6%	1062950481 / 632337369 / +68.1% 🔴	0.55 / 0.81 / -31.8%
tpch_q05/duckdb:parquet	1172039645 / 1058084967 / +10.8%	1495471705 / 1392990151 / +7.4%	0.78 / 0.76 / +3.2%
tpch_q06/duckdb:parquet	368231357 / 395637690 / -6.9%	394254527 / 781529198 / -49.6% 🟢	0.93 / 0.51 / +84.5%
tpch_q07/duckdb:parquet	1092227689 / 950472108 / +14.9%	976620209 / 862776862 / +13.2%	1.12 / 1.10 / +1.5%
tpch_q08/duckdb:parquet	1419106928 / 1303077447 / +8.9%	1227480056 / 1271924395 / -3.5%	1.16 / 1.02 / +12.8%
tpch_q09/duckdb:parquet	1357691784 / 1131353881 / +20.0%	1848876591 / 1356106081 / +36.3% 🔴	0.73 / 0.83 / -12.0%
tpch_q10/duckdb:parquet	2111024898 / 1859387343 / +13.5%	2522869320 / 2366908141 / +6.6%	0.84 / 0.79 / +6.5%
tpch_q11/duckdb:parquet	604269174 / 516755049 / +16.9%	668685625 / 480713482 / +39.1% 🔴	0.90 / 1.07 / -15.9%
tpch_q12/duckdb:parquet	812723720 / 701099262 / +15.9%	1160531952 / 794726027 / +46.0% 🔴	0.70 / 0.88 / -20.6%
tpch_q13/duckdb:parquet	805968468 / 802707545 / +0.4%	910536192 / 970410171 / -6.2%	0.89 / 0.83 / +7.0%
tpch_q14/duckdb:parquet	699972852 / 631774670 / +10.8%	644618276 / 593360021 / +8.6%	1.09 / 1.06 / +2.0%
tpch_q15/duckdb:parquet	484033750 / 464702351 / +4.2%	472093519 / 425154334 / +11.0%	1.03 / 1.09 / -6.2%
tpch_q16/duckdb:parquet	663906508 / 596479343 / +11.3%	667888846 / 583342613 / +14.5%	0.99 / 1.02 / -2.8%
tpch_q17/duckdb:parquet	570639945 / 531612857 / +7.3%	710762024 / 605936344 / +17.3%	0.80 / 0.88 / -8.5%
tpch_q18/duckdb:parquet	811922275 / 794637027 / +2.2%	806193094 / 898803005 / -10.3%	1.01 / 0.88 / +13.9%
tpch_q19/duckdb:parquet	756935060 / 674450769 / +12.2%	834661295 / 690544004 / +20.9%	0.91 / 0.98 / -7.1%
tpch_q20/duckdb:parquet	1106567877 / 1072927892 / +3.1%	1177647175 / 1078309578 / +9.2%	0.94 / 1.00 / -5.6%
tpch_q21/duckdb:parquet	1113106927 / 876934920 / +26.9%	1017781178 / 943924892 / +7.8%	1.09 / 0.93 / +17.7%
tpch_q22/duckdb:parquet	830676910 / 669892845 / +24.0%	1093622386 / 753887544 / +45.1% 🔴	0.76 / 0.89 / -14.5%

gatesn added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Sep 9, 2026

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 9, 2026

gatesn marked this pull request as ready for review September 9, 2026 20:26

robert3005 reviewed Sep 10, 2026

View reviewed changes

Comment thread vortex-array/src/arrays/filter/rules.rs Outdated

robert3005 reviewed Sep 10, 2026

View reviewed changes

Comment thread vortex-array/src/arrays/scalar_fn/rules.rs Outdated

robert3005 reviewed Sep 10, 2026

View reviewed changes

Comment thread vortex-array/src/arrays/scalar_fn/rules.rs

github-actions Bot added the stale This PR is stale and will be auto-closed soon label Sep 25, 2026

robert3005 removed the stale This PR is stale and will be auto-closed soon label Sep 25, 2026

robert3005 force-pushed the ngates/batched-case-execution branch 2 times, most recently from aa123dd to 8c8f65c Compare October 7, 2026 10:29

robert3005 changed the base branch from develop to rk/case-when-benchmarks October 7, 2026 10:29

robert3005 added this pull request to stack #10357 October 7, 2026 10:29

robert3005 mentioned this pull request Oct 7, 2026

bench: add CASE WHEN benchmarks for decimal and string branch values #10356

Merged

robert3005 force-pushed the ngates/batched-case-execution branch from 8c8f65c to 9c7a9f5 Compare October 7, 2026 10:38

robert3005 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 7, 2026

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 7, 2026

Base automatically changed from rk/case-when-benchmarks to develop October 9, 2026 13:53

gatesn and others added 3 commits October 9, 2026 14:54

Batch fragmented CASE branches and push selections before scalar exec…

5d5d2be

…ution Signed-off-by: Nicholas Gates <nick@nickgates.com>

fixes

b831775

Signed-off-by: Robert Kruszewski <github@robertk.io>

robert3005 force-pushed the ngates/batched-case-execution branch from 02a61c9 to f83e38f Compare October 9, 2026 13:54

robert3005 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 9, 2026

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 9, 2026

robert3005 added the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Oct 9, 2026

github-actions Bot removed the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Oct 9, 2026

robert3005 approved these changes Oct 9, 2026

View reviewed changes

robert3005 merged commit 731a231 into develop Oct 9, 2026
163 of 164 checks passed

robert3005 deleted the ngates/batched-case-execution branch October 9, 2026 15:48

Conversation

gatesn commented Sep 9, 2026

Why

Changes

Validation

Review considerations

Uh oh!

codspeed Bot commented Sep 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will regress 6 benchmarks

Performance Changes

Footnotes

Uh oh!

github-actions Bot commented Sep 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented Sep 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Sep 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on NVME 📖

Uh oh!

github-actions Bot commented Sep 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

github-actions Bot commented Sep 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Statistical and Population Genetics 📖

Uh oh!

github-actions Bot commented Sep 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench on NVME 📖

Uh oh!

github-actions Bot commented Sep 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb S3 📖

Uh oh!

github-actions Bot commented Sep 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Sep 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Sep 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on S3 📖

Uh oh!

github-actions Bot commented Sep 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-DS SF=1 on NVME 📖

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions Bot commented Sep 25, 2026

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: FineWeb S3 📖

Uh oh!

github-actions Bot commented Oct 9, 2026

Benchmarks: Clickbench on NVME 📖

codspeed Bot commented Sep 9, 2026 •

edited

Loading

github-actions Bot commented Sep 9, 2026 •

edited

Loading

github-actions Bot commented Sep 9, 2026 •

edited

Loading

github-actions Bot commented Sep 9, 2026 •

edited

Loading

github-actions Bot commented Sep 9, 2026 •

edited

Loading

github-actions Bot commented Sep 9, 2026 •

edited

Loading

github-actions Bot commented Sep 9, 2026 •

edited

Loading

github-actions Bot commented Sep 9, 2026 •

edited

Loading

github-actions Bot commented Sep 9, 2026 •

edited

Loading

github-actions Bot commented Sep 9, 2026 •

edited

Loading

github-actions Bot commented Sep 9, 2026 •

edited

Loading

github-actions Bot commented Sep 9, 2026 •

edited

Loading