Skip to content

DuckDB 2.0 (v2.0-cyanoptera head) - #10513

Draft
joseph-isaacs wants to merge 2 commits into
developfrom
ji/relaxed-goldberg-03ljyd
Draft

joseph-isaacs wants to merge 2 commits into
developfrom
ji/relaxed-goldberg-03ljyd

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 15, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Builds on #9141 (DuckDB 2.0 support), merged with the current develop and bumped to the latest DuckDB 2.0 release-branch commit. DuckDB has not tagged v2.0.0 yet, so this pins the head of v2.0-cyanoptera. #9141's commits are squashed into one commit, with Mikhail Kot as co-author, so that DCO passes.

Changes

  • All changes from Duckdb 2.0 #9141.
  • Merge of develop:
  • DEFAULT_DUCKDB_VERSION bumped from 561522aea03e400bd20adc64fcc63e78b8721f3f (2026-09-30) to 8588363bf15e090fcbbfe2a68ec98b10c6866cb1 (2026-10-15, v2.0-cyanoptera head). The old commit is an ancestor, 2,315 commits behind.
  • cpp/table_filter.cpp: DynamicFilterData::lock is now an annotated_shared_mutex, so it is read under annotated_shared_lock, as DuckDB does.
  • httpfs is now an out-of-tree DuckDB extension with vcpkg dependencies, and DuckDB refuses to build it without VCPKG_TOOLCHAIN_PATH:
    • scripts/duckdb-r2-prepare.sh: on Linux, bootstraps DuckDB's pinned vcpkg (make setup-vcpkg) and keeps httpfs. The macOS universal build drops httpfs (and the hand-built universal OpenSSL), since vcpkg can't produce universal binaries and the S3 test only runs on Linux.
    • vortex-duckdb/build.rs: when building DuckDB from source, links httpfs only if VCPKG_TOOLCHAIN_PATH is set.
  • DuckDB SQL logic test expectations regenerated with --complete against 8588363b:
    • 83 EXPLAIN plan snapshots changed because of DuckDB optimizer changes. For example, avg is no longer rewritten to sum/count, and duplicate pushed-down scan filters are now deduplicated.
    • The number of Vortex scans (2,572) and FILTER nodes (525) is unchanged, and every scan filter is still pushed down.
    • TPC-DS q9's last bucket changed in the 16th significant digit (…512 → …511) on both Parquet and Vortex. DuckDB now sums the floats in a different order.

Testing

  • Locally against DuckDB 8588363b: duckdb-bench tpch --formats parquet,vortex --opt scale-factor=0.1 -i 1 ran all 22 queries on both formats. All DuckDB SQL logic tests pass.
  • In CI, everything passes, including SQL logic tests, DuckDB S3 tests (httpfs built with vcpkg) and DCO. The exception is CodSpeed, which flags benchmarks in crates this PR doesn't touch.
  • action/bench-sql on eb261dbc: no suite showed a confirmed regression. Note that DuckDB's own Parquet reader also changes in this bump, so the Parquet control rows are not a stable baseline for the DuckDB attribution.

🤖 Generated with Claude Code

https://claude.ai/code/session_013h1DozjdAzpYiyEykgbhPi

@joseph-isaacs joseph-isaacs added changelog/feature A new feature ext/duckdb Relates to the DuckDB integration action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. labels Oct 15, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 15, 2026
@github-actions

github-actions Bot commented Oct 15, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done eb261db tpch-nvme-10 1 Explore Profiling Data
🟢 Done eb261db tpch-nvme 1 Explore Profiling Data
🟢 Done eb261db fineweb 1 Explore Profiling Data
🟢 Done eb261db tpch-s3 1 Explore Profiling Data
🟢 Done eb261db polarsignals 1 Explore Profiling Data
🟢 Done eb261db clickbench-nvme 1 Explore Profiling Data
🟢 Done eb261db tpcds-nvme 1 Explore Profiling Data
Previous Runs (3)
Status Commit Job Attempt Link
🟢 Done 55df3f5 random-access-bench 1 Explore Profiling Data
🟢 Done 55df3f5 compress-bench 1 Explore Profiling Data
🟢 Done 55df3f5 string-bench 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 55df3f55 vs base c128e993


vortex / vortex-file-compressed / ms (1.003x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 32.301455 / 32.295486 / +0.0%
read/clickbench/URL/shard-0/onpair-12 19.572311 / 19.505697 / +0.3%
read/tpch/l_comment/fsst 51.817558 / 51.457197 / +0.7%
read/tpch/l_comment/onpair-12 43.895968 / 43.742231 / +0.4%
write/clickbench/URL/shard-0/fsst 491.478301 / 490.275923 / +0.2%
write/clickbench/URL/shard-0/onpair-12 819.640379 / 821.356004 / -0.2%
write/tpch/l_comment/fsst 1138.40805 / 1135.29898 / +0.3%
write/tpch/l_comment/onpair-12 1423.50423 / 1419.31033 / +0.3%
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 47.3744121 / 47.3744121 / +0.0%
size/clickbench/URL/shard-0/onpair-12 28.3410988 / 28.3410988 / +0.0%
size/tpch/l_comment/fsst 30.1093362 / 30.1093362 / +0.0%
size/tpch/l_comment/onpair-12 23.0415004 / 23.0415004 / +0.0%

@codspeed

codspeed Bot commented Oct 15, 2026 •

Copy link
Copy Markdown

Merging this PR will degrade performance by 28.33%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ 1 benchmark measured no execution time

Nothing ran under measurement, usually because the compiler removed the code under test. This result is not comparable, so it counts as unchanged.

Preventing compiler optimizations

⚠️ 18 benchmarks spent significant time in system calls

System calls cannot be consistently instrumented, so they are not included in the measure, which understates the real cost. Please switch to the Walltime instrument to accurately measure system calls.

Measurement and system calls

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 1 improved benchmark
❌ 4 regressed benchmarks
✅ 2254 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ ⚠️ Simulation density_sweep_dense_runs[0.9] 13.3 µs 51.9 µs -74.42%
❌ ⚠️ Simulation random_i128[0.01] 4.9 µs 6 µs -17.88%
❌ WallTime bitpack_blocked_compress_avx2 6.7 µs 7.6 µs -12.21%
❌ ⚠️ Simulation test_repeated_scan_scalar_at[int_str] 441.9 µs 491.6 µs -10.1%
⚡ Simulation test_scan_filter[int] 3.5 ms 3 ms +14.03%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/relaxed-goldberg-03ljyd (3078838) with develop (52a1d15)1

Open in CodSpeed

Footnotes

  1. No successful run was found on develop (18aebea) during the generation of this report, so 52a1d15 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 55df3f55 vs base c128e993


vortex / vortex-file-compressed / ns (0.987x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 763505331 / 783761251 / -2.6%
compress time/Bimbo 3591155960 / 3668706776 / -2.1%
compress time/CMSprovider 2537110109 / 2543515424 / -0.3%
compress time/Euro2016 270576612 / 266848943 / +1.4%
compress time/Food 316466011 / 316732994 / -0.1%
compress time/HashTags 467698700 / 461952458 / +1.2%
compress time/TPC-H l_comment canonical 607268222 / 604464733 / +0.5%
compress time/TPC-H l_comment chunked 611511430 / 607519424 / +0.7%
compress time/taxi 391840364 / 391199320 / +0.2%
compress time/wide table cols=100 chunks=1 rows=1000 7238173 / 7217734 / +0.3%
compress time/wide table cols=100 chunks=50 rows=1000 7096533 / 7274091 / -2.4%
compress time/wide table cols=1000 chunks=1 rows=1000 70565243 / 70886807 / -0.5%
compress time/wide table cols=1000 chunks=50 rows=1000 70577158 / 71078734 / -0.7%
compress time/wide table cols=10000 chunks=1 rows=1000 779850939 / 786168347 / -0.8%
compress time/wide table cols=10000 chunks=50 rows=1000 786294382 / 790242874 / -0.5%
decompress time/Arade 9156504 / 9749611 / -6.1%
decompress time/Bimbo 38124254 / 39102457 / -2.5%
decompress time/CMSprovider 27764807 / 29113409 / -4.6%
decompress time/Euro2016 10115049 / 10015875 / +1.0%
decompress time/Food 2638793 / 2652613 / -0.5%
decompress time/HashTags 45406556 / 45882611 / -1.0%
decompress time/TPC-H l_comment canonical 11043446 / 11719311 / -5.8%
decompress time/TPC-H l_comment chunked 11245318 / 11523216 / -2.4%
decompress time/taxi 5266187 / 5476550 / -3.8%
decompress time/wide table cols=100 chunks=1 rows=1000 1920660 / 1958425 / -1.9%
decompress time/wide table cols=100 chunks=50 rows=1000 1899805 / 1959855 / -3.1%
decompress time/wide table cols=1000 chunks=1 rows=1000 18601662 / 18658142 / -0.3%
decompress time/wide table cols=1000 chunks=50 rows=1000 18453040 / 18588512 / -0.7%
decompress time/wide table cols=10000 chunks=1 rows=1000 216891172 / 221022306 / -1.9%
decompress time/wide table cols=10000 chunks=50 rows=1000 221097525 / 219120247 / +0.9%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 142213756 / 142213756 / +0.0%
vortex-file-compressed size/Bimbo 458581212 / 458581212 / +0.0%
vortex-file-compressed size/CMSprovider 420794836 / 420794836 / +0.0%
vortex-file-compressed size/Euro2016 164130260 / 164125572 / +0.0%
vortex-file-compressed size/Food 38950752 / 38950752 / +0.0%
vortex-file-compressed size/HashTags 196170516 / 196170516 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 178688232 / 178688232 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 178688232 / 178688232 / +0.0%
vortex-file-compressed size/taxi 49998092 / 49998092 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 934080 / 934080 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 934080 / 934080 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9325680 / 9325680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9325680 / 9325680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93277680 / 93277680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93277680 / 93277680 / +0.0%
vortex / vortex-file-compressed / ratio (0.989x ➖, 0↑ 0↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.339313308 / 0.347543396 / -2.4%
vortex:parquet-zstd ratio compress time/Bimbo 0.303737773 / 0.309952525 / -2.0%
vortex:parquet-zstd ratio compress time/CMSprovider 0.398455347 / 0.397411507 / +0.3%
vortex:parquet-zstd ratio compress time/Euro2016 0.251004953 / 0.246860271 / +1.7%
vortex:parquet-zstd ratio compress time/Food 0.427570911 / 0.428576527 / -0.2%
vortex:parquet-zstd ratio compress time/HashTags 0.255739729 / 0.25273576 / +1.2%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.231053975 / 0.230331923 / +0.3%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.232345623 / 0.231166775 / +0.5%
vortex:parquet-zstd ratio compress time/taxi 0.359441512 / 0.357815724 / +0.5%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.82959331 / 1.82799545 / +0.1%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.76700471 / 1.84314299 / -4.1%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.58184467 / 1.58067725 / +0.1%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.60078938 / 1.57939875 / +1.4%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.66706574 / 1.72673535 / -3.5%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.69156108 / 1.74803884 / -3.2%
vortex:parquet-zstd ratio decompress time/Arade 0.0164508477 / 0.0175311475 / -6.2%
vortex:parquet-zstd ratio decompress time/Bimbo 0.0236492244 / 0.0243671593 / -2.9%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0203550676 / 0.0213209235 / -4.5%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0303748247 / 0.0301819346 / +0.6%
vortex:parquet-zstd ratio decompress time/Food 0.0155001334 / 0.0156033241 / -0.7%
vortex:parquet-zstd ratio decompress time/HashTags 0.0879872503 / 0.0889543775 / -1.1%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0222522711 / 0.0234489322 / -5.1%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0225596528 / 0.0230577224 / -2.2%
vortex:parquet-zstd ratio decompress time/taxi 0.024113206 / 0.0251088577 / -4.0%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.940811916 / 0.949871907 / -1.0%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.88045323 / 0.953056547 / -7.6%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.79122713 / 0.791178105 / +0.0%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.814989053 / 0.766028977 / +6.4%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.861557571 / 0.911446472 / -5.5%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.881500053 / 0.911984338 / -3.3%
vortex:parquet-zstd size/Arade 0.551185597 / 0.551185597 / -0.0%
vortex:parquet-zstd size/Bimbo 1.19261532 / 1.19261532 / +0.0%
vortex:parquet-zstd size/CMSprovider 1.11649863 / 1.11649863 / -0.0%
vortex:parquet-zstd size/Euro2016 1.33461969 / 1.33458157 / +0.0%
vortex:parquet-zstd size/Food 1.09107276 / 1.09107276 / -0.0%
vortex:parquet-zstd size/HashTags 1.46946859 / 1.46946859 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.12837977 / 1.12837977 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.12837977 / 1.12837977 / -0.0%
vortex:parquet-zstd size/taxi 0.904392267 / 0.904392267 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.0017975 / 1.0017975 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.0017975 / 1.0017975 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 1.00017975 / 1.00017975 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 1.00017975 / 1.00017975 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 1.00040408 / 1.00040408 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 1.00040408 / 1.00040408 / -0.0%
vortex / parquet / ns (1.003x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2250148497 / 2255146438 / -0.2%
parquet_rs-zstd compress time/Bimbo 11823211604 / 11836350665 / -0.1%
parquet_rs-zstd compress time/CMSprovider 6367363698 / 6400205784 / -0.5%
parquet_rs-zstd compress time/Euro2016 1077973198 / 1080971603 / -0.3%
parquet_rs-zstd compress time/Food 740148599 / 739034860 / +0.2%
parquet_rs-zstd compress time/HashTags 1828807366 / 1827808058 / +0.1%
parquet_rs-zstd compress time/TPC-H l_comment canonical 2628252650 / 2624320261 / +0.1%
parquet_rs-zstd compress time/TPC-H l_comment chunked 2631904243 / 2628056835 / +0.1%
parquet_rs-zstd compress time/taxi 1090136645 / 1093298292 / -0.3%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3956165 / 3948442 / +0.2%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 4016137 / 3946569 / +1.8%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 44609464 / 44845845 / -0.5%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 44088972 / 45003666 / -2.0%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 467798551 / 455291743 / +2.7%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 464833573 / 452073979 / +2.8%
parquet_rs-zstd decompress time/Arade 556597701 / 556130794 / +0.1%
parquet_rs-zstd decompress time/Bimbo 1612072066 / 1604719553 / +0.5%
parquet_rs-zstd decompress time/CMSprovider 1364024311 / 1365485363 / -0.1%
parquet_rs-zstd decompress time/Euro2016 333007650 / 331850000 / +0.3%
parquet_rs-zstd decompress time/Food 170243244 / 170003070 / +0.1%
parquet_rs-zstd decompress time/HashTags 516058359 / 515799360 / +0.1%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 496283995 / 499780157 / -0.7%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 498470349 / 499755171 / -0.3%
parquet_rs-zstd decompress time/taxi 218394311 / 218112272 / +0.1%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2041492 / 2061778 / -1.0%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2157758 / 2056389 / +4.9%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23509889 / 23582733 / -0.3%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 22642071 / 24266069 / -6.7%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 251743098 / 242496200 / +3.8%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 250819639 / 240267555 / +4.4%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.992x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 98689536 / 99924816 / -1.2%
arrow-ipc compress time/Bimbo 616335281 / 628630541 / -2.0%
arrow-ipc compress time/CMSprovider 384049812 / 388473560 / -1.1%
arrow-ipc compress time/Euro2016 38276895 / 38730631 / -1.2%
arrow-ipc compress time/Food 33843101 / 34162393 / -0.9%
arrow-ipc compress time/HashTags 78571168 / 79089034 / -0.7%
arrow-ipc compress time/TPC-H l_comment canonical 522436473 / 522145235 / +0.1%
arrow-ipc compress time/TPC-H l_comment chunked 504057452 / 503107623 / +0.2%
arrow-ipc compress time/taxi 74888684 / 75453769 / -0.7%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 203138 / 211367 / -3.9%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 204076 / 204785 / -0.3%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2252343 / 2285383 / -1.4%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2243257 / 2263183 / -0.9%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25621756 / 25776549 / -0.6%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25863951 / 25986682 / -0.5%
arrow-ipc decompress time/Arade 180681230 / 182251283 / -0.9%
arrow-ipc decompress time/Bimbo 413749949 / 431731551 / -4.2%
arrow-ipc decompress time/CMSprovider 583137072 / 582886388 / +0.0%
arrow-ipc decompress time/Euro2016 74647476 / 74827459 / -0.2%
arrow-ipc decompress time/Food 58354300 / 58642820 / -0.5%
arrow-ipc decompress time/HashTags 142503835 / 143587525 / -0.8%
arrow-ipc decompress time/TPC-H l_comment canonical 540728270 / 536980664 / +0.7%
arrow-ipc decompress time/TPC-H l_comment chunked 531351668 / 536074489 / -0.9%
arrow-ipc decompress time/taxi 48448688 / 48825683 / -0.8%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 318177 / 319284 / -0.3%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 316790 / 319332 / -0.8%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3605988 / 3540376 / +1.9%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3611553 / 3656778 / -1.2%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 36683962 / 37120911 / -1.2%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 36783924 / 36661311 / +0.3%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

Copy link
Copy Markdown
Contributor Author

CodSpeed Performance Analysis reports "1 benchmark regressed" on both 55df3f5 and 0caa032. I don't think this PR causes it: compared with develop, the PR only changes vortex-duckdb, vortex-sqllogictest and scripts/duckdb-r2-prepare.sh. None of the CodSpeed benchmark crates (vortex-array, encodings, vortex-python, vortex-spatial) are touched, and CodSpeed's summary itself warns the walltime numbers are inconsistent on hosted runners. No fix to port, and I can't re-run the CodSpeed app check from here.


Generated by Claude Code

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 55df3f55 vs base c128e993
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.4%
Engines: random-access No clear signal (+4.4%, environment too noisy confidence)
Vortex (geomean): hot 0.997x ➖
Parquet (geomean): hot 0.956x ➖
Shifts: Parquet (control) -4.4% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (1.087x ➖, 1↑ 3↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 73911 / 69769 / +5.9%
random-access/arrow-tokio-local-disk-footer 170049 / 163218 / +4.2%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 2436315 / 1344038 / +81.3% 🔴
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 2086028 / 2084350 / +0.1%
random-access/feature-vectors/uniform/arrow-tokio-local-disk 32130176 / 54663458 / -41.2% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 55546123 / 32622491 / +70.3% 🔴
random-access/nested-lists/correlated/arrow-tokio-local-disk 63042 / 58893 / +7.0%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 109401 / 102581 / +6.6%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1193201 / 1114788 / +7.0%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1267498 / 1162076 / +9.1%
random-access/nested-structs/correlated/arrow-tokio-local-disk 55912 / 53632 / +4.3%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 98369 / 92747 / +6.1%
random-access/nested-structs/uniform/arrow-tokio-local-disk 912392 / 892792 / +2.2%
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 993135 / 930526 / +6.7%
random-access/taxi/correlated/arrow-tokio-local-disk 126134 / 116277 / +8.5%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 226774 / 215980 / +5.0%
random-access/taxi/uniform/arrow-tokio-local-disk 2977258 / 2649990 / +12.3% 🔴
random-access/taxi/uniform/arrow-tokio-local-disk-footer 3095799 / 2831657 / +9.3%
random-access / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 246290 / 244851 / +0.6%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1219820 / 1228914 / -0.7%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 1437321 / 1416007 / +1.5%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 2666891 / 2714073 / -1.7%
random-access/nested-lists/correlated/vortex-tokio-local-disk 219131 / 207704 / +5.5%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 378726 / 376011 / +0.7%
random-access/nested-lists/uniform/vortex-tokio-local-disk 710795 / 724563 / -1.9%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 947367 / 935215 / +1.3%
random-access/nested-structs/correlated/vortex-tokio-local-disk 279174 / 276971 / +0.8%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 510439 / 507329 / +0.6%
random-access/nested-structs/uniform/vortex-tokio-local-disk 624577 / 623844 / +0.1%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 911737 / 918319 / -0.7%
random-access/taxi/correlated/vortex-tokio-local-disk 681775 / 674519 / +1.1%
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1364401 / 1439555 / -5.2%
random-access/taxi/uniform/vortex-tokio-local-disk 2697491 / 2691337 / +0.2%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3787154 / 3796912 / -0.3%
random-access/vortex-tokio-local-disk 449356 / 452940 / -0.8%
random-access/vortex-tokio-local-disk-footer 1013261 / 1069574 / -5.3%
random-access / parquet / ns (0.956x ➖, 2↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 112982017866 / 107221220388 / +5.4%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 108651740535 / 114173205177 / -4.8%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 107306183335 / 183122759820 / -41.4% 🟢
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 108437166238 / 141426734483 / -23.3% 🟢
random-access/nested-lists/correlated/parquet-tokio-local-disk 148472385 / 147392707 / +0.7%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 145781976 / 146978936 / -0.8%
random-access/nested-lists/uniform/parquet-tokio-local-disk 144708694 / 146909654 / -1.5%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 144921405 / 148276459 / -2.3%
random-access/nested-structs/correlated/parquet-tokio-local-disk 45063118 / 44844970 / +0.5%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 45067941 / 44952042 / +0.3%
random-access/nested-structs/uniform/parquet-tokio-local-disk 44963457 / 44900034 / +0.1%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 45101498 / 45437905 / -0.7%
random-access/parquet-tokio-local-disk 120221342 / 120300040 / -0.1%
random-access/parquet-tokio-local-disk-footer 121430159 / 119026915 / +2.0%
random-access/taxi/correlated/parquet-tokio-local-disk 180483863 / 180609622 / -0.1%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 181732927 / 178535081 / +1.8%
random-access/taxi/uniform/parquet-tokio-local-disk 188499433 / 192344820 / -2.0%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 188023887 / 187962041 / +0.0%
random-access / lance / ns (0.996x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 212431 / 213213 / -0.4%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1015901 / 1019584 / -0.4%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1062554 / 1083360 / -1.9%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1895128 / 1923363 / -1.5%
random-access/lance-tokio-local-disk 557050 / 556653 / +0.1%
random-access/lance-tokio-local-disk-footer 1309179 / 1320472 / -0.9%
random-access/nested-lists/correlated/lance-tokio-local-disk 162391 / 158978 / +2.1%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 501194 / 500126 / +0.2%
random-access/nested-lists/uniform/lance-tokio-local-disk 909304 / 904681 / +0.5%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1443291 / 1447134 / -0.3%
random-access/nested-structs/correlated/lance-tokio-local-disk 279380 / 279668 / -0.1%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 565138 / 569785 / -0.8%
random-access/nested-structs/uniform/lance-tokio-local-disk 2341476 / 2328935 / +0.5%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2686171 / 2665811 / +0.8%
random-access/taxi/correlated/lance-tokio-local-disk 799008 / 800329 / -0.2%
random-access/taxi/correlated/lance-tokio-local-disk-footer 1822558 / 1833709 / -0.6%
random-access/taxi/uniform/lance-tokio-local-disk 8125495 / 8220447 / -1.2%
random-access/taxi/uniform/lance-tokio-local-disk-footer 8699194 / 8919340 / -2.5%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access (S3) 📖

Commits: PR 55df3f55 vs base c1a2ca12
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -10.1%
Engines: random-access No clear signal (-10.1%, environment too noisy confidence)
Vortex (geomean): hot 0.901x ➖
Parquet (geomean): hot 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish -1.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (0.901x ➖, 2↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-s3 53533346 / 47920046 / +11.7%
random-access/feature-vectors/correlated/vortex-tokio-s3-footer 135226057 / 119119492 / +13.5%
random-access/feature-vectors/uniform/vortex-tokio-s3 134853010 / 144193832 / -6.5%
random-access/feature-vectors/uniform/vortex-tokio-s3-footer 233979978 / 202912377 / +15.3%
random-access/nested-lists/correlated/vortex-tokio-s3 48419124 / 54907369 / -11.8%
random-access/nested-lists/correlated/vortex-tokio-s3-footer 95423465 / 97725886 / -2.4%
random-access/nested-lists/uniform/vortex-tokio-s3 173531829 / 160737201 / +8.0%
random-access/nested-lists/uniform/vortex-tokio-s3-footer 209612787 / 202781535 / +3.4%
random-access/nested-structs/correlated/vortex-tokio-s3 67942068 / 128857652 / -47.3% 🟢
random-access/nested-structs/correlated/vortex-tokio-s3-footer 115060118 / 309292105 / -62.8% 🟢
random-access/nested-structs/uniform/vortex-tokio-s3 173408834 / 229856866 / -24.6%
random-access/nested-structs/uniform/vortex-tokio-s3-footer 247134064 / 300865403 / -17.9%
random-access/taxi/correlated/vortex-tokio-s3 99220644 / 97864021 / +1.4%
random-access/taxi/correlated/vortex-tokio-s3-footer 138178437 / 170304746 / -18.9%
random-access/taxi/uniform/vortex-tokio-s3 176633101 / 173714111 / +1.7%
random-access/taxi/uniform/vortex-tokio-s3-footer 217760014 / 218405515 / -0.3%
random-access/vortex-tokio-s3 62379418 / 58255320 / +7.1%
random-access/vortex-tokio-s3-footer 109244942 / 100913180 / +8.3%
random-access / parquet / ns (1.002x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-s3 179749275213 / 185676888695 / -3.2%
random-access/feature-vectors/correlated/parquet-tokio-s3-footer 202715189981 / 178660309506 / +13.5%
random-access/feature-vectors/uniform/parquet-tokio-s3 179979670736 / 177208154692 / +1.6%
random-access/feature-vectors/uniform/parquet-tokio-s3-footer 192315215093 / 170913803660 / +12.5%
random-access/nested-lists/correlated/parquet-tokio-s3 1029157011 / 1023547549 / +0.5%
random-access/nested-lists/correlated/parquet-tokio-s3-footer 1111931197 / 1116646498 / -0.4%
random-access/nested-lists/uniform/parquet-tokio-s3 1026081205 / 1029761911 / -0.4%
random-access/nested-lists/uniform/parquet-tokio-s3-footer 1154029584 / 1108354166 / +4.1%
random-access/nested-structs/correlated/parquet-tokio-s3 452379280 / 455780408 / -0.7%
random-access/nested-structs/correlated/parquet-tokio-s3-footer 536886028 / 552014347 / -2.7%
random-access/nested-structs/uniform/parquet-tokio-s3 451895900 / 459907194 / -1.7%
random-access/nested-structs/uniform/parquet-tokio-s3-footer 539610575 / 539847263 / -0.0%
random-access/parquet-tokio-s3 501588254 / 490496733 / +2.3%
random-access/parquet-tokio-s3-footer 550522247 / 622137427 / -11.5%
random-access/taxi/correlated/parquet-tokio-s3 735978988 / 733346723 / +0.4%
random-access/taxi/correlated/parquet-tokio-s3-footer 796817792 / 796091324 / +0.1%
random-access/taxi/uniform/parquet-tokio-s3 786973657 / 800872944 / -1.7%
random-access/taxi/uniform/parquet-tokio-s3-footer 848638705 / 898597305 / -5.6%
random-access / lance / ns (1.130x ➖, 1↑ 6↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-s3 91724616 / 45757328 / +100.5% 🔴
random-access/feature-vectors/correlated/lance-tokio-s3-footer 331410708 / 197830320 / +67.5% 🔴
random-access/feature-vectors/uniform/lance-tokio-s3 119053467 / 90231868 / +31.9% 🔴
random-access/feature-vectors/uniform/lance-tokio-s3-footer 310478444 / 237933560 / +30.5% 🔴
random-access/lance-tokio-s3 92456747 / 93819088 / -1.5%
random-access/lance-tokio-s3-footer 299910077 / 283983767 / +5.6%
random-access/nested-lists/correlated/lance-tokio-s3 55883824 / 40576516 / +37.7% 🔴
random-access/nested-lists/correlated/lance-tokio-s3-footer 309368891 / 246087559 / +25.7%
random-access/nested-lists/uniform/lance-tokio-s3 117800749 / 77177920 / +52.6% 🔴
random-access/nested-lists/uniform/lance-tokio-s3-footer 330281471 / 270832059 / +22.0%
random-access/nested-structs/correlated/lance-tokio-s3 77495131 / 90856036 / -14.7%
random-access/nested-structs/correlated/lance-tokio-s3-footer 277572345 / 295751160 / -6.1%
random-access/nested-structs/uniform/lance-tokio-s3 162866278 / 196287529 / -17.0%
random-access/nested-structs/uniform/lance-tokio-s3-footer 416825678 / 395815611 / +5.3%
random-access/taxi/correlated/lance-tokio-s3 83994060 / 83743493 / +0.3%
random-access/taxi/correlated/lance-tokio-s3-footer 288219877 / 280057330 / +2.9%
random-access/taxi/uniform/lance-tokio-s3 225285253 / 373715072 / -39.7% 🟢
random-access/taxi/uniform/lance-tokio-s3-footer 506902704 / 476286907 / +6.4%

Squash of #9141 (DuckDB 2.0) merged with develop, plus:

- Bump DEFAULT_DUCKDB_VERSION to 8588363bf15e090fcbbfe2a68ec98b10c6866cb1,
  the head of DuckDB's v2.0-cyanoptera release branch.
- Build httpfs with DuckDB's pinned vcpkg for Linux R2 builds; drop it from
  the macOS universal build. build.rs only links httpfs when
  VCPKG_TOOLCHAIN_PATH is set.
- Read DynamicFilterData::lock (now an annotated_shared_mutex) under
  annotated_shared_lock.
- Keep develop's i8 decimal narrowing alongside #9141's zeroing of invalid
  decimal slots in convert/vector.rs.

Co-authored-by: Mikhail Kot <mikhail@spiraldb.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013h1DozjdAzpYiyEykgbhPi
Signed-off-by: Claude <noreply@anthropic.com>
@joseph-isaacs
joseph-isaacs force-pushed the ji/relaxed-goldberg-03ljyd branch from b4a7dbf to eb261db Compare October 15, 2026 13:38
@joseph-isaacs
joseph-isaacs marked this pull request as draft October 15, 2026 13:51
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 15, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 15, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR eb261dbc vs base c1a2ca12
Vortex (geomean): hot 1.002x ➖ · cold 1.059x ➖


datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45121457 / 44905778 / +0.5% 88671923 / 84321171 / +5.2% 0.51 / 0.53 / -4.4%
polarsignals_q01/datafusion:vortex-file-compressed 51093130 / 51164540 / -0.1% 112839043 / 104818429 / +7.7% 0.45 / 0.49 / -7.2%
polarsignals_q02/datafusion:vortex-file-compressed 46176629 / 46180792 / -0.0% 83080084 / 80160448 / +3.6% 0.56 / 0.58 / -3.5%
polarsignals_q03/datafusion:vortex-file-compressed 54816604 / 53887969 / +1.7% 115679282 / 106659265 / +8.5% 0.47 / 0.51 / -6.2%
polarsignals_q04/datafusion:vortex-file-compressed 9431558 / 9587010 / -1.6% 45708456 / 44046332 / +3.8% 0.21 / 0.22 / -5.2%
polarsignals_q05/datafusion:vortex-file-compressed 12160751 / 12072942 / +0.7% 52451711 / 47345359 / +10.8% 🔴 0.23 / 0.25 / -9.1%
polarsignals_q06/datafusion:vortex-file-compressed 23390537 / 23510752 / -0.5% 60299445 / 57568898 / +4.7% 0.39 / 0.41 / -5.0%
polarsignals_q07/datafusion:vortex-file-compressed 11356182 / 11361676 / -0.0% 48578954 / 45920410 / +5.8% 0.23 / 0.25 / -5.5%
polarsignals_q08/datafusion:vortex-file-compressed 98405584 / 97920952 / +0.5% 162155786 / 157103721 / +3.2% 0.61 / 0.62 / -2.6%
polarsignals_q09/datafusion:vortex-file-compressed 10222790 / 10092252 / +1.3% 46712612 / 43910578 / +6.4% 0.22 / 0.23 / -4.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR eb261dbc vs base c1a2ca12
Verdict: Likely improvement (medium confidence)
Attributed Vortex impact: -25.5%
Engines: DataFusion No clear signal (+3.5%, low confidence) · DuckDB Likely improvement (-46.4%, environment too noisy confidence)
Vortex (geomean): hot 0.854x ✅ · cold 0.852x ✅
Parquet (geomean): hot 1.147x ❌ · cold 1.097x ➖
Shifts: Parquet (control) +14.7% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.039x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6864484 / 6929984 / -0.9% 19705978 / 20353868 / -3.2% 0.35 / 0.34 / +2.3%
fineweb_q01/datafusion:vortex-file-compressed 11950788 / 9920945 / +20.5% 🔴 50117717 / 53396399 / -6.1% 0.24 / 0.19 / +28.3%
fineweb_q02/datafusion:vortex-file-compressed 12288054 / 14082598 / -12.7% 🟢 49325920 / 61741306 / -20.1% 🟢 0.25 / 0.23 / +9.2%
fineweb_q03/datafusion:vortex-file-compressed 22295076 / 21282065 / +4.8% 112078022 / 117791107 / -4.9% 0.20 / 0.18 / +10.1%
fineweb_q04/datafusion:vortex-file-compressed 80611234 / 81817507 / -1.5% 171224363 / 174060845 / -1.6% 0.47 / 0.47 / +0.2%
fineweb_q05/datafusion:vortex-file-compressed 68743112 / 67646518 / +1.6% 151168270 / 150020258 / +0.8% 0.45 / 0.45 / +0.8%
fineweb_q06/datafusion:vortex-file-compressed 20914666 / 20475402 / +2.1% 113555427 / 121770990 / -6.7% 0.18 / 0.17 / +9.5%
fineweb_q07/datafusion:vortex-file-compressed 19114596 / 19144004 / -0.2% 110910216 / 113493965 / -2.3% 0.17 / 0.17 / +2.2%
fineweb_q08/datafusion:vortex-file-compressed 10988918 / 8693760 / +26.4% 🔴 39783348 / 50948172 / -21.9% 🟢 0.28 / 0.17 / +61.9%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9190660 / 9393922 / -2.2% 34226478 / 34202181 / +0.1% 0.27 / 0.27 / -2.2%
fineweb_q01/datafusion:parquet 74999522 / 75554452 / -0.7% 167800361 / 166405623 / +0.8% 0.45 / 0.45 / -1.6%
fineweb_q02/datafusion:parquet 77595641 / 75102002 / +3.3% 169464142 / 167037188 / +1.5% 0.46 / 0.45 / +1.8%
fineweb_q03/datafusion:parquet 74795949 / 73389444 / +1.9% 164377356 / 153894861 / +6.8% 0.46 / 0.48 / -4.6%
fineweb_q04/datafusion:parquet 82156720 / 82209555 / -0.1% 162098604 / 161189601 / +0.6% 0.51 / 0.51 / -0.6%
fineweb_q05/datafusion:parquet 80165546 / 80687782 / -0.6% 162858703 / 167407239 / -2.7% 0.49 / 0.48 / +2.1%
fineweb_q06/datafusion:parquet 75283874 / 76144446 / -1.1% 165825462 / 169328712 / -2.1% 0.45 / 0.45 / +1.0%
fineweb_q07/datafusion:parquet 75167286 / 74574305 / +0.8% 170805524 / 158880880 / +7.5% 0.44 / 0.47 / -6.2%
fineweb_q08/datafusion:parquet 74199952 / 72718176 / +2.0% 158497858 / 166333021 / -4.7% 0.47 / 0.44 / +7.1%
duckdb / vortex-file-compressed / ns (0.702x ✅, 8↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2415901 / 2249656 / +7.4% 8049191 / 4835173 / +66.5% 🔴 0.30 / 0.47 / -35.5%
fineweb_q01/duckdb:vortex-file-compressed 11826525 / 23973548 / -50.7% 🟢 37040307 / 67590227 / -45.2% 🟢 0.32 / 0.35 / -10.0%
fineweb_q02/duckdb:vortex-file-compressed 13458979 / 18778298 / -28.3% 🟢 38753200 / 61342379 / -36.8% 🟢 0.35 / 0.31 / +13.5%
fineweb_q03/duckdb:vortex-file-compressed 20164262 / 27702026 / -27.2% 🟢 100722694 / 120264779 / -16.2% 🟢 0.20 / 0.23 / -13.1%
fineweb_q04/duckdb:vortex-file-compressed 79662239 / 105489520 / -24.5% 🟢 119501114 / 220077238 / -45.7% 🟢 0.67 / 0.48 / +39.1%
fineweb_q05/duckdb:vortex-file-compressed 66500596 / 92541580 / -28.1% 🟢 111151698 / 212661188 / -47.7% 🟢 0.60 / 0.44 / +37.5%
fineweb_q06/duckdb:vortex-file-compressed 20018212 / 34262077 / -41.6% 🟢 102518311 / 109549353 / -6.4% 0.20 / 0.31 / -37.6%
fineweb_q07/duckdb:vortex-file-compressed 19340810 / 28888183 / -33.0% 🟢 97000373 / 104532388 / -7.2% 0.20 / 0.28 / -27.9%
fineweb_q08/duckdb:vortex-file-compressed 5467760 / 7763176 / -29.6% 🟢 13897405 / 14388519 / -3.4% 0.39 / 0.54 / -27.1%
duckdb / parquet / ns (1.310x ❌, 0↑ 9↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 27321819 / 21786780 / +25.4% 🔴 30030927 / 23744885 / +26.5% 🔴 0.91 / 0.92 / -0.8%
fineweb_q01/duckdb:parquet 60141014 / 44083326 / +36.4% 🔴 80986810 / 57252133 / +41.5% 🔴 0.74 / 0.77 / -3.6%
fineweb_q02/duckdb:parquet 63910382 / 44685520 / +43.0% 🔴 85403685 / 57611765 / +48.2% 🔴 0.75 / 0.78 / -3.5%
fineweb_q03/duckdb:parquet 127218722 / 94736113 / +34.3% 🔴 193926041 / 177264917 / +9.4% 0.66 / 0.53 / +22.8%
fineweb_q04/duckdb:parquet 175932684 / 151512521 / +16.1% 🔴 221581805 / 207566461 / +6.8% 0.79 / 0.73 / +8.8%
fineweb_q05/duckdb:parquet 169396892 / 143292263 / +18.2% 🔴 221377514 / 197441531 / +12.1% 🔴 0.77 / 0.73 / +5.4%
fineweb_q06/duckdb:parquet 94410462 / 72305654 / +30.6% 🔴 161235181 / 139063089 / +15.9% 🔴 0.59 / 0.52 / +12.6%
fineweb_q07/duckdb:parquet 95578773 / 72179293 / +32.4% 🔴 157552344 / 155349989 / +1.4% 0.61 / 0.46 / +30.6%
fineweb_q08/duckdb:parquet 33487872 / 22927114 / +46.1% 🔴 34392657 / 28401608 / +21.1% 🔴 0.97 / 0.81 / +20.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR eb261dbc vs base c087cd96
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.2%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-6.4%, environment too noisy confidence)
Vortex (geomean): hot 0.973x ➖ · cold 0.951x ➖
Parquet (geomean): hot 1.006x ➖ · cold 0.990x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15627522 / 15786374 / -1.0% 44279776 / 44324296 / -0.1% 0.35 / 0.36 / -0.9%
tpch_q02/datafusion:vortex-file-compressed 17457438 / 17658441 / -1.1% 34862503 / 36249926 / -3.8% 0.50 / 0.49 / +2.8%
tpch_q03/datafusion:vortex-file-compressed 19687033 / 19473946 / +1.1% 45712105 / 51796524 / -11.7% 🟢 0.43 / 0.38 / +14.6%
tpch_q04/datafusion:vortex-file-compressed 10116608 / 10189118 / -0.7% 32489553 / 33253614 / -2.3% 0.31 / 0.31 / +1.6%
tpch_q05/datafusion:vortex-file-compressed 37076553 / 37365974 / -0.8% 64349964 / 63176928 / +1.9% 0.58 / 0.59 / -2.6%
tpch_q06/datafusion:vortex-file-compressed 6343640 / 6682217 / -5.1% 27952145 / 28314587 / -1.3% 0.23 / 0.24 / -3.8%
tpch_q07/datafusion:vortex-file-compressed 51771172 / 52353682 / -1.1% 80320528 / 80948749 / -0.8% 0.64 / 0.65 / -0.3%
tpch_q08/datafusion:vortex-file-compressed 52225625 / 52810180 / -1.1% 80077552 / 79403721 / +0.8% 0.65 / 0.67 / -1.9%
tpch_q09/datafusion:vortex-file-compressed 50470752 / 49024101 / +3.0% 78816395 / 77734043 / +1.4% 0.64 / 0.63 / +1.5%
tpch_q10/datafusion:vortex-file-compressed 17676145 / 17463580 / +1.2% 49070824 / 51767493 / -5.2% 0.36 / 0.34 / +6.8%
tpch_q11/datafusion:vortex-file-compressed 15196850 / 15136193 / +0.4% 34033031 / 35444545 / -4.0% 0.45 / 0.43 / +4.6%
tpch_q12/datafusion:vortex-file-compressed 23650961 / 22944063 / +3.1% 45918478 / 48352991 / -5.0% 0.52 / 0.47 / +8.5%
tpch_q13/datafusion:vortex-file-compressed 19978277 / 20006900 / -0.1% 42055938 / 41680921 / +0.9% 0.48 / 0.48 / -1.0%
tpch_q14/datafusion:vortex-file-compressed 15063880 / 14678502 / +2.6% 38232838 / 40484743 / -5.6% 0.39 / 0.36 / +8.7%
tpch_q15/datafusion:vortex-file-compressed 18479134 / 18782994 / -1.6% 45032018 / 42757377 / +5.3% 0.41 / 0.44 / -6.6%
tpch_q16/datafusion:vortex-file-compressed 18966299 / 18776182 / +1.0% 37355875 / 39965627 / -6.5% 0.51 / 0.47 / +8.1%
tpch_q17/datafusion:vortex-file-compressed 28368419 / 28016762 / +1.3% 59827471 / 58876807 / +1.6% 0.47 / 0.48 / -0.4%
tpch_q18/datafusion:vortex-file-compressed 36860507 / 36515487 / +0.9% 55513395 / 57542448 / -3.5% 0.66 / 0.63 / +4.6%
tpch_q19/datafusion:vortex-file-compressed 14623554 / 14550828 / +0.5% 39831602 / 40134956 / -0.8% 0.37 / 0.36 / +1.3%
tpch_q20/datafusion:vortex-file-compressed 21019912 / 21144673 / -0.6% 43437867 / 45005332 / -3.5% 0.48 / 0.47 / +3.0%
tpch_q21/datafusion:vortex-file-compressed 39113465 / 39503227 / -1.0% 64119771 / 66895961 / -4.2% 0.61 / 0.59 / +3.3%
tpch_q22/datafusion:vortex-file-compressed 12225155 / 11668535 / +4.8% 30141061 / 32482576 / -7.2% 0.41 / 0.36 / +12.9%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72239713 / 72404012 / -0.2% 89084729 / 90509943 / -1.6% 0.81 / 0.80 / +1.4%
tpch_q02/datafusion:parquet 58135386 / 57277875 / +1.5% 77318200 / 76862734 / +0.6% 0.75 / 0.75 / +0.9%
tpch_q03/datafusion:parquet 84635577 / 84617706 / +0.0% 108314774 / 107509268 / +0.7% 0.78 / 0.79 / -0.7%
tpch_q04/datafusion:parquet 46223161 / 46732642 / -1.1% 62816051 / 67235277 / -6.6% 0.74 / 0.70 / +5.9%
tpch_q05/datafusion:parquet 99998155 / 98724314 / +1.3% 126750954 / 126273371 / +0.4% 0.79 / 0.78 / +0.9%
tpch_q06/datafusion:parquet 32073568 / 32008416 / +0.2% 49863928 / 52961958 / -5.8% 0.64 / 0.60 / +6.4%
tpch_q07/datafusion:parquet 104199562 / 107649817 / -3.2% 135743802 / 131874538 / +2.9% 0.77 / 0.82 / -6.0%
tpch_q08/datafusion:parquet 113886831 / 112648158 / +1.1% 135799927 / 138155179 / -1.7% 0.84 / 0.82 / +2.9%
tpch_q09/datafusion:parquet 131364249 / 132143835 / -0.6% 159029758 / 160844665 / -1.1% 0.83 / 0.82 / +0.5%
tpch_q10/datafusion:parquet 104210431 / 104385130 / -0.2% 131020124 / 134870007 / -2.9% 0.80 / 0.77 / +2.8%
tpch_q11/datafusion:parquet 41816037 / 41359266 / +1.1% 63892907 / 66829091 / -4.4% 0.65 / 0.62 / +5.8%
tpch_q12/datafusion:parquet 68939512 / 68901143 / +0.1% 90257261 / 93455870 / -3.4% 0.76 / 0.74 / +3.6%
tpch_q13/datafusion:parquet 186788270 / 186050576 / +0.4% 207797992 / 211182514 / -1.6% 0.90 / 0.88 / +2.0%
tpch_q14/datafusion:parquet 48353749 / 47939551 / +0.9% 73555174 / 74245487 / -0.9% 0.66 / 0.65 / +1.8%
tpch_q15/datafusion:parquet 54663666 / 55636733 / -1.7% 74867697 / 78359949 / -4.5% 0.73 / 0.71 / +2.8%
tpch_q16/datafusion:parquet 41754576 / 41381199 / +0.9% 59328173 / 60885718 / -2.6% 0.70 / 0.68 / +3.6%
tpch_q17/datafusion:parquet 129971833 / 127548070 / +1.9% 151506008 / 155252229 / -2.4% 0.86 / 0.82 / +4.4%
tpch_q18/datafusion:parquet 129557910 / 130530443 / -0.7% 153321426 / 152380855 / +0.6% 0.85 / 0.86 / -1.4%
tpch_q19/datafusion:parquet 59425968 / 59088219 / +0.6% 84059763 / 88748214 / -5.3% 0.71 / 0.67 / +6.2%
tpch_q20/datafusion:parquet 68118088 / 67740993 / +0.6% 91620448 / 94269237 / -2.8% 0.74 / 0.72 / +3.5%
tpch_q21/datafusion:parquet 107634940 / 108798372 / -1.1% 131481552 / 134168203 / -2.0% 0.82 / 0.81 / +1.0%
tpch_q22/datafusion:parquet 47439266 / 46753085 / +1.5% 64159579 / 64732943 / -0.9% 0.74 / 0.72 / +2.4%
duckdb / vortex-file-compressed / ns (0.945x ➖, 5↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11518636 / 11838119 / -2.7% 24159939 / 19748007 / +22.3% 🔴 0.48 / 0.60 / -20.5%
tpch_q02/duckdb:vortex-file-compressed 15802941 / 16800052 / -5.9% 22945523 / 26429829 / -13.2% 🟢 0.69 / 0.64 / +8.3%
tpch_q03/duckdb:vortex-file-compressed 20008033 / 17909957 / +11.7% 🔴 34784499 / 35370455 / -1.7% 0.58 / 0.51 / +13.6%
tpch_q04/duckdb:vortex-file-compressed 12860314 / 17221021 / -25.3% 🟢 25192505 / 31503056 / -20.0% 🟢 0.51 / 0.55 / -6.6%
tpch_q05/duckdb:vortex-file-compressed 20904617 / 21869211 / -4.4% 33745366 / 36607014 / -7.8% 0.62 / 0.60 / +3.7%
tpch_q06/duckdb:vortex-file-compressed 5606828 / 5326888 / +5.3% 16652705 / 14575476 / +14.3% 🔴 0.34 / 0.37 / -7.9%
tpch_q07/duckdb:vortex-file-compressed 25586003 / 20114748 / +27.2% 🔴 40248427 / 39350800 / +2.3% 0.64 / 0.51 / +24.4%
tpch_q08/duckdb:vortex-file-compressed 22223690 / 22832299 / -2.7% 37159211 / 37606812 / -1.2% 0.60 / 0.61 / -1.5%
tpch_q09/duckdb:vortex-file-compressed 22485204 / 28738851 / -21.8% 🟢 39512982 / 50715469 / -22.1% 🟢 0.57 / 0.57 / +0.4%
tpch_q10/duckdb:vortex-file-compressed 23785987 / 28980928 / -17.9% 🟢 38345883 / 49456104 / -22.5% 🟢 0.62 / 0.59 / +5.9%
tpch_q11/duckdb:vortex-file-compressed 7957729 / 8642028 / -7.9% 15562347 / 14529487 / +7.1% 0.51 / 0.59 / -14.0%
tpch_q12/duckdb:vortex-file-compressed 16619626 / 15455661 / +7.5% 30869915 / 31787532 / -2.9% 0.54 / 0.49 / +10.7%
tpch_q13/duckdb:vortex-file-compressed 21485829 / 21559870 / -0.3% 33210079 / 38375628 / -13.5% 🟢 0.65 / 0.56 / +15.2%
tpch_q14/duckdb:vortex-file-compressed 12472999 / 12983642 / -3.9% 22526286 / 24420697 / -7.8% 0.55 / 0.53 / +4.1%
tpch_q15/duckdb:vortex-file-compressed 9062430 / 9403639 / -3.6% 20649033 / 19967249 / +3.4% 0.44 / 0.47 / -6.8%
tpch_q16/duckdb:vortex-file-compressed 18867940 / 18167404 / +3.9% 24897906 / 24304352 / +2.4% 0.76 / 0.75 / +1.4%
tpch_q17/duckdb:vortex-file-compressed 14122389 / 14241424 / -0.8% 26774991 / 34228858 / -21.8% 🟢 0.53 / 0.42 / +26.8%
tpch_q18/duckdb:vortex-file-compressed 27015668 / 23115879 / +16.9% 🔴 35538608 / 36719131 / -3.2% 0.76 / 0.63 / +20.8%
tpch_q19/duckdb:vortex-file-compressed 12288852 / 22545853 / -45.5% 🟢 26459246 / 34662676 / -23.7% 🟢 0.46 / 0.65 / -28.6%
tpch_q20/duckdb:vortex-file-compressed 15682369 / 16521635 / -5.1% 31009468 / 36326956 / -14.6% 🟢 0.51 / 0.45 / +11.2%
tpch_q21/duckdb:vortex-file-compressed 40079092 / 63861047 / -37.2% 🟢 58129630 / 79972531 / -27.3% 🟢 0.69 / 0.80 / -13.7%
tpch_q22/duckdb:vortex-file-compressed 18966737 / 14371990 / +32.0% 🔴 29069121 / 25209657 / +15.3% 🔴 0.65 / 0.57 / +14.4%
duckdb / parquet / ns (1.010x ➖, 4↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 54944941 / 63224629 / -13.1% 🟢 60276662 / 70073133 / -14.0% 🟢 0.91 / 0.90 / +1.0%
tpch_q02/duckdb:parquet 37189708 / 37648713 / -1.2% 44185013 / 45751872 / -3.4% 0.84 / 0.82 / +2.3%
tpch_q03/duckdb:parquet 70984302 / 67544047 / +5.1% 80253278 / 76634022 / +4.7% 0.88 / 0.88 / +0.4%
tpch_q04/duckdb:parquet 45331383 / 49216731 / -7.9% 53324248 / 55704154 / -4.3% 0.85 / 0.88 / -3.8%
tpch_q05/duckdb:parquet 70875014 / 66251180 / +7.0% 80015882 / 78029206 / +2.5% 0.89 / 0.85 / +4.3%
tpch_q06/duckdb:parquet 22720936 / 22193001 / +2.4% 27787939 / 27531194 / +0.9% 0.82 / 0.81 / +1.4%
tpch_q07/duckdb:parquet 66169128 / 65282541 / +1.4% 75893429 / 75710976 / +0.2% 0.87 / 0.86 / +1.1%
tpch_q08/duckdb:parquet 83440724 / 80271487 / +3.9% 92738856 / 93337958 / -0.6% 0.90 / 0.86 / +4.6%
tpch_q09/duckdb:parquet 114726192 / 122762609 / -6.5% 125512863 / 134920380 / -7.0% 0.91 / 0.91 / +0.5%
tpch_q10/duckdb:parquet 129871297 / 119653661 / +8.5% 139711559 / 130934392 / +6.7% 0.93 / 0.91 / +1.7%
tpch_q11/duckdb:parquet 24343083 / 21343031 / +14.1% 🔴 29807971 / 24851920 / +19.9% 🔴 0.82 / 0.86 / -4.9%
tpch_q12/duckdb:parquet 46792373 / 44456374 / +5.3% 53280051 / 51506225 / +3.4% 0.88 / 0.86 / +1.8%
tpch_q13/duckdb:parquet 263163845 / 241879632 / +8.8% 271533852 / 252606708 / +7.5% 0.97 / 0.96 / +1.2%
tpch_q14/duckdb:parquet 50289085 / 47362321 / +6.2% 59686815 / 55880289 / +6.8% 0.84 / 0.85 / -0.6%
tpch_q15/duckdb:parquet 30381867 / 29574277 / +2.7% 38810020 / 37213745 / +4.3% 0.78 / 0.79 / -1.5%
tpch_q16/duckdb:parquet 53138332 / 51170094 / +3.8% 59826557 / 58082771 / +3.0% 0.89 / 0.88 / +0.8%
tpch_q17/duckdb:parquet 59832635 / 49433175 / +21.0% 🔴 69311793 / 59221183 / +17.0% 🔴 0.86 / 0.83 / +3.4%
tpch_q18/duckdb:parquet 82826665 / 95653815 / -13.4% 🟢 89040811 / 106525284 / -16.4% 🟢 0.93 / 0.90 / +3.6%
tpch_q19/duckdb:parquet 54104871 / 65233239 / -17.1% 🟢 63523083 / 75254807 / -15.6% 🟢 0.85 / 0.87 / -1.7%
tpch_q20/duckdb:parquet 64698220 / 62150000 / +4.1% 74652820 / 73978270 / +0.9% 0.87 / 0.84 / +3.2%
tpch_q21/duckdb:parquet 107712830 / 142076336 / -24.2% 🟢 117784372 / 153154669 / -23.1% 🟢 0.91 / 0.93 / -1.4%
tpch_q22/duckdb:parquet 65019483 / 51584609 / +26.0% 🔴 72253244 / 59072861 / +22.3% 🔴 0.90 / 0.87 / +3.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR eb261dbc vs base c087cd96
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -10.7%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-20.4%, environment too noisy confidence)
Vortex (geomean): hot 0.989x ➖ · cold 1.013x ➖
Parquet (geomean): hot 1.108x ❌ · cold 0.982x ➖
Shifts: Parquet (control) +10.8% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1256785 / 1245516 / +0.9% 19213372 / 19314218 / -0.5% 0.07 / 0.06 / +1.4%
clickbench_q01/datafusion:vortex-file-compressed 6045045 / 5996822 / +0.8% 31089840 / 32454890 / -4.2% 0.19 / 0.18 / +5.2%
clickbench_q02/datafusion:vortex-file-compressed 10088782 / 10746818 / -6.1% 35212618 / 34470666 / +2.2% 0.29 / 0.31 / -8.1%
clickbench_q03/datafusion:vortex-file-compressed 11890121 / 11261116 / +5.6% 50542442 / 51263230 / -1.4% 0.24 / 0.22 / +7.1%
clickbench_q04/datafusion:vortex-file-compressed 56068940 / 56717320 / -1.1% 93110350 / 93253954 / -0.2% 0.60 / 0.61 / -1.0%
clickbench_q05/datafusion:vortex-file-compressed 72947378 / 74995123 / -2.7% 115614882 / 117079792 / -1.3% 0.63 / 0.64 / -1.5%
clickbench_q06/datafusion:vortex-file-compressed 1254768 / 1259333 / -0.4% 19683613 / 19950699 / -1.3% 0.06 / 0.06 / +1.0%
clickbench_q07/datafusion:vortex-file-compressed 8954705 / 9085550 / -1.4% 32365215 / 31044904 / +4.3% 0.28 / 0.29 / -5.5%
clickbench_q08/datafusion:vortex-file-compressed 75659188 / 77187550 / -2.0% 112804849 / 115057223 / -2.0% 0.67 / 0.67 / -0.0%
clickbench_q09/datafusion:vortex-file-compressed 173668550 / 166091696 / +4.6% 209438801 / 205127935 / +2.1% 0.83 / 0.81 / +2.4%
clickbench_q10/datafusion:vortex-file-compressed 23340281 / 23312856 / +0.1% 63606022 / 64529697 / -1.4% 0.37 / 0.36 / +1.6%
clickbench_q11/datafusion:vortex-file-compressed 25704082 / 26126546 / -1.6% 65849372 / 67693178 / -2.7% 0.39 / 0.39 / +1.1%
clickbench_q12/datafusion:vortex-file-compressed 72559924 / 71043184 / +2.1% 112979773 / 113678153 / -0.6% 0.64 / 0.62 / +2.8%
clickbench_q13/datafusion:vortex-file-compressed 116560711 / 119886702 / -2.8% 184406097 / 176486209 / +4.5% 0.63 / 0.68 / -6.9%
clickbench_q14/datafusion:vortex-file-compressed 75126151 / 73153770 / +2.7% 121962230 / 115191006 / +5.9% 0.62 / 0.64 / -3.0%
clickbench_q15/datafusion:vortex-file-compressed 59596812 / 60367282 / -1.3% 94910223 / 98587302 / -3.7% 0.63 / 0.61 / +2.5%
clickbench_q16/datafusion:vortex-file-compressed 149784626 / 152225047 / -1.6% 207983698 / 215876537 / -3.7% 0.72 / 0.71 / +2.1%
clickbench_q17/datafusion:vortex-file-compressed 151380783 / 149464680 / +1.3% 207681343 / 211088164 / -1.6% 0.73 / 0.71 / +2.9%
clickbench_q18/datafusion:vortex-file-compressed 296093572 / 297729674 / -0.5% 367840460 / 379697987 / -3.1% 0.80 / 0.78 / +2.7%
clickbench_q19/datafusion:vortex-file-compressed 7482324 / 7629622 / -1.9% 44246579 / 45143621 / -2.0% 0.17 / 0.17 / +0.1%
clickbench_q20/datafusion:vortex-file-compressed 62534292 / 61770000 / +1.2% 227090580 / 233519469 / -2.8% 0.28 / 0.26 / +4.1%
clickbench_q21/datafusion:vortex-file-compressed 87619086 / 88901931 / -1.4% 272274536 / 277056815 / -1.7% 0.32 / 0.32 / +0.3%
clickbench_q22/datafusion:vortex-file-compressed 98802384 / 97563813 / +1.3% 345834730 / 347805550 / -0.6% 0.29 / 0.28 / +1.8%
clickbench_q23/datafusion:vortex-file-compressed 185670725 / 183145820 / +1.4% 484958291 / 485949340 / -0.2% 0.38 / 0.38 / +1.6%
clickbench_q24/datafusion:vortex-file-compressed 16405394 / 15498468 / +5.9% 62934864 / 62388643 / +0.9% 0.26 / 0.25 / +4.9%
clickbench_q25/datafusion:vortex-file-compressed 18019890 / 17949871 / +0.4% 56532521 / 55069963 / +2.7% 0.32 / 0.33 / -2.2%
clickbench_q26/datafusion:vortex-file-compressed 16792040 / 15872759 / +5.8% 63526430 / 63784762 / -0.4% 0.26 / 0.25 / +6.2%
clickbench_q27/datafusion:vortex-file-compressed 98982910 / 97591236 / +1.4% 245260636 / 244816686 / +0.2% 0.40 / 0.40 / +1.2%
clickbench_q28/datafusion:vortex-file-compressed 558320200 / 565722388 / -1.3% 611001091 / 616360112 / -0.9% 0.91 / 0.92 / -0.4%
clickbench_q29/datafusion:vortex-file-compressed 23357920 / 23125606 / +1.0% 48096714 / 48025120 / +0.1% 0.49 / 0.48 / +0.9%
clickbench_q30/datafusion:vortex-file-compressed 59245096 / 55684864 / +6.4% 101069492 / 103245767 / -2.1% 0.59 / 0.54 / +8.7%
clickbench_q31/datafusion:vortex-file-compressed 68706456 / 70788908 / -2.9% 149741633 / 148277814 / +1.0% 0.46 / 0.48 / -3.9%
clickbench_q32/datafusion:vortex-file-compressed 310263412 / 305492663 / +1.6% 379340069 / 376248277 / +0.8% 0.82 / 0.81 / +0.7%
clickbench_q33/datafusion:vortex-file-compressed 331570976 / 331576664 / -0.0% 417978985 / 422720942 / -1.1% 0.79 / 0.78 / +1.1%
clickbench_q34/datafusion:vortex-file-compressed 330706063 / 323204856 / +2.3% 423781763 / 421109310 / +0.6% 0.78 / 0.77 / +1.7%
clickbench_q35/datafusion:vortex-file-compressed 54811032 / 55967650 / -2.1% 83339361 / 85090853 / -2.1% 0.66 / 0.66 / -0.0%
clickbench_q36/datafusion:vortex-file-compressed 37599460 / 37173158 / +1.1% 64175622 / 64074231 / +0.2% 0.59 / 0.58 / +1.0%
clickbench_q37/datafusion:vortex-file-compressed 21542667 / 21657818 / -0.5% 46564001 / 47358673 / -1.7% 0.46 / 0.46 / +1.2%
clickbench_q38/datafusion:vortex-file-compressed 11573400 / 11597638 / -0.2% 36813212 / 37981172 / -3.1% 0.31 / 0.31 / +3.0%
clickbench_q39/datafusion:vortex-file-compressed 77617034 / 77633174 / -0.0% 106846485 / 108267495 / -1.3% 0.73 / 0.72 / +1.3%
clickbench_q40/datafusion:vortex-file-compressed 11159454 / 11172612 / -0.1% 34998478 / 36090810 / -3.0% 0.32 / 0.31 / +3.0%
clickbench_q41/datafusion:vortex-file-compressed 10955294 / 10658810 / +2.8% 33826896 / 34546513 / -2.1% 0.32 / 0.31 / +5.0%
clickbench_q42/datafusion:vortex-file-compressed 10909590 / 11226494 / -2.8% 33519431 / 34538659 / -3.0% 0.33 / 0.33 / +0.1%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1277796 / 1278464 / -0.1% 48283471 / 48631046 / -0.7% 0.03 / 0.03 / +0.7%
clickbench_q01/datafusion:parquet 15754308 / 16107493 / -2.2% 68046180 / 72743222 / -6.5% 0.23 / 0.22 / +4.6%
clickbench_q02/datafusion:parquet 19017541 / 19012178 / +0.0% 85135862 / 81589064 / +4.3% 0.22 / 0.23 / -4.1%
clickbench_q03/datafusion:parquet 16931789 / 17826858 / -5.0% 80910542 / 78482053 / +3.1% 0.21 / 0.23 / -7.9%
clickbench_q04/datafusion:parquet 64168127 / 62957362 / +1.9% 124722986 / 124356282 / +0.3% 0.51 / 0.51 / +1.6%
clickbench_q05/datafusion:parquet 89067211 / 87928948 / +1.3% 157340032 / 157205507 / +0.1% 0.57 / 0.56 / +1.2%
clickbench_q06/datafusion:parquet 1279909 / 1289612 / -0.8% 47779749 / 47628436 / +0.3% 0.03 / 0.03 / -1.1%
clickbench_q07/datafusion:parquet 16985115 / 16822228 / +1.0% 68637381 / 68449775 / +0.3% 0.25 / 0.25 / +0.7%
clickbench_q08/datafusion:parquet 86065612 / 85604796 / +0.5% 162500833 / 159265640 / +2.0% 0.53 / 0.54 / -1.5%
clickbench_q09/datafusion:parquet 188190527 / 187153409 / +0.6% 266410701 / 260957737 / +2.1% 0.71 / 0.72 / -1.5%
clickbench_q10/datafusion:parquet 36426368 / 35797998 / +1.8% 96768851 / 99079556 / -2.3% 0.38 / 0.36 / +4.2%
clickbench_q11/datafusion:parquet 42278659 / 43696305 / -3.2% 106234807 / 108760842 / -2.3% 0.40 / 0.40 / -0.9%
clickbench_q12/datafusion:parquet 96346208 / 95928346 / +0.4% 160081224 / 159664378 / +0.3% 0.60 / 0.60 / +0.2%
clickbench_q13/datafusion:parquet 148309827 / 148714680 / -0.3% 224362048 / 224723260 / -0.2% 0.66 / 0.66 / -0.1%
clickbench_q14/datafusion:parquet 102211442 / 100411991 / +1.8% 172285494 / 170189873 / +1.2% 0.59 / 0.59 / +0.6%
clickbench_q15/datafusion:parquet 74187370 / 71317696 / +4.0% 131440594 / 129105970 / +1.8% 0.56 / 0.55 / +2.2%
clickbench_q16/datafusion:parquet 158943678 / 156507188 / +1.6% 238030064 / 232387280 / +2.4% 0.67 / 0.67 / -0.9%
clickbench_q17/datafusion:parquet 156736137 / 157638928 / -0.6% 238543721 / 235902163 / +1.1% 0.66 / 0.67 / -1.7%
clickbench_q18/datafusion:parquet 317547374 / 313362504 / +1.3% 425229038 / 417233405 / +1.9% 0.75 / 0.75 / -0.6%
clickbench_q19/datafusion:parquet 18633577 / 18931420 / -1.6% 74985763 / 75787944 / -1.1% 0.25 / 0.25 / -0.5%
clickbench_q20/datafusion:parquet 179922349 / 181561278 / -0.9% 275663924 / 278069897 / -0.9% 0.65 / 0.65 / -0.0%
clickbench_q21/datafusion:parquet 177664421 / 172923404 / +2.7% 293642842 / 292742182 / +0.3% 0.61 / 0.59 / +2.4%
clickbench_q22/datafusion:parquet 262947178 / 261681059 / +0.5% 411986163 / 414455895 / -0.6% 0.64 / 0.63 / +1.1%
clickbench_q23/datafusion:parquet 1185840770 / 1149449556 / +3.2% 1238271853 / 1229216940 / +0.7% 0.96 / 0.94 / +2.4%
clickbench_q24/datafusion:parquet 30035372 / 30298816 / -0.9% 87441980 / 86776434 / +0.8% 0.34 / 0.35 / -1.6%
clickbench_q25/datafusion:parquet 37439361 / 37370788 / +0.2% 101202449 / 100898612 / +0.3% 0.37 / 0.37 / -0.1%
clickbench_q26/datafusion:parquet 30656108 / 30778358 / -0.4% 87739263 / 87914645 / -0.2% 0.35 / 0.35 / -0.2%
clickbench_q27/datafusion:parquet 195312710 / 193252660 / +1.1% 283066380 / 291156554 / -2.8% 0.69 / 0.66 / +4.0%
clickbench_q28/datafusion:parquet 630808046 / 623290076 / +1.2% 697471488 / 696851247 / +0.1% 0.90 / 0.89 / +1.1%
clickbench_q29/datafusion:parquet 28965369 / 29011174 / -0.2% 92234815 / 91082002 / +1.3% 0.31 / 0.32 / -1.4%
clickbench_q30/datafusion:parquet 90645786 / 91008844 / -0.4% 168099520 / 167066875 / +0.6% 0.54 / 0.54 / -1.0%
clickbench_q31/datafusion:parquet 103559096 / 103505810 / +0.1% 190117460 / 191860008 / -0.9% 0.54 / 0.54 / +1.0%
clickbench_q32/datafusion:parquet 323257672 / 327673498 / -1.3% 429556813 / 426314540 / +0.8% 0.75 / 0.77 / -2.1%
clickbench_q33/datafusion:parquet 387472048 / 382755502 / +1.2% 473927963 / 475322885 / -0.3% 0.82 / 0.81 / +1.5%
clickbench_q34/datafusion:parquet 390388611 / 383553958 / +1.8% 474882940 / 488203052 / -2.7% 0.82 / 0.79 / +4.6%
clickbench_q35/datafusion:parquet 63418425 / 64807188 / -2.1% 126242389 / 123707808 / +2.0% 0.50 / 0.52 / -4.1%
clickbench_q36/datafusion:parquet 73220344 / 73763550 / -0.7% 134110543 / 134346548 / -0.2% 0.55 / 0.55 / -0.6%
clickbench_q37/datafusion:parquet 35379119 / 35557970 / -0.5% 91025742 / 91140925 / -0.1% 0.39 / 0.39 / -0.4%
clickbench_q38/datafusion:parquet 47575294 / 47620906 / -0.1% 106562195 / 105888750 / +0.6% 0.45 / 0.45 / -0.7%
clickbench_q39/datafusion:parquet 144084586 / 143846526 / +0.2% 206629587 / 207424112 / -0.4% 0.70 / 0.69 / +0.6%
clickbench_q40/datafusion:parquet 20270995 / 19994152 / +1.4% 76414410 / 76720448 / -0.4% 0.27 / 0.26 / +1.8%
clickbench_q41/datafusion:parquet 18628619 / 19086084 / -2.4% 75432526 / 76520369 / -1.4% 0.25 / 0.25 / -1.0%
clickbench_q42/datafusion:parquet 19561424 / 19280686 / +1.5% 75020153 / 74211741 / +1.1% 0.26 / 0.26 / +0.4%
duckdb / vortex-file-compressed / ns (0.974x ➖, 12↑ 7↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2422220 / 1519984 / +59.4% 🔴 25944504 / 18248723 / +42.2% 🔴 0.09 / 0.08 / +12.1%
clickbench_q01/duckdb:vortex-file-compressed 7547358 / 6343170 / +19.0% 🔴 32760341 / 21836234 / +50.0% 🔴 0.23 / 0.29 / -20.7%
clickbench_q02/duckdb:vortex-file-compressed 8341495 / 7957271 / +4.8% 37026568 / 29408394 / +25.9% 🔴 0.23 / 0.27 / -16.7%
clickbench_q03/duckdb:vortex-file-compressed 16741596 / 16365072 / +2.3% 54887177 / 46743464 / +17.4% 🔴 0.31 / 0.35 / -12.9%
clickbench_q04/duckdb:vortex-file-compressed 59980972 / 67420478 / -11.0% 🟢 98388068 / 101927588 / -3.5% 0.61 / 0.66 / -7.8%
clickbench_q05/duckdb:vortex-file-compressed 67277370 / 67643051 / -0.5% 95596655 / 92716294 / +3.1% 0.70 / 0.73 / -3.5%
clickbench_q06/duckdb:vortex-file-compressed 2768554 / 1798137 / +54.0% 🔴 32764673 / 28928712 / +13.3% 🔴 0.08 / 0.06 / +35.9%
clickbench_q07/duckdb:vortex-file-compressed 8927024 / 7823970 / +14.1% 🔴 29656694 / 27646160 / +7.3% 0.30 / 0.28 / +6.4%
clickbench_q08/duckdb:vortex-file-compressed 70940573 / 82564578 / -14.1% 🟢 109167293 / 120099320 / -9.1% 0.65 / 0.69 / -5.5%
clickbench_q09/duckdb:vortex-file-compressed 91044957 / 107850129 / -15.6% 🟢 130877237 / 149031997 / -12.2% 🟢 0.70 / 0.72 / -3.9%
clickbench_q10/duckdb:vortex-file-compressed 27769258 / 29239498 / -5.0% 65923346 / 64341427 / +2.5% 0.42 / 0.45 / -7.3%
clickbench_q11/duckdb:vortex-file-compressed 30846590 / 32548690 / -5.2% 68590767 / 67256522 / +2.0% 0.45 / 0.48 / -7.1%
clickbench_q12/duckdb:vortex-file-compressed 73580075 / 73787365 / -0.3% 101496672 / 106055837 / -4.3% 0.72 / 0.70 / +4.2%
clickbench_q13/duckdb:vortex-file-compressed 133556174 / 132042384 / +1.1% 164440970 / 165134634 / -0.4% 0.81 / 0.80 / +1.6%
clickbench_q14/duckdb:vortex-file-compressed 76632890 / 76295306 / +0.4% 103825075 / 107989629 / -3.9% 0.74 / 0.71 / +4.5%
clickbench_q15/duckdb:vortex-file-compressed 77649642 / 93607346 / -17.0% 🟢 113521492 / 124835291 / -9.1% 0.68 / 0.75 / -8.8%
clickbench_q16/duckdb:vortex-file-compressed 144273452 / 160707571 / -10.2% 🟢 184132678 / 218372980 / -15.7% 🟢 0.78 / 0.74 / +6.5%
clickbench_q17/duckdb:vortex-file-compressed 147422384 / 159718358 / -7.7% 180046301 / 206072689 / -12.6% 🟢 0.82 / 0.78 / +5.6%
clickbench_q18/duckdb:vortex-file-compressed 266420346 / 309281069 / -13.9% 🟢 325135370 / 372889430 / -12.8% 🟢 0.82 / 0.83 / -1.2%
clickbench_q19/duckdb:vortex-file-compressed 9491362 / 10071170 / -5.8% 42244999 / 37402354 / +12.9% 🔴 0.22 / 0.27 / -16.6%
clickbench_q20/duckdb:vortex-file-compressed 65028212 / 71643730 / -9.2% 169050505 / 162639828 / +3.9% 0.38 / 0.44 / -12.7%
clickbench_q21/duckdb:vortex-file-compressed 98293778 / 106959803 / -8.1% 265758516 / 265080226 / +0.3% 0.37 / 0.40 / -8.3%
clickbench_q22/duckdb:vortex-file-compressed 180700960 / 189909857 / -4.8% 399961937 / 406831555 / -1.7% 0.45 / 0.47 / -3.2%
clickbench_q23/duckdb:vortex-file-compressed 35982932 / 41580019 / -13.5% 🟢 88013214 / 99134689 / -11.2% 🟢 0.41 / 0.42 / -2.5%
clickbench_q24/duckdb:vortex-file-compressed 14874244 / 14648254 / +1.5% 38808955 / 35585709 / +9.1% 0.38 / 0.41 / -6.9%
clickbench_q25/duckdb:vortex-file-compressed 18564662 / 18577672 / -0.1% 49005328 / 41732623 / +17.4% 🔴 0.38 / 0.45 / -14.9%
clickbench_q26/duckdb:vortex-file-compressed 11657496 / 11710410 / -0.5% 37651497 / 32476606 / +15.9% 🔴 0.31 / 0.36 / -14.1%
clickbench_q27/duckdb:vortex-file-compressed 56457738 / 71772918 / -21.3% 🟢 218287683 / 218401705 / -0.1% 0.26 / 0.33 / -21.3%
clickbench_q28/duckdb:vortex-file-compressed 455915719 / 571355830 / -20.2% 🟢 518560303 / 664494719 / -22.0% 🟢 0.88 / 0.86 / +2.3%
clickbench_q29/duckdb:vortex-file-compressed 18734945 / 15380535 / +21.8% 🔴 46891987 / 35887651 / +30.7% 🔴 0.40 / 0.43 / -6.8%
clickbench_q30/duckdb:vortex-file-compressed 61246118 / 62410298 / -1.9% 106629122 / 102735875 / +3.8% 0.57 / 0.61 / -5.4%
clickbench_q31/duckdb:vortex-file-compressed 114309498 / 119924680 / -4.7% 168772569 / 191136079 / -11.7% 🟢 0.68 / 0.63 / +7.9%
clickbench_q32/duckdb:vortex-file-compressed 377458918 / 437634942 / -13.8% 🟢 407933523 / 526992197 / -22.6% 🟢 0.93 / 0.83 / +11.4%
clickbench_q33/duckdb:vortex-file-compressed 362775456 / 378805012 / -4.2% 440010491 / 482690019 / -8.8% 0.82 / 0.78 / +5.1%
clickbench_q34/duckdb:vortex-file-compressed 374788796 / 398658498 / -6.0% 458041983 / 506602910 / -9.6% 0.82 / 0.79 / +4.0%
clickbench_q35/duckdb:vortex-file-compressed 59251175 / 100254228 / -40.9% 🟢 92800447 / 132683801 / -30.1% 🟢 0.64 / 0.76 / -15.5%
clickbench_q36/duckdb:vortex-file-compressed 12542298 / 12309485 / +1.9% 34243347 / 30640630 / +11.8% 🔴 0.37 / 0.40 / -8.8%
clickbench_q37/duckdb:vortex-file-compressed 8711182 / 8884004 / -1.9% 32418912 / 27210573 / +19.1% 🔴 0.27 / 0.33 / -17.7%
clickbench_q38/duckdb:vortex-file-compressed 9321544 / 9032463 / +3.2% 30224248 / 28154211 / +7.4% 0.31 / 0.32 / -3.9%
clickbench_q39/duckdb:vortex-file-compressed 20826448 / 20573659 / +1.2% 40700357 / 35986336 / +13.1% 🔴 0.51 / 0.57 / -10.5%
clickbench_q40/duckdb:vortex-file-compressed 7814286 / 6510307 / +20.0% 🔴 30740872 / 23895153 / +28.6% 🔴 0.25 / 0.27 / -6.7%
clickbench_q41/duckdb:vortex-file-compressed 8289440 / 7105526 / +16.7% 🔴 32980569 / 23320137 / +41.4% 🔴 0.25 / 0.30 / -17.5%
clickbench_q42/duckdb:vortex-file-compressed 7640763 / 9034000 / -15.4% 🟢 31665554 / 23733905 / +33.4% 🔴 0.24 / 0.38 / -36.6%
duckdb / parquet / ns (1.225x ❌, 4↑ 30↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 12749480 / 9561500 / +33.3% 🔴 19670083 / 19648048 / +0.1% 0.65 / 0.49 / +33.2%
clickbench_q01/duckdb:parquet 19208268 / 10129068 / +89.6% 🔴 25390000 / 20003994 / +26.9% 🔴 0.76 / 0.51 / +49.4%
clickbench_q02/duckdb:parquet 27538933 / 14905876 / +84.8% 🔴 38613709 / 29894960 / +29.2% 🔴 0.71 / 0.50 / +43.0%
clickbench_q03/duckdb:parquet 27176612 / 16334134 / +66.4% 🔴 42069361 / 53042171 / -20.7% 🟢 0.65 / 0.31 / +109.8%
clickbench_q04/duckdb:parquet 67267314 / 71773976 / -6.3% 84429081 / 88717930 / -4.8% 0.80 / 0.81 / -1.5%
clickbench_q05/duckdb:parquet 92478005 / 82407009 / +12.2% 🔴 108070633 / 116162165 / -7.0% 0.86 / 0.71 / +20.6%
clickbench_q06/duckdb:parquet 25153578 / 15705651 / +60.2% 🔴 35680603 / 22892587 / +55.9% 🔴 0.70 / 0.69 / +2.8%
clickbench_q07/duckdb:parquet 21159706 / 10896386 / +94.2% 🔴 29318929 / 23961745 / +22.4% 🔴 0.72 / 0.45 / +58.7%
clickbench_q08/duckdb:parquet 80314962 / 91678496 / -12.4% 🟢 93212783 / 127499835 / -26.9% 🟢 0.86 / 0.72 / +19.8%
clickbench_q09/duckdb:parquet 106398652 / 118224473 / -10.0% 🟢 123433328 / 165217287 / -25.3% 🟢 0.86 / 0.72 / +20.5%
clickbench_q10/duckdb:parquet 46355704 / 33259504 / +39.4% 🔴 61649861 / 68098772 / -9.5% 0.75 / 0.49 / +54.0%
clickbench_q11/duckdb:parquet 51472002 / 35882006 / +43.4% 🔴 69865037 / 76706960 / -8.9% 0.74 / 0.47 / +57.5%
clickbench_q12/duckdb:parquet 102689635 / 89005656 / +15.4% 🔴 117683278 / 126290490 / -6.8% 0.87 / 0.70 / +23.8%
clickbench_q13/duckdb:parquet 160616690 / 144075812 / +11.5% 🔴 179893265 / 202122141 / -11.0% 🟢 0.89 / 0.71 / +25.3%
clickbench_q14/duckdb:parquet 110334174 / 100974130 / +9.3% 130213575 / 137239280 / -5.1% 0.85 / 0.74 / +15.2%
clickbench_q15/duckdb:parquet 93850346 / 91701615 / +2.3% 107812055 / 116541943 / -7.5% 0.87 / 0.79 / +10.6%
clickbench_q16/duckdb:parquet 197460929 / 173897125 / +13.6% 🔴 198367724 / 225941286 / -12.2% 🟢 1.00 / 0.77 / +29.3%
clickbench_q17/duckdb:parquet 181104832 / 179057840 / +1.1% 201353430 / 232124666 / -13.3% 🟢 0.90 / 0.77 / +16.6%
clickbench_q18/duckdb:parquet 319120894 / 326385696 / -2.2% 348891215 / 406763103 / -14.2% 🟢 0.91 / 0.80 / +14.0%
clickbench_q19/duckdb:parquet 24142298 / 13514142 / +78.6% 🔴 31333554 / 39882515 / -21.4% 🟢 0.77 / 0.34 / +127.4%
clickbench_q20/duckdb:parquet 197784106 / 145113083 / +36.3% 🔴 249209946 / 245207712 / +1.6% 0.79 / 0.59 / +34.1%
clickbench_q21/duckdb:parquet 237112084 / 180725862 / +31.2% 🔴 282494453 / 330748511 / -14.6% 🟢 0.84 / 0.55 / +53.6%
clickbench_q22/duckdb:parquet 343401444 / 244382816 / +40.5% 🔴 373506458 / 408348675 / -8.5% 0.92 / 0.60 / +53.6%
clickbench_q23/duckdb:parquet 185346024 / 148524816 / +24.8% 🔴 247621697 / 167143142 / +48.1% 🔴 0.75 / 0.89 / -15.8%
clickbench_q24/duckdb:parquet 36745575 / 42554508 / -13.7% 🟢 43684719 / 60906206 / -28.3% 🟢 0.84 / 0.70 / +20.4%
clickbench_q25/duckdb:parquet 46619086 / 40811007 / +14.2% 🔴 62934810 / 89198194 / -29.4% 🟢 0.74 / 0.46 / +61.9%
clickbench_q26/duckdb:parquet 36563975 / 31271447 / +16.9% 🔴 50892753 / 47164793 / +7.9% 0.72 / 0.66 / +8.4%
clickbench_q27/duckdb:parquet 208345300 / 150915904 / +38.1% 🔴 242048814 / 260569804 / -7.1% 0.86 / 0.58 / +48.6%
clickbench_q28/duckdb:parquet 848094114 / 905591192 / -6.3% 842731033 / 997182450 / -15.5% 🟢 1.01 / 0.91 / +10.8%
clickbench_q29/duckdb:parquet 31120642 / 17823975 / +74.6% 🔴 41108975 / 29503732 / +39.3% 🔴 0.76 / 0.60 / +25.3%
clickbench_q30/duckdb:parquet 112800234 / 91817886 / +22.9% 🔴 139197908 / 173028355 / -19.6% 🟢 0.81 / 0.53 / +52.7%
clickbench_q31/duckdb:parquet 169469019 / 143823164 / +17.8% 🔴 188627482 / 288206469 / -34.6% 🟢 0.90 / 0.50 / +80.0%
clickbench_q32/duckdb:parquet 412534108 / 437460798 / -5.7% 427937490 / 486238173 / -12.0% 🟢 0.96 / 0.90 / +7.1%
clickbench_q33/duckdb:parquet 486000230 / 442884663 / +9.7% 489494664 / 476358431 / +2.8% 0.99 / 0.93 / +6.8%
clickbench_q34/duckdb:parquet 493647855 / 455925238 / +8.3% 497339358 / 498957532 / -0.3% 0.99 / 0.91 / +8.6%
clickbench_q35/duckdb:parquet 67634243 / 105910334 / -36.1% 🟢 83606922 / 119314547 / -29.9% 🟢 0.81 / 0.89 / -8.9%
clickbench_q36/duckdb:parquet 37868768 / 30544423 / +24.0% 🔴 45274685 / 41288140 / +9.7% 0.84 / 0.74 / +13.1%
clickbench_q37/duckdb:parquet 28957052 / 22515616 / +28.6% 🔴 37067244 / 32273162 / +14.9% 🔴 0.78 / 0.70 / +12.0%
clickbench_q38/duckdb:parquet 30708035 / 23736065 / +29.4% 🔴 39808405 / 34580582 / +15.1% 🔴 0.77 / 0.69 / +12.4%
clickbench_q39/duckdb:parquet 62946580 / 56197925 / +12.0% 🔴 72883851 / 66733892 / +9.2% 0.86 / 0.84 / +2.6%
clickbench_q40/duckdb:parquet 18209889 / 12659414 / +43.8% 🔴 26521561 / 21840824 / +21.4% 🔴 0.69 / 0.58 / +18.5%
clickbench_q41/duckdb:parquet 19351725 / 13019580 / +48.6% 🔴 25325045 / 23099234 / +9.6% 0.76 / 0.56 / +35.6%
clickbench_q42/duckdb:parquet 18494032 / 14598044 / +26.7% 🔴 27239191 / 25480802 / +6.9% 0.68 / 0.57 / +18.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR eb261dbc vs base c1a2ca12
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.2%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-13.8%, environment too noisy confidence)
Vortex (geomean): hot 1.043x ➖ · cold 1.022x ➖
Parquet (geomean): hot 1.124x ❌ · cold 1.086x ➖
Shifts: Parquet (control) +12.4% · Median polish +4.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24155474 / 24001624 / +0.6% 42403082 / 42589530 / -0.4% 0.57 / 0.56 / +1.1%
tpcds_q02/datafusion:vortex-file-compressed 45339540 / 45124687 / +0.5% 60794779 / 59985888 / +1.3% 0.75 / 0.75 / -0.9%
tpcds_q03/datafusion:vortex-file-compressed 11580574 / 11760724 / -1.5% 28587660 / 29307750 / -2.5% 0.41 / 0.40 / +0.9%
tpcds_q04/datafusion:vortex-file-compressed 113028304 / 113937806 / -0.8% 142079558 / 139357640 / +2.0% 0.80 / 0.82 / -2.7%
tpcds_q05/datafusion:vortex-file-compressed 60619941 / 60344149 / +0.5% 83983787 / 82225351 / +2.1% 0.72 / 0.73 / -1.6%
tpcds_q06/datafusion:vortex-file-compressed 23551603 / 23286222 / +1.1% 45011440 / 47513644 / -5.3% 0.52 / 0.49 / +6.8%
tpcds_q07/datafusion:vortex-file-compressed 33262374 / 32559908 / +2.2% 54887887 / 56112584 / -2.2% 0.61 / 0.58 / +4.4%
tpcds_q08/datafusion:vortex-file-compressed 25302864 / 25004018 / +1.2% 44179064 / 45582468 / -3.1% 0.57 / 0.55 / +4.4%
tpcds_q09/datafusion:vortex-file-compressed 17995869 / 17077307 / +5.4% 34538891 / 36585408 / -5.6% 0.52 / 0.47 / +11.6%
tpcds_q10/datafusion:vortex-file-compressed 27425342 / 28151892 / -2.6% 48801032 / 49910168 / -2.2% 0.56 / 0.56 / -0.4%
tpcds_q11/datafusion:vortex-file-compressed 62267202 / 62826738 / -0.9% 89495676 / 91325235 / -2.0% 0.70 / 0.69 / +1.1%
tpcds_q12/datafusion:vortex-file-compressed 16331264 / 16203124 / +0.8% 31441537 / 32343006 / -2.8% 0.52 / 0.50 / +3.7%
tpcds_q13/datafusion:vortex-file-compressed 34130600 / 34960012 / -2.4% 52870559 / 57456216 / -8.0% 0.65 / 0.61 / +6.1%
tpcds_q14/datafusion:vortex-file-compressed 91443108 / 91692720 / -0.3% 119322449 / 120726527 / -1.2% 0.77 / 0.76 / +0.9%
tpcds_q15/datafusion:vortex-file-compressed 23944967 / 23782747 / +0.7% 43786853 / 44105872 / -0.7% 0.55 / 0.54 / +1.4%
tpcds_q16/datafusion:vortex-file-compressed 19981241 / 20272056 / -1.4% 39809027 / 41886719 / -5.0% 0.50 / 0.48 / +3.7%
tpcds_q17/datafusion:vortex-file-compressed 57780505 / 60289272 / -4.2% 74599940 / 84178651 / -11.4% 🟢 0.77 / 0.72 / +8.1%
tpcds_q18/datafusion:vortex-file-compressed 68959512 / 68862444 / +0.1% 93249735 / 94768033 / -1.6% 0.74 / 0.73 / +1.8%
tpcds_q19/datafusion:vortex-file-compressed 17732867 / 18654902 / -4.9% 39312677 / 41130568 / -4.4% 0.45 / 0.45 / -0.5%
tpcds_q20/datafusion:vortex-file-compressed 17557296 / 17836778 / -1.6% 34421269 / 35167644 / -2.1% 0.51 / 0.51 / +0.6%
tpcds_q21/datafusion:vortex-file-compressed 16382926 / 17131512 / -4.4% 41352156 / 38181426 / +8.3% 0.40 / 0.45 / -11.7%
tpcds_q22/datafusion:vortex-file-compressed 50018072 / 50470187 / -0.9% 69852691 / 74024395 / -5.6% 0.72 / 0.68 / +5.0%
tpcds_q23/datafusion:vortex-file-compressed 74037730 / 74545940 / -0.7% 101299866 / 99075716 / +2.2% 0.73 / 0.75 / -2.9%
tpcds_q24/datafusion:vortex-file-compressed 69973438 / 70081736 / -0.2% 94121653 / 95520064 / -1.5% 0.74 / 0.73 / +1.3%
tpcds_q25/datafusion:vortex-file-compressed 51378480 / 48168456 / +6.7% 79906834 / 82961805 / -3.7% 0.64 / 0.58 / +10.7%
tpcds_q26/datafusion:vortex-file-compressed 30051881 / 29766708 / +1.0% 49672255 / 50170422 / -1.0% 0.61 / 0.59 / +2.0%
tpcds_q27/datafusion:vortex-file-compressed 65199467 / 61376867 / +6.2% 83174469 / 93059101 / -10.6% 🟢 0.78 / 0.66 / +18.9%
tpcds_q28/datafusion:vortex-file-compressed 18570619 / 18072090 / +2.8% 38223045 / 38825827 / -1.6% 0.49 / 0.47 / +4.4%
tpcds_q29/datafusion:vortex-file-compressed 60614374 / 60274795 / +0.6% 75794436 / 84222603 / -10.0% 🟢 0.80 / 0.72 / +11.7%
tpcds_q30/datafusion:vortex-file-compressed 27657942 / 27437323 / +0.8% 44379411 / 45890353 / -3.3% 0.62 / 0.60 / +4.2%
tpcds_q31/datafusion:vortex-file-compressed 62656160 / 63120642 / -0.7% 91692097 / 91829431 / -0.1% 0.68 / 0.69 / -0.6%
tpcds_q32/datafusion:vortex-file-compressed 13740072 / 13603027 / +1.0% 30206883 / 30636732 / -1.4% 0.45 / 0.44 / +2.4%
tpcds_q33/datafusion:vortex-file-compressed 26951295 / 27105985 / -0.6% 47114218 / 49452393 / -4.7% 0.57 / 0.55 / +4.4%
tpcds_q34/datafusion:vortex-file-compressed 18698880 / 18715738 / -0.1% 36456808 / 36139341 / +0.9% 0.51 / 0.52 / -1.0%
tpcds_q35/datafusion:vortex-file-compressed 35596934 / 34938828 / +1.9% 56054666 / 56638425 / -1.0% 0.64 / 0.62 / +2.9%
tpcds_q36/datafusion:vortex-file-compressed 47548397 / 47892442 / -0.7% 72327398 / 75649369 / -4.4% 0.66 / 0.63 / +3.8%
tpcds_q37/datafusion:vortex-file-compressed 13437064 / 14071792 / -4.5% 35306001 / 34646812 / +1.9% 0.38 / 0.41 / -6.3%
tpcds_q38/datafusion:vortex-file-compressed 29276160 / 29188140 / +0.3% 52067337 / 52653319 / -1.1% 0.56 / 0.55 / +1.4%
tpcds_q39/datafusion:vortex-file-compressed 65706049 / 66142030 / -0.7% 89806955 / 92917081 / -3.3% 0.73 / 0.71 / +2.8%
tpcds_q40/datafusion:vortex-file-compressed 25127172 / 25478028 / -1.4% 45642451 / 46872931 / -2.6% 0.55 / 0.54 / +1.3%
tpcds_q41/datafusion:vortex-file-compressed 17378922 / 17362529 / +0.1% 30982000 / 31356459 / -1.2% 0.56 / 0.55 / +1.3%
tpcds_q42/datafusion:vortex-file-compressed 11319175 / 11243278 / +0.7% 26976799 / 27367548 / -1.4% 0.42 / 0.41 / +2.1%
tpcds_q43/datafusion:vortex-file-compressed 13101466 / 13013470 / +0.7% 31600507 / 32128779 / -1.6% 0.41 / 0.41 / +2.4%
tpcds_q44/datafusion:vortex-file-compressed 26258204 / 26603459 / -1.3% 49480980 / 50083803 / -1.2% 0.53 / 0.53 / -0.1%
tpcds_q45/datafusion:vortex-file-compressed 27753502 / 27415802 / +1.2% 45821296 / 47395920 / -3.3% 0.61 / 0.58 / +4.7%
tpcds_q46/datafusion:vortex-file-compressed 23763523 / 24037456 / -1.1% 46367392 / 48060037 / -3.5% 0.51 / 0.50 / +2.5%
tpcds_q47/datafusion:vortex-file-compressed 78279808 / 78894564 / -0.8% 105192665 / 108398487 / -3.0% 0.74 / 0.73 / +2.2%
tpcds_q48/datafusion:vortex-file-compressed 31452793 / 31405506 / +0.2% 51616502 / 52552060 / -1.8% 0.61 / 0.60 / +2.0%
tpcds_q49/datafusion:vortex-file-compressed 60891078 / 60025038 / +1.4% 92667689 / 83138419 / +11.5% 🔴 0.66 / 0.72 / -9.0%
tpcds_q50/datafusion:vortex-file-compressed 34605310 / 33957560 / +1.9% 55559784 / 55001432 / +1.0% 0.62 / 0.62 / +0.9%
tpcds_q51/datafusion:vortex-file-compressed 61056796 / 60813656 / +0.4% 83476693 / 85879539 / -2.8% 0.73 / 0.71 / +3.3%
tpcds_q52/datafusion:vortex-file-compressed 11801438 / 11721534 / +0.7% 27980133 / 27709860 / +1.0% 0.42 / 0.42 / -0.3%
tpcds_q53/datafusion:vortex-file-compressed 18712820 / 18589537 / +0.7% 37266913 / 38004067 / -1.9% 0.50 / 0.49 / +2.7%
tpcds_q54/datafusion:vortex-file-compressed 33770390 / 34582200 / -2.3% 59460944 / 58776877 / +1.2% 0.57 / 0.59 / -3.5%
tpcds_q55/datafusion:vortex-file-compressed 11369484 / 11422946 / -0.5% 26498086 / 27563625 / -3.9% 0.43 / 0.41 / +3.5%
tpcds_q56/datafusion:vortex-file-compressed 27057559 / 26568222 / +1.8% 46957454 / 49507726 / -5.2% 0.58 / 0.54 / +7.4%
tpcds_q57/datafusion:vortex-file-compressed 73285628 / 72852550 / +0.6% 98225810 / 97879471 / +0.4% 0.75 / 0.74 / +0.2%
tpcds_q58/datafusion:vortex-file-compressed 39693706 / 40278222 / -1.5% 65547449 / 68076784 / -3.7% 0.61 / 0.59 / +2.4%
tpcds_q59/datafusion:vortex-file-compressed 31940991 / 31177142 / +2.5% 52290218 / 53400190 / -2.1% 0.61 / 0.58 / +4.6%
tpcds_q60/datafusion:vortex-file-compressed 26669880 / 27324994 / -2.4% 47881355 / 49052454 / -2.4% 0.56 / 0.56 / -0.0%
tpcds_q61/datafusion:vortex-file-compressed 23782408 / 24201045 / -1.7% 46491631 / 46761923 / -0.6% 0.51 / 0.52 / -1.2%
tpcds_q62/datafusion:vortex-file-compressed 17094680 / 17194728 / -0.6% 34648079 / 35910927 / -3.5% 0.49 / 0.48 / +3.0%
tpcds_q63/datafusion:vortex-file-compressed 18636738 / 18615606 / +0.1% 37981874 / 37560272 / +1.1% 0.49 / 0.50 / -1.0%
tpcds_q64/datafusion:vortex-file-compressed 324534726 / 322533948 / +0.6% 356964319 / 356424385 / +0.2% 0.91 / 0.90 / +0.5%
tpcds_q65/datafusion:vortex-file-compressed 74791710 / 75816197 / -1.4% 95129913 / 96632197 / -1.6% 0.79 / 0.78 / +0.2%
tpcds_q66/datafusion:vortex-file-compressed 52847719 / 53187072 / -0.6% 74025073 / 75374570 / -1.8% 0.71 / 0.71 / +1.2%
tpcds_q67/datafusion:vortex-file-compressed 57570999 / 55642427 / +3.5% 86046508 / 83902771 / +2.6% 0.67 / 0.66 / +0.9%
tpcds_q68/datafusion:vortex-file-compressed 23568256 / 23791084 / -0.9% 46663042 / 49029022 / -4.8% 0.51 / 0.49 / +4.1%
tpcds_q69/datafusion:vortex-file-compressed 27687351 / 27368726 / +1.2% 47342983 / 50105529 / -5.5% 0.58 / 0.55 / +7.1%
tpcds_q70/datafusion:vortex-file-compressed 24110812 / 24055827 / +0.2% 46920520 / 48364803 / -3.0% 0.51 / 0.50 / +3.3%
tpcds_q71/datafusion:vortex-file-compressed 19029291 / 19374226 / -1.8% 40757791 / 39448916 / +3.3% 0.47 / 0.49 / -4.9%
tpcds_q72/datafusion:vortex-file-compressed 461484597 / 477520788 / -3.4% 504953341 / 472756501 / +6.8% 0.91 / 1.01 / -9.5%
tpcds_q73/datafusion:vortex-file-compressed 17098944 / 17543746 / -2.5% 36051197 / 35897835 / +0.4% 0.47 / 0.49 / -3.0%
tpcds_q74/datafusion:vortex-file-compressed 44651288 / 44541978 / +0.2% 71202770 / 70780233 / +0.6% 0.63 / 0.63 / -0.3%
tpcds_q75/datafusion:vortex-file-compressed 132825917 / 131219476 / +1.2% 153833327 / 160067328 / -3.9% 0.86 / 0.82 / +5.3%
tpcds_q76/datafusion:vortex-file-compressed 42831170 / 44137867 / -3.0% 62379692 / 66072334 / -5.6% 0.69 / 0.67 / +2.8%
tpcds_q77/datafusion:vortex-file-compressed 34775412 / 34505826 / +0.8% 60958027 / 59769999 / +2.0% 0.57 / 0.58 / -1.2%
tpcds_q78/datafusion:vortex-file-compressed 79999555 / 79624894 / +0.5% 106730505 / 109612286 / -2.6% 0.75 / 0.73 / +3.2%
tpcds_q79/datafusion:vortex-file-compressed 20950037 / 20500220 / +2.2% 40488797 / 42045355 / -3.7% 0.52 / 0.49 / +6.1%
tpcds_q80/datafusion:vortex-file-compressed 77544300 / 78061735 / -0.7% 110741974 / 106836590 / +3.7% 0.70 / 0.73 / -4.2%
tpcds_q81/datafusion:vortex-file-compressed 28143824 / 28345414 / -0.7% 44320230 / 44660905 / -0.8% 0.64 / 0.63 / +0.1%
tpcds_q82/datafusion:vortex-file-compressed 14027584 / 13310275 / +5.4% 34855063 / 35551890 / -2.0% 0.40 / 0.37 / +7.5%
tpcds_q83/datafusion:vortex-file-compressed 35794956 / 35633114 / +0.5% 57759466 / 57803983 / -0.1% 0.62 / 0.62 / +0.5%
tpcds_q84/datafusion:vortex-file-compressed 12166186 / 12062483 / +0.9% 28955380 / 27772975 / +4.3% 0.42 / 0.43 / -3.3%
tpcds_q85/datafusion:vortex-file-compressed 59326985 / 59979043 / -1.1% 85146345 / 83640744 / +1.8% 0.70 / 0.72 / -2.8%
tpcds_q86/datafusion:vortex-file-compressed 16680187 / 16720255 / -0.2% 32231583 / 32390438 / -0.5% 0.52 / 0.52 / +0.3%
tpcds_q87/datafusion:vortex-file-compressed 29173198 / 28923897 / +0.9% 51228630 / 52797832 / -3.0% 0.57 / 0.55 / +4.0%
tpcds_q88/datafusion:vortex-file-compressed 34714816 / 34091012 / +1.8% 61900530 / 56966724 / +8.7% 0.56 / 0.60 / -6.3%
tpcds_q89/datafusion:vortex-file-compressed 21174013 / 20794972 / +1.8% 40293941 / 40659681 / -0.9% 0.53 / 0.51 / +2.7%
tpcds_q90/datafusion:vortex-file-compressed 10056914 / 10246020 / -1.8% 24884750 / 25023737 / -0.6% 0.40 / 0.41 / -1.3%
tpcds_q91/datafusion:vortex-file-compressed 16768693 / 16066058 / +4.4% 34925276 / 36219612 / -3.6% 0.48 / 0.44 / +8.2%
tpcds_q92/datafusion:vortex-file-compressed 13975315 / 13684524 / +2.1% 29786997 / 31145092 / -4.4% 0.47 / 0.44 / +6.8%
tpcds_q93/datafusion:vortex-file-compressed 24354796 / 23430804 / +3.9% 45212704 / 45843312 / -1.4% 0.54 / 0.51 / +5.4%
tpcds_q94/datafusion:vortex-file-compressed 19353904 / 18965716 / +2.0% 38860192 / 40384899 / -3.8% 0.50 / 0.47 / +6.1%
tpcds_q95/datafusion:vortex-file-compressed 45767932 / 45818246 / -0.1% 67755606 / 68735085 / -1.4% 0.68 / 0.67 / +1.3%
tpcds_q96/datafusion:vortex-file-compressed 9033363 / 8968229 / +0.7% 23165931 / 25262330 / -8.3% 0.39 / 0.36 / +9.8%
tpcds_q97/datafusion:vortex-file-compressed 20737228 / 21100116 / -1.7% 42749875 / 43978890 / -2.8% 0.49 / 0.48 / +1.1%
tpcds_q98/datafusion:vortex-file-compressed 16932116 / 16614317 / +1.9% 35773239 / 36127689 / -1.0% 0.47 / 0.46 / +2.9%
tpcds_q99/datafusion:vortex-file-compressed 19451631 / 19259684 / +1.0% 37329570 / 38456764 / -2.9% 0.52 / 0.50 / +4.0%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 31668998 / 31543051 / +0.4% 50027820 / 49896673 / +0.3% 0.63 / 0.63 / +0.1%
tpcds_q02/datafusion:parquet 40036138 / 39599070 / +1.1% 56399546 / 58492734 / -3.6% 0.71 / 0.68 / +4.9%
tpcds_q03/datafusion:parquet 16455408 / 16348562 / +0.7% 31960479 / 31340194 / +2.0% 0.51 / 0.52 / -1.3%
tpcds_q04/datafusion:parquet 200557754 / 201357887 / -0.4% 232266419 / 229435556 / +1.2% 0.86 / 0.88 / -1.6%
tpcds_q05/datafusion:parquet 73562812 / 72690582 / +1.2% 93411724 / 97767424 / -4.5% 0.79 / 0.74 / +5.9%
tpcds_q06/datafusion:parquet 28442074 / 28189002 / +0.9% 49521724 / 49579783 / -0.1% 0.57 / 0.57 / +1.0%
tpcds_q07/datafusion:parquet 46964901 / 47011412 / -0.1% 66924253 / 69320722 / -3.5% 0.70 / 0.68 / +3.5%
tpcds_q08/datafusion:parquet 31583964 / 31151948 / +1.4% 51919556 / 50815961 / +2.2% 0.61 / 0.61 / -0.8%
tpcds_q09/datafusion:parquet 32600362 / 30456983 / +7.0% 39649495 / 44958346 / -11.8% 🟢 0.82 / 0.68 / +21.4%
tpcds_q10/datafusion:parquet 42410400 / 42085997 / +0.8% 62864335 / 60340983 / +4.2% 0.67 / 0.70 / -3.3%
tpcds_q11/datafusion:parquet 96022382 / 95575207 / +0.5% 120566269 / 119069334 / +1.3% 0.80 / 0.80 / -0.8%
tpcds_q12/datafusion:parquet 21687382 / 21710744 / -0.1% 36395446 / 35915490 / +1.3% 0.60 / 0.60 / -1.4%
tpcds_q13/datafusion:parquet 41621598 / 43256284 / -3.8% 67318588 / 68422647 / -1.6% 0.62 / 0.63 / -2.2%
tpcds_q14/datafusion:parquet 128881318 / 126755733 / +1.7% 153396680 / 149903298 / +2.3% 0.84 / 0.85 / -0.6%
tpcds_q15/datafusion:parquet 32651594 / 33495643 / -2.5% 50667006 / 51452923 / -1.5% 0.64 / 0.65 / -1.0%
tpcds_q16/datafusion:parquet 38274633 / 37359295 / +2.5% 55583201 / 55825234 / -0.4% 0.69 / 0.67 / +2.9%
tpcds_q17/datafusion:parquet 78311894 / 77619872 / +0.9% 103660920 / 104196723 / -0.5% 0.76 / 0.74 / +1.4%
tpcds_q18/datafusion:parquet 62471138 / 61442044 / +1.7% 82035752 / 85243030 / -3.8% 0.76 / 0.72 / +5.6%
tpcds_q19/datafusion:parquet 25921757 / 26842399 / -3.4% 44853504 / 46388994 / -3.3% 0.58 / 0.58 / -0.1%
tpcds_q20/datafusion:parquet 23048950 / 22326434 / +3.2% 36350363 / 37959938 / -4.2% 0.63 / 0.59 / +7.8%
tpcds_q21/datafusion:parquet 18218228 / 18117700 / +0.6% 32577517 / 32995749 / -1.3% 0.56 / 0.55 / +1.8%
tpcds_q22/datafusion:parquet 75476476 / 75079032 / +0.5% 89034576 / 89875619 / -0.9% 0.85 / 0.84 / +1.5%
tpcds_q23/datafusion:parquet 110585258 / 108540993 / +1.9% 135024121 / 136603698 / -1.2% 0.82 / 0.79 / +3.1%
tpcds_q24/datafusion:parquet 96042176 / 95713003 / +0.3% 122283764 / 123419526 / -0.9% 0.79 / 0.78 / +1.3%
tpcds_q25/datafusion:parquet 79095170 / 79819243 / -0.9% 104106322 / 106766895 / -2.5% 0.76 / 0.75 / +1.6%
tpcds_q26/datafusion:parquet 43921572 / 43846278 / +0.2% 62188920 / 64973976 / -4.3% 0.71 / 0.67 / +4.7%
tpcds_q27/datafusion:parquet 76208459 / 73356089 / +3.9% 96142253 / 95495948 / +0.7% 0.79 / 0.77 / +3.2%
tpcds_q28/datafusion:parquet 27851659 / 27589160 / +1.0% 45348967 / 44891249 / +1.0% 0.61 / 0.61 / -0.1%
tpcds_q29/datafusion:parquet 78037894 / 79482878 / -1.8% 104569951 / 106968303 / -2.2% 0.75 / 0.74 / +0.4%
tpcds_q30/datafusion:parquet 45178884 / 43632765 / +3.5% 62462380 / 65759598 / -5.0% 0.72 / 0.66 / +9.0%
tpcds_q31/datafusion:parquet 80766255 / 80801422 / -0.0% 100781092 / 102257411 / -1.4% 0.80 / 0.79 / +1.4%
tpcds_q32/datafusion:parquet 23913798 / 23617250 / +1.3% 39953150 / 42483226 / -6.0% 0.60 / 0.56 / +7.7%
tpcds_q33/datafusion:parquet 33326074 / 33620900 / -0.9% 51251153 / 51186650 / +0.1% 0.65 / 0.66 / -1.0%
tpcds_q34/datafusion:parquet 23450988 / 22878403 / +2.5% 38173446 / 40038876 / -4.7% 0.61 / 0.57 / +7.5%
tpcds_q35/datafusion:parquet 50348872 / 49938923 / +0.8% 70261220 / 70657687 / -0.6% 0.72 / 0.71 / +1.4%
tpcds_q36/datafusion:parquet 52448734 / 53452414 / -1.9% 73408164 / 76441455 / -4.0% 0.71 / 0.70 / +2.2%
tpcds_q37/datafusion:parquet 23178045 / 22775542 / +1.8% 37973080 / 39503238 / -3.9% 0.61 / 0.58 / +5.9%
tpcds_q38/datafusion:parquet 44376701 / 43453918 / +2.1% 64320163 / 64794352 / -0.7% 0.69 / 0.67 / +2.9%
tpcds_q39/datafusion:parquet 71304042 / 72135698 / -1.2% 89829568 / 89866373 / -0.0% 0.79 / 0.80 / -1.1%
tpcds_q40/datafusion:parquet 30520287 / 31401480 / -2.8% 49572281 / 51363397 / -3.5% 0.62 / 0.61 / +0.7%
tpcds_q41/datafusion:parquet 17563944 / 17756486 / -1.1% 29665449 / 31129446 / -4.7% 0.59 / 0.57 / +3.8%
tpcds_q42/datafusion:parquet 15359108 / 15714074 / -2.3% 29274643 / 29888494 / -2.1% 0.52 / 0.53 / -0.2%
tpcds_q43/datafusion:parquet 17279078 / 17656680 / -2.1% 32085577 / 32666547 / -1.8% 0.54 / 0.54 / -0.4%
tpcds_q44/datafusion:parquet 33558304 / 33437168 / +0.4% 50757914 / 54178182 / -6.3% 0.66 / 0.62 / +7.1%
tpcds_q45/datafusion:parquet 37778883 / 37693740 / +0.2% 55199002 / 57092838 / -3.3% 0.68 / 0.66 / +3.7%
tpcds_q46/datafusion:parquet 29044948 / 28624954 / +1.5% 49616256 / 50077050 / -0.9% 0.59 / 0.57 / +2.4%
tpcds_q47/datafusion:parquet 96975904 / 96091876 / +0.9% 122448624 / 123519866 / -0.9% 0.79 / 0.78 / +1.8%
tpcds_q48/datafusion:parquet 37842868 / 38243526 / -1.0% 58770633 / 61517566 / -4.5% 0.64 / 0.62 / +3.6%
tpcds_q49/datafusion:parquet 75121600 / 76260944 / -1.5% 99625402 / 108338916 / -8.0% 0.75 / 0.70 / +7.1%
tpcds_q50/datafusion:parquet 49966615 / 50483766 / -1.0% 71002264 / 72871484 / -2.6% 0.70 / 0.69 / +1.6%
tpcds_q51/datafusion:parquet 67385738 / 68418962 / -1.5% 91745461 / 92736596 / -1.1% 0.73 / 0.74 / -0.4%
tpcds_q52/datafusion:parquet 16054433 / 15729494 / +2.1% 30950009 / 31639886 / -2.2% 0.52 / 0.50 / +4.3%
tpcds_q53/datafusion:parquet 22219120 / 22031566 / +0.9% 38886692 / 38589546 / +0.8% 0.57 / 0.57 / +0.1%
tpcds_q54/datafusion:parquet 45482871 / 45566345 / -0.2% 65053046 / 64021178 / +1.6% 0.70 / 0.71 / -1.8%
tpcds_q55/datafusion:parquet 15517428 / 15384872 / +0.9% 28955936 / 30177521 / -4.0% 0.54 / 0.51 / +5.1%
tpcds_q56/datafusion:parquet 32001559 / 32554041 / -1.7% 53977147 / 53913835 / +0.1% 0.59 / 0.60 / -1.8%
tpcds_q57/datafusion:parquet 98789762 / 99740001 / -1.0% 121635694 / 121049859 / +0.5% 0.81 / 0.82 / -1.4%
tpcds_q58/datafusion:parquet 64728213 / 64795908 / -0.1% 88259516 / 88425349 / -0.2% 0.73 / 0.73 / +0.1%
tpcds_q59/datafusion:parquet 42977898 / 42952764 / +0.1% 63111921 / 64011308 / -1.4% 0.68 / 0.67 / +1.5%
tpcds_q60/datafusion:parquet 32125732 / 32153210 / -0.1% 52565178 / 54500814 / -3.6% 0.61 / 0.59 / +3.6%
tpcds_q61/datafusion:parquet 34286593 / 34395606 / -0.3% 54841483 / 56730041 / -3.3% 0.63 / 0.61 / +3.1%
tpcds_q62/datafusion:parquet 24204644 / 24168101 / +0.2% 38139975 / 39117231 / -2.5% 0.63 / 0.62 / +2.7%
tpcds_q63/datafusion:parquet 21918614 / 21881936 / +0.2% 38655560 / 38514079 / +0.4% 0.57 / 0.57 / -0.2%
tpcds_q64/datafusion:parquet 210594559 / 204673854 / +2.9% 240323133 / 232637771 / +3.3% 0.88 / 0.88 / -0.4%
tpcds_q65/datafusion:parquet 38763332 / 38802972 / -0.1% 58387595 / 58649907 / -0.4% 0.66 / 0.66 / +0.3%
tpcds_q66/datafusion:parquet 61787230 / 62772841 / -1.6% 80302611 / 80566678 / -0.3% 0.77 / 0.78 / -1.2%
tpcds_q67/datafusion:parquet 70189784 / 70069560 / +0.2% 95440144 / 95577444 / -0.1% 0.74 / 0.73 / +0.3%
tpcds_q68/datafusion:parquet 29385736 / 28870892 / +1.8% 51715526 / 52919074 / -2.3% 0.57 / 0.55 / +4.2%
tpcds_q69/datafusion:parquet 40928410 / 41682740 / -1.8% 60416509 / 60523679 / -0.2% 0.68 / 0.69 / -1.6%
tpcds_q70/datafusion:parquet 32724128 / 32888394 / -0.5% 54375969 / 54679183 / -0.6% 0.60 / 0.60 / +0.1%
tpcds_q71/datafusion:parquet 24628208 / 24063524 / +2.3% 38918507 / 40554908 / -4.0% 0.63 / 0.59 / +6.6%
tpcds_q72/datafusion:parquet 546620400 / 546378832 / +0.0% 574925883 / 572576869 / +0.4% 0.95 / 0.95 / -0.4%
tpcds_q73/datafusion:parquet 22297286 / 21534272 / +3.5% 38019837 / 37243632 / +2.1% 0.59 / 0.58 / +1.4%
tpcds_q74/datafusion:parquet 66397188 / 67398230 / -1.5% 85590035 / 87548576 / -2.2% 0.78 / 0.77 / +0.8%
tpcds_q75/datafusion:parquet 152716816 / 148250516 / +3.0% 182436443 / 184279047 / -1.0% 0.84 / 0.80 / +4.1%
tpcds_q76/datafusion:parquet 48065726 / 49057452 / -2.0% 66312991 / 65905072 / +0.6% 0.72 / 0.74 / -2.6%
tpcds_q77/datafusion:parquet 53126170 / 52220030 / +1.7% 75646774 / 73077303 / +3.5% 0.70 / 0.71 / -1.7%
tpcds_q78/datafusion:parquet 92940296 / 93657728 / -0.8% 125422487 / 124473760 / +0.8% 0.74 / 0.75 / -1.5%
tpcds_q79/datafusion:parquet 26039385 / 26102064 / -0.2% 45732570 / 45768868 / -0.1% 0.57 / 0.57 / -0.2%
tpcds_q80/datafusion:parquet 80935462 / 82997073 / -2.5% 109836961 / 113113180 / -2.9% 0.74 / 0.73 / +0.4%
tpcds_q81/datafusion:parquet 38983992 / 38202582 / +2.0% 58240671 / 58526971 / -0.5% 0.67 / 0.65 / +2.5%
tpcds_q82/datafusion:parquet 25480742 / 25150444 / +1.3% 38996371 / 39934133 / -2.3% 0.65 / 0.63 / +3.7%
tpcds_q83/datafusion:parquet 48279488 / 47567092 / +1.5% 70009181 / 67242629 / +4.1% 0.69 / 0.71 / -2.5%
tpcds_q84/datafusion:parquet 28916052 / 29510376 / -2.0% 44658690 / 46149055 / -3.2% 0.65 / 0.64 / +1.3%
tpcds_q85/datafusion:parquet 85774416 / 86664918 / -1.0% 110461628 / 107996507 / +2.3% 0.78 / 0.80 / -3.2%
tpcds_q86/datafusion:parquet 20878107 / 20916850 / -0.2% 33597277 / 34357289 / -2.2% 0.62 / 0.61 / +2.1%
tpcds_q87/datafusion:parquet 43401190 / 43298812 / +0.2% 60824416 / 61139706 / -0.5% 0.71 / 0.71 / +0.8%
tpcds_q88/datafusion:parquet 38855884 / 40108586 / -3.1% 63987626 / 57621375 / +11.0% 🔴 0.61 / 0.70 / -12.8%
tpcds_q89/datafusion:parquet 25401376 / 25334976 / +0.3% 41712903 / 41364754 / +0.8% 0.61 / 0.61 / -0.6%
tpcds_q90/datafusion:parquet 15489510 / 15620686 / -0.8% 30903357 / 29425082 / +5.0% 0.50 / 0.53 / -5.6%
tpcds_q91/datafusion:parquet 32004228 / 31898570 / +0.3% 48666294 / 49398786 / -1.5% 0.66 / 0.65 / +1.8%
tpcds_q92/datafusion:parquet 24017144 / 23444680 / +2.4% 41012516 / 40488062 / +1.3% 0.59 / 0.58 / +1.1%
tpcds_q93/datafusion:parquet 27895519 / 27812008 / +0.3% 45110278 / 48899166 / -7.7% 0.62 / 0.57 / +8.7%
tpcds_q94/datafusion:parquet 31932689 / 32165797 / -0.7% 48297412 / 48466104 / -0.3% 0.66 / 0.66 / -0.4%
tpcds_q95/datafusion:parquet 65832433 / 65769908 / +0.1% 80828810 / 80832749 / -0.0% 0.81 / 0.81 / +0.1%
tpcds_q96/datafusion:parquet 13051878 / 12743440 / +2.4% 27037735 / 28330458 / -4.6% 0.48 / 0.45 / +7.3%
tpcds_q97/datafusion:parquet 32337961 / 32197654 / +0.4% 52358014 / 52590434 / -0.4% 0.62 / 0.61 / +0.9%
tpcds_q98/datafusion:parquet 22449611 / 22632703 / -0.8% 38224435 / 38786479 / -1.4% 0.59 / 0.58 / +0.6%
tpcds_q99/datafusion:parquet 28674358 / 28598368 / +0.3% 42798624 / 43038153 / -0.6% 0.67 / 0.66 / +0.8%
duckdb / vortex-file-compressed / ns (1.086x ➖, 19↑ 47↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 17730990 / 14834070 / +19.5% 🔴 26774163 / 23003648 / +16.4% 🔴 0.66 / 0.64 / +2.7%
tpcds_q02/duckdb:vortex-file-compressed 16384125 / 14612362 / +12.1% 🔴 22867789 / 20661341 / +10.7% 🔴 0.72 / 0.71 / +1.3%
tpcds_q03/duckdb:vortex-file-compressed 7760523 / 8934590 / -13.1% 🟢 16453391 / 19269770 / -14.6% 🟢 0.47 / 0.46 / +1.7%
tpcds_q04/duckdb:vortex-file-compressed 49162954 / 50327600 / -2.3% 58414850 / 59279777 / -1.5% 0.84 / 0.85 / -0.9%
tpcds_q05/duckdb:vortex-file-compressed 24378558 / 18417196 / +32.4% 🔴 32330549 / 27944767 / +15.7% 🔴 0.75 / 0.66 / +14.4%
tpcds_q06/duckdb:vortex-file-compressed 29539916 / 25826330 / +14.4% 🔴 42724765 / 39182150 / +9.0% 0.69 / 0.66 / +4.9%
tpcds_q07/duckdb:vortex-file-compressed 14980867 / 15288802 / -2.0% 26182377 / 32300559 / -18.9% 🟢 0.57 / 0.47 / +20.9%
tpcds_q08/duckdb:vortex-file-compressed 19606241 / 18077454 / +8.5% 26783428 / 29393010 / -8.9% 0.73 / 0.62 / +19.0%
tpcds_q09/duckdb:vortex-file-compressed 18273790 / 12947894 / +41.1% 🔴 29410026 / 20913210 / +40.6% 🔴 0.62 / 0.62 / +0.4%
tpcds_q10/duckdb:vortex-file-compressed 33835766 / 26377926 / +28.3% 🔴 46911385 / 42998782 / +9.1% 0.72 / 0.61 / +17.6%
tpcds_q11/duckdb:vortex-file-compressed 39940004 / 40051986 / -0.3% 48435635 / 51800613 / -6.5% 0.82 / 0.77 / +6.6%
tpcds_q12/duckdb:vortex-file-compressed 10813326 / 9942614 / +8.8% 17080473 / 15765200 / +8.3% 0.63 / 0.63 / +0.4%
tpcds_q13/duckdb:vortex-file-compressed 21663650 / 20752892 / +4.4% 35239261 / 31986318 / +10.2% 🔴 0.61 / 0.65 / -5.2%
tpcds_q14/duckdb:vortex-file-compressed 59862500 / 58130178 / +3.0% 68581166 / 71731026 / -4.4% 0.87 / 0.81 / +7.7%
tpcds_q15/duckdb:vortex-file-compressed 24448350 / 20470149 / +19.4% 🔴 31570616 / 24736561 / +27.6% 🔴 0.77 / 0.83 / -6.4%
tpcds_q16/duckdb:vortex-file-compressed 36565064 / 16827016 / +117.3% 🔴 46988299 / 25823637 / +82.0% 🔴 0.78 / 0.65 / +19.4%
tpcds_q17/duckdb:vortex-file-compressed 25959246 / 29246610 / -11.2% 🟢 40484789 / 44375352 / -8.8% 0.64 / 0.66 / -2.7%
tpcds_q18/duckdb:vortex-file-compressed 33305888 / 27306920 / +22.0% 🔴 43574654 / 37009878 / +17.7% 🔴 0.76 / 0.74 / +3.6%
tpcds_q19/duckdb:vortex-file-compressed 97255790 / 23866490 / +307.5% 🔴 110029896 / 35297730 / +211.7% 🔴 0.88 / 0.68 / +30.7%
tpcds_q20/duckdb:vortex-file-compressed 11268597 / 10399897 / +8.4% 18555961 / 15176553 / +22.3% 🔴 0.61 / 0.69 / -11.4%
tpcds_q21/duckdb:vortex-file-compressed 11567812 / 12635632 / -8.5% 24167929 / 17080544 / +41.5% 🔴 0.48 / 0.74 / -35.3%
tpcds_q22/duckdb:vortex-file-compressed 20197450 / 28717212 / -29.7% 🟢 29752628 / 38747787 / -23.2% 🟢 0.68 / 0.74 / -8.4%
tpcds_q23/duckdb:vortex-file-compressed 41631732 / 35823812 / +16.2% 🔴 52978452 / 46503086 / +13.9% 🔴 0.79 / 0.77 / +2.0%
tpcds_q24/duckdb:vortex-file-compressed 29022934 / 28059582 / +3.4% 39519879 / 41529478 / -4.8% 0.73 / 0.68 / +8.7%
tpcds_q25/duckdb:vortex-file-compressed 26086940 / 24931174 / +4.6% 40534025 / 40039325 / +1.2% 0.64 / 0.62 / +3.4%
tpcds_q26/duckdb:vortex-file-compressed 13783326 / 12979834 / +6.2% 22652538 / 19833345 / +14.2% 🔴 0.61 / 0.65 / -7.0%
tpcds_q27/duckdb:vortex-file-compressed 17636630 / 18107708 / -2.6% 29755023 / 31641096 / -6.0% 0.59 / 0.57 / +3.6%
tpcds_q28/duckdb:vortex-file-compressed 15761358 / 11524846 / +36.8% 🔴 24749189 / 18309414 / +35.2% 🔴 0.64 / 0.63 / +1.2%
tpcds_q29/duckdb:vortex-file-compressed 24906590 / 27848133 / -10.6% 🟢 38927960 / 45505050 / -14.5% 🟢 0.64 / 0.61 / +4.5%
tpcds_q30/duckdb:vortex-file-compressed 17519514 / 18552718 / -5.6% 25358168 / 29057474 / -12.7% 🟢 0.69 / 0.64 / +8.2%
tpcds_q31/duckdb:vortex-file-compressed 19552812 / 18882714 / +3.5% 27867927 / 26569780 / +4.9% 0.70 / 0.71 / -1.3%
tpcds_q32/duckdb:vortex-file-compressed 13253510 / 9267022 / +43.0% 🔴 22925591 / 15058466 / +52.2% 🔴 0.58 / 0.62 / -6.1%
tpcds_q33/duckdb:vortex-file-compressed 18575374 / 15994134 / +16.1% 🔴 26759938 / 30284089 / -11.6% 🟢 0.69 / 0.53 / +31.4%
tpcds_q34/duckdb:vortex-file-compressed 13561878 / 15266070 / -11.2% 🟢 22291880 / 28269845 / -21.1% 🟢 0.61 / 0.54 / +12.7%
tpcds_q35/duckdb:vortex-file-compressed 31187808 / 45508842 / -31.5% 🟢 42333100 / 59997943 / -29.4% 🟢 0.74 / 0.76 / -2.9%
tpcds_q36/duckdb:vortex-file-compressed 15926627 / 14401933 / +10.6% 🔴 27144931 / 26742640 / +1.5% 0.59 / 0.54 / +8.9%
tpcds_q37/duckdb:vortex-file-compressed 10728347 / 13689366 / -21.6% 🟢 24594579 / 21991645 / +11.8% 🔴 0.44 / 0.62 / -29.9%
tpcds_q38/duckdb:vortex-file-compressed 25307552 / 21900666 / +15.6% 🔴 32542199 / 28410171 / +14.5% 🔴 0.78 / 0.77 / +0.9%
tpcds_q39/duckdb:vortex-file-compressed 20741746 / 18059272 / +14.9% 🔴 33187482 / 27584981 / +20.3% 🔴 0.62 / 0.65 / -4.5%
tpcds_q40/duckdb:vortex-file-compressed 14862534 / 12844206 / +15.7% 🔴 21742677 / 19197873 / +13.3% 🔴 0.68 / 0.67 / +2.2%
tpcds_q41/duckdb:vortex-file-compressed 15743372 / 6125011 / +157.0% 🔴 23981307 / 9032013 / +165.5% 🔴 0.66 / 0.68 / -3.2%
tpcds_q42/duckdb:vortex-file-compressed 7676964 / 9016928 / -14.9% 🟢 16521445 / 21119228 / -21.8% 🟢 0.46 / 0.43 / +8.8%
tpcds_q43/duckdb:vortex-file-compressed 10530075 / 9896974 / +6.4% 19121310 / 18144449 / +5.4% 0.55 / 0.55 / +1.0%
tpcds_q44/duckdb:vortex-file-compressed 16816254 / 14448918 / +16.4% 🔴 28765428 / 24928269 / +15.4% 🔴 0.58 / 0.58 / +0.9%
tpcds_q45/duckdb:vortex-file-compressed 26315484 / 21628044 / +21.7% 🔴 33015527 / 28572887 / +15.5% 🔴 0.80 / 0.76 / +5.3%
tpcds_q46/duckdb:vortex-file-compressed 20917842 / 18411550 / +13.6% 🔴 28714169 / 29915399 / -4.0% 0.73 / 0.62 / +18.4%
tpcds_q47/duckdb:vortex-file-compressed 41444403 / 31539120 / +31.4% 🔴 51847915 / 45044942 / +15.1% 🔴 0.80 / 0.70 / +14.2%
tpcds_q48/duckdb:vortex-file-compressed 25430226 / 18682232 / +36.1% 🔴 37203098 / 29299915 / +27.0% 🔴 0.68 / 0.64 / +7.2%
tpcds_q49/duckdb:vortex-file-compressed 20861516 / 16292580 / +28.0% 🔴 33442481 / 28567873 / +17.1% 🔴 0.62 / 0.57 / +9.4%
tpcds_q50/duckdb:vortex-file-compressed 19839348 / 17707668 / +12.0% 🔴 31054106 / 26983432 / +15.1% 🔴 0.64 / 0.66 / -2.6%
tpcds_q51/duckdb:vortex-file-compressed 52928943 / 76631805 / -30.9% 🟢 84008230 / 60189928 / +39.6% 🔴 0.63 / 1.27 / -50.5%
tpcds_q52/duckdb:vortex-file-compressed 7979285 / 9749686 / -18.2% 🟢 16444733 / 19011739 / -13.5% 🟢 0.49 / 0.51 / -5.4%
tpcds_q53/duckdb:vortex-file-compressed 12704970 / 13506636 / -5.9% 22015884 / 24780926 / -11.2% 🟢 0.58 / 0.55 / +5.9%
tpcds_q54/duckdb:vortex-file-compressed 21385569 / 20155886 / +6.1% 30296076 / 28804721 / +5.2% 0.71 / 0.70 / +0.9%
tpcds_q55/duckdb:vortex-file-compressed 7672194 / 7869346 / -2.5% 16950451 / 18026667 / -6.0% 0.45 / 0.44 / +3.7%
tpcds_q56/duckdb:vortex-file-compressed 18786490 / 16613738 / +13.1% 🔴 28490774 / 28551002 / -0.2% 0.66 / 0.58 / +13.3%
tpcds_q57/duckdb:vortex-file-compressed 28650581 / 23716456 / +20.8% 🔴 37283287 / 30467353 / +22.4% 🔴 0.77 / 0.78 / -1.3%
tpcds_q58/duckdb:vortex-file-compressed 20738732 / 16773630 / +23.6% 🔴 29934185 / 27675959 / +8.2% 0.69 / 0.61 / +14.3%
tpcds_q59/duckdb:vortex-file-compressed 21000090 / 18252706 / +15.1% 🔴 28508862 / 24619162 / +15.8% 🔴 0.74 / 0.74 / -0.6%
tpcds_q60/duckdb:vortex-file-compressed 19403717 / 18052426 / +7.5% 29696779 / 28583767 / +3.9% 0.65 / 0.63 / +3.5%
tpcds_q61/duckdb:vortex-file-compressed 26269432 / 19495968 / +34.7% 🔴 36760216 / 30876783 / +19.1% 🔴 0.71 / 0.63 / +13.2%
tpcds_q62/duckdb:vortex-file-compressed 12022418 / 9704304 / +23.9% 🔴 19498357 / 16683990 / +16.9% 🔴 0.62 / 0.58 / +6.0%
tpcds_q63/duckdb:vortex-file-compressed 11845020 / 13340766 / -11.2% 🟢 20828482 / 23156357 / -10.1% 🟢 0.57 / 0.58 / -1.3%
tpcds_q64/duckdb:vortex-file-compressed 53780318 / 62396584 / -13.8% 🟢 73284830 / 79710676 / -8.1% 0.73 / 0.78 / -6.3%
tpcds_q65/duckdb:vortex-file-compressed 16877002 / 15610520 / +8.1% 26781451 / 29144645 / -8.1% 0.63 / 0.54 / +17.7%
tpcds_q66/duckdb:vortex-file-compressed 32120070 / 20993836 / +53.0% 🔴 41427677 / 31136850 / +33.1% 🔴 0.78 / 0.67 / +15.0%
tpcds_q67/duckdb:vortex-file-compressed 64885127 / 64192428 / +1.1% 74226203 / 80626281 / -7.9% 0.87 / 0.80 / +9.8%
tpcds_q68/duckdb:vortex-file-compressed 21024242 / 17971904 / +17.0% 🔴 28030879 / 29311631 / -4.4% 0.75 / 0.61 / +22.3%
tpcds_q69/duckdb:vortex-file-compressed 23533366 / 27708650 / -15.1% 🟢 38179226 / 47639598 / -19.9% 🟢 0.62 / 0.58 / +6.0%
tpcds_q70/duckdb:vortex-file-compressed 16767058 / 18233116 / -8.0% 25233105 / 30033623 / -16.0% 🟢 0.66 / 0.61 / +9.5%
tpcds_q71/duckdb:vortex-file-compressed 14632848 / 12558136 / +16.5% 🔴 23931542 / 22172349 / +7.9% 0.61 / 0.57 / +8.0%
tpcds_q72/duckdb:vortex-file-compressed 49695716 / 61233846 / -18.8% 🟢 62460932 / 76232524 / -18.1% 🟢 0.80 / 0.80 / -0.9%
tpcds_q73/duckdb:vortex-file-compressed 11850543 / 14795640 / -19.9% 🟢 20740250 / 27062394 / -23.4% 🟢 0.57 / 0.55 / +4.5%
tpcds_q74/duckdb:vortex-file-compressed 28062510 / 27167050 / +3.3% 35481163 / 41472640 / -14.4% 🟢 0.79 / 0.66 / +20.7%
tpcds_q75/duckdb:vortex-file-compressed 30478846 / 27610730 / +10.4% 🔴 41007742 / 39463086 / +3.9% 0.74 / 0.70 / +6.2%
tpcds_q76/duckdb:vortex-file-compressed 13529244 / 11873092 / +13.9% 🔴 23646487 / 22900780 / +3.3% 0.57 / 0.52 / +10.4%
tpcds_q77/duckdb:vortex-file-compressed 21151366 / 15182924 / +39.3% 🔴 31973611 / 24723159 / +29.3% 🔴 0.66 / 0.61 / +7.7%
tpcds_q78/duckdb:vortex-file-compressed 44217874 / 36745928 / +20.3% 🔴 53784488 / 46070189 / +16.7% 🔴 0.82 / 0.80 / +3.1%
tpcds_q79/duckdb:vortex-file-compressed 14507019 / 15984835 / -9.2% 22779518 / 26118181 / -12.8% 🟢 0.64 / 0.61 / +4.1%
tpcds_q80/duckdb:vortex-file-compressed 39692610 / 27366424 / +45.0% 🔴 51826837 / 45736949 / +13.3% 🔴 0.77 / 0.60 / +28.0%
tpcds_q81/duckdb:vortex-file-compressed 22283304 / 24078254 / -7.5% 30143199 / 30424903 / -0.9% 0.74 / 0.79 / -6.6%
tpcds_q82/duckdb:vortex-file-compressed 10770536 / 31611321 / -65.9% 🟢 23036396 / 38402317 / -40.0% 🟢 0.47 / 0.82 / -43.2%
tpcds_q83/duckdb:vortex-file-compressed 18044000 / 16751619 / +7.7% 24026351 / 24231170 / -0.8% 0.75 / 0.69 / +8.6%
tpcds_q84/duckdb:vortex-file-compressed 16764426 / 12461384 / +34.5% 🔴 24456779 / 20018412 / +22.2% 🔴 0.69 / 0.62 / +10.1%
tpcds_q85/duckdb:vortex-file-compressed 25487584 / 30556832 / -16.6% 🟢 38024799 / 39442517 / -3.6% 0.67 / 0.77 / -13.5%
tpcds_q86/duckdb:vortex-file-compressed 10252577 / 11897901 / -13.8% 🟢 18125453 / 17013894 / +6.5% 0.57 / 0.70 / -19.1%
tpcds_q87/duckdb:vortex-file-compressed 26896547 / 23456595 / +14.7% 🔴 33922421 / 29230861 / +16.1% 🔴 0.79 / 0.80 / -1.2%
tpcds_q88/duckdb:vortex-file-compressed 38939396 / 31218741 / +24.7% 🔴 47607903 / 44531271 / +6.9% 0.82 / 0.70 / +16.7%
tpcds_q89/duckdb:vortex-file-compressed 13098375 / 13475811 / -2.8% 22458508 / 26944646 / -16.6% 🟢 0.58 / 0.50 / +16.6%
tpcds_q90/duckdb:vortex-file-compressed 8669936 / 8100096 / +7.0% 15343815 / 11665556 / +31.5% 🔴 0.57 / 0.69 / -18.6%
tpcds_q91/duckdb:vortex-file-compressed 14976890 / 14904608 / +0.5% 23514756 / 21753498 / +8.1% 0.64 / 0.69 / -7.0%
tpcds_q92/duckdb:vortex-file-compressed 13904449 / 10477888 / +32.7% 🔴 23460465 / 22883879 / +2.5% 0.59 / 0.46 / +29.4%
tpcds_q93/duckdb:vortex-file-compressed 12192146 / 17245924 / -29.3% 🟢 26550551 / 26989004 / -1.6% 0.46 / 0.64 / -28.1%
tpcds_q94/duckdb:vortex-file-compressed 33125691 / 15771874 / +110.0% 🔴 42222937 / 28360034 / +48.9% 🔴 0.78 / 0.56 / +41.1%
tpcds_q95/duckdb:vortex-file-compressed 43573213 / 44293555 / -1.6% 53791809 / 53486707 / +0.6% 0.81 / 0.83 / -2.2%
tpcds_q96/duckdb:vortex-file-compressed 7127513 / 7441390 / -4.2% 15213994 / 14498270 / +4.9% 0.47 / 0.51 / -8.7%
tpcds_q97/duckdb:vortex-file-compressed 25700303 / 22017594 / +16.7% 🔴 33657368 / 32439096 / +3.8% 0.76 / 0.68 / +12.5%
tpcds_q98/duckdb:vortex-file-compressed 12370004 / 12762145 / -3.1% 20462857 / 22513834 / -9.1% 0.60 / 0.57 / +6.6%
tpcds_q99/duckdb:vortex-file-compressed 14305475 / 12907496 / +10.8% 🔴 22267877 / 19037965 / +17.0% 🔴 0.64 / 0.68 / -5.2%
duckdb / parquet / ns (1.260x ❌, 8↑ 78↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 29659231 / 27448268 / +8.1% 36690825 / 33275809 / +10.3% 🔴 0.81 / 0.82 / -2.0%
tpcds_q02/duckdb:parquet 19412326 / 15720738 / +23.5% 🔴 25509716 / 21400307 / +19.2% 🔴 0.76 / 0.73 / +3.6%
tpcds_q03/duckdb:parquet 11061721 / 9234406 / +19.8% 🔴 17859872 / 15762869 / +13.3% 🔴 0.62 / 0.59 / +5.7%
tpcds_q04/duckdb:parquet 132339500 / 130208410 / +1.6% 141364472 / 134997217 / +4.7% 0.94 / 0.96 / -2.9%
tpcds_q05/duckdb:parquet 30567056 / 22986732 / +33.0% 🔴 35858543 / 28855802 / +24.3% 🔴 0.85 / 0.80 / +7.0%
tpcds_q06/duckdb:parquet 33852444 / 26803377 / +26.3% 🔴 44703932 / 36567108 / +22.3% 🔴 0.76 / 0.73 / +3.3%
tpcds_q07/duckdb:parquet 34154706 / 15676742 / +117.9% 🔴 42935641 / 22189524 / +93.5% 🔴 0.80 / 0.71 / +12.6%
tpcds_q08/duckdb:parquet 23377322 / 25962716 / -10.0% 29064809 / 33195932 / -12.4% 🟢 0.80 / 0.78 / +2.8%
tpcds_q09/duckdb:parquet 29423542 / 19143036 / +53.7% 🔴 32323827 / 22414069 / +44.2% 🔴 0.91 / 0.85 / +6.6%
tpcds_q10/duckdb:parquet 44240760 / 27844522 / +58.9% 🔴 52197067 / 37345947 / +39.8% 🔴 0.85 / 0.75 / +13.7%
tpcds_q11/duckdb:parquet 76594280 / 72708095 / +5.3% 84327059 / 78012731 / +8.1% 0.91 / 0.93 / -2.5%
tpcds_q12/duckdb:parquet 16193512 / 12829959 / +26.2% 🔴 21602873 / 18208693 / +18.6% 🔴 0.75 / 0.70 / +6.4%
tpcds_q13/duckdb:parquet 33616402 / 24207476 / +38.9% 🔴 42863219 / 30336195 / +41.3% 🔴 0.78 / 0.80 / -1.7%
tpcds_q14/duckdb:parquet 75037538 / 60700274 / +23.6% 🔴 79072586 / 67774906 / +16.7% 🔴 0.95 / 0.90 / +6.0%
tpcds_q15/duckdb:parquet 20367424 / 25434892 / -19.9% 🟢 26552697 / 30364994 / -12.6% 🟢 0.77 / 0.84 / -8.4%
tpcds_q16/duckdb:parquet 43493228 / 21056121 / +106.6% 🔴 50470689 / 28404608 / +77.7% 🔴 0.86 / 0.74 / +16.2%
tpcds_q17/duckdb:parquet 37764697 / 32693197 / +15.5% 🔴 45403261 / 39970531 / +13.6% 🔴 0.83 / 0.82 / +1.7%
tpcds_q18/duckdb:parquet 56896628 / 40379630 / +40.9% 🔴 65019717 / 52013212 / +25.0% 🔴 0.88 / 0.78 / +12.7%
tpcds_q19/duckdb:parquet 22235600 / 24995462 / -11.0% 🟢 30112723 / 32088055 / -6.2% 0.74 / 0.78 / -5.2%
tpcds_q20/duckdb:parquet 17206836 / 14005803 / +22.9% 🔴 22417146 / 18351178 / +22.2% 🔴 0.77 / 0.76 / +0.6%
tpcds_q21/duckdb:parquet 12375868 / 9460414 / +30.8% 🔴 19490749 / 15167069 / +28.5% 🔴 0.63 / 0.62 / +1.8%
tpcds_q22/duckdb:parquet 22477987 / 34611736 / -35.1% 🟢 28531572 / 38738093 / -26.3% 🟢 0.79 / 0.89 / -11.8%
tpcds_q23/duckdb:parquet 51300010 / 40904780 / +25.4% 🔴 56568803 / 47933445 / +18.0% 🔴 0.91 / 0.85 / +6.3%
tpcds_q24/duckdb:parquet 33394540 / 33806866 / -1.2% 40383848 / 42097104 / -4.1% 0.83 / 0.80 / +3.0%
tpcds_q25/duckdb:parquet 35679408 / 31279926 / +14.1% 🔴 44614133 / 39580923 / +12.7% 🔴 0.80 / 0.79 / +1.2%
tpcds_q26/duckdb:parquet 32819922 / 31585080 / +3.9% 39320427 / 38176109 / +3.0% 0.83 / 0.83 / +0.9%
tpcds_q27/duckdb:parquet 37887071 / 31906405 / +18.7% 🔴 46470181 / 39960607 / +16.3% 🔴 0.82 / 0.80 / +2.1%
tpcds_q28/duckdb:parquet 28245326 / 17995192 / +57.0% 🔴 33875258 / 27645905 / +22.5% 🔴 0.83 / 0.65 / +28.1%
tpcds_q29/duckdb:parquet 36531561 / 31085660 / +17.5% 🔴 43983592 / 39559207 / +11.2% 🔴 0.83 / 0.79 / +5.7%
tpcds_q30/duckdb:parquet 44636245 / 34215038 / +30.5% 🔴 53211668 / 42644887 / +24.8% 🔴 0.84 / 0.80 / +4.6%
tpcds_q31/duckdb:parquet 40249083 / 20843094 / +93.1% 🔴 47133784 / 25024994 / +88.3% 🔴 0.85 / 0.83 / +2.5%
tpcds_q32/duckdb:parquet 18197786 / 12101624 / +50.4% 🔴 24712463 / 18142719 / +36.2% 🔴 0.74 / 0.67 / +10.4%
tpcds_q33/duckdb:parquet 24994607 / 16473150 / +51.7% 🔴 31093629 / 23603590 / +31.7% 🔴 0.80 / 0.70 / +15.2%
tpcds_q34/duckdb:parquet 19191569 / 16393396 / +17.1% 🔴 26443618 / 22183053 / +19.2% 🔴 0.73 / 0.74 / -1.8%
tpcds_q35/duckdb:parquet 42183409 / 46888595 / -10.0% 🟢 50972343 / 56117332 / -9.2% 0.83 / 0.84 / -1.0%
tpcds_q36/duckdb:parquet 43646562 / 16178898 / +169.8% 🔴 52542588 / 22939873 / +129.0% 🔴 0.83 / 0.71 / +17.8%
tpcds_q37/duckdb:parquet 14753980 / 11529996 / +28.0% 🔴 22121975 / 18241985 / +21.3% 🔴 0.67 / 0.63 / +5.5%
tpcds_q38/duckdb:parquet 32555331 / 26608332 / +22.4% 🔴 36813661 / 30160399 / +22.1% 🔴 0.88 / 0.88 / +0.2%
tpcds_q39/duckdb:parquet 25906928 / 24251416 / +6.8% 32529968 / 28135491 / +15.6% 🔴 0.80 / 0.86 / -7.6%
tpcds_q40/duckdb:parquet 18336010 / 16637474 / +10.2% 🔴 23462553 / 21478412 / +9.2% 0.78 / 0.77 / +0.9%
tpcds_q41/duckdb:parquet 14067886 / 7628086 / +84.4% 🔴 21975705 / 12929073 / +70.0% 🔴 0.64 / 0.59 / +8.5%
tpcds_q42/duckdb:parquet 10912330 / 8745517 / +24.8% 🔴 17930077 / 15108459 / +18.7% 🔴 0.61 / 0.58 / +5.1%
tpcds_q43/duckdb:parquet 14288750 / 10590330 / +34.9% 🔴 20750936 / 14830270 / +39.9% 🔴 0.69 / 0.71 / -3.6%
tpcds_q44/duckdb:parquet 22200564 / 16048983 / +38.3% 🔴 29454170 / 22961833 / +28.3% 🔴 0.75 / 0.70 / +7.8%
tpcds_q45/duckdb:parquet 25375795 / 23669005 / +7.2% 32222363 / 29823169 / +8.0% 0.79 / 0.79 / -0.8%
tpcds_q46/duckdb:parquet 40847988 / 36572398 / +11.7% 🔴 49215666 / 45699342 / +7.7% 0.83 / 0.80 / +3.7%
tpcds_q47/duckdb:parquet 41689053 / 30956544 / +34.7% 🔴 49801187 / 40252096 / +23.7% 🔴 0.84 / 0.77 / +8.8%
tpcds_q48/duckdb:parquet 32065344 / 21196534 / +51.3% 🔴 40696098 / 27786940 / +46.5% 🔴 0.79 / 0.76 / +3.3%
tpcds_q49/duckdb:parquet 33395119 / 19960074 / +67.3% 🔴 38721221 / 31093561 / +24.5% 🔴 0.86 / 0.64 / +34.4%
tpcds_q50/duckdb:parquet 22664582 / 18442710 / +22.9% 🔴 29787200 / 28112036 / +6.0% 0.76 / 0.66 / +16.0%
tpcds_q51/duckdb:parquet 56649995 / 53042352 / +6.8% 64309813 / 63945754 / +0.6% 0.88 / 0.83 / +6.2%
tpcds_q52/duckdb:parquet 11054161 / 8843573 / +25.0% 🔴 17998229 / 15893110 / +13.2% 🔴 0.61 / 0.56 / +10.4%
tpcds_q53/duckdb:parquet 15145892 / 11688922 / +29.6% 🔴 22748624 / 16752838 / +35.8% 🔴 0.67 / 0.70 / -4.6%
tpcds_q54/duckdb:parquet 29150736 / 20949818 / +39.1% 🔴 36521746 / 29678530 / +23.1% 🔴 0.80 / 0.71 / +13.1%
tpcds_q55/duckdb:parquet 10833922 / 8988270 / +20.5% 🔴 17472349 / 15571225 / +12.2% 🔴 0.62 / 0.58 / +7.4%
tpcds_q56/duckdb:parquet 27180674 / 16957774 / +60.3% 🔴 33501454 / 26850056 / +24.8% 🔴 0.81 / 0.63 / +28.5%
tpcds_q57/duckdb:parquet 36013414 / 28788274 / +25.1% 🔴 42734418 / 34551430 / +23.7% 🔴 0.84 / 0.83 / +1.1%
tpcds_q58/duckdb:parquet 26108062 / 20488016 / +27.4% 🔴 32800107 / 26665256 / +23.0% 🔴 0.80 / 0.77 / +3.6%
tpcds_q59/duckdb:parquet 25056553 / 19976745 / +25.4% 🔴 32147952 / 24931029 / +28.9% 🔴 0.78 / 0.80 / -2.7%
tpcds_q60/duckdb:parquet 28554932 / 17331324 / +64.8% 🔴 34181216 / 25811577 / +32.4% 🔴 0.84 / 0.67 / +24.4%
tpcds_q61/duckdb:parquet 28140856 / 21895614 / +28.5% 🔴 33693163 / 28333324 / +18.9% 🔴 0.84 / 0.77 / +8.1%
tpcds_q62/duckdb:parquet 14792436 / 10781716 / +37.2% 🔴 20166061 / 15143679 / +33.2% 🔴 0.73 / 0.71 / +3.0%
tpcds_q63/duckdb:parquet 14564916 / 11207326 / +30.0% 🔴 22187255 / 16546493 / +34.1% 🔴 0.66 / 0.68 / -3.1%
tpcds_q64/duckdb:parquet 81577538 / 53521686 / +52.4% 🔴 92741747 / 67997150 / +36.4% 🔴 0.88 / 0.79 / +11.8%
tpcds_q65/duckdb:parquet 21489106 / 17260068 / +24.5% 🔴 27011787 / 21883787 / +23.4% 🔴 0.80 / 0.79 / +0.9%
tpcds_q66/duckdb:parquet 42343221 / 24872324 / +70.2% 🔴 49124890 / 31936593 / +53.8% 🔴 0.86 / 0.78 / +10.7%
tpcds_q67/duckdb:parquet 68596540 / 76529292 / -10.4% 🟢 75470691 / 86997391 / -13.2% 🟢 0.91 / 0.88 / +3.3%
tpcds_q68/duckdb:parquet 32608255 / 30460262 / +7.1% 41474525 / 40200399 / +3.2% 0.79 / 0.76 / +3.8%
tpcds_q69/duckdb:parquet 31696963 / 30079625 / +5.4% 40679654 / 41875446 / -2.9% 0.78 / 0.72 / +8.5%
tpcds_q70/duckdb:parquet 21568472 / 16801637 / +28.4% 🔴 29160349 / 26678631 / +9.3% 0.74 / 0.63 / +17.4%
tpcds_q71/duckdb:parquet 18505828 / 15031560 / +23.1% 🔴 25071641 / 21677232 / +15.7% 🔴 0.74 / 0.69 / +6.4%
tpcds_q72/duckdb:parquet 62866290 / 81691326 / -23.0% 🟢 70331481 / 87588228 / -19.7% 🟢 0.89 / 0.93 / -4.2%
tpcds_q73/duckdb:parquet 16446882 / 13772924 / +19.4% 🔴 23446244 / 19297829 / +21.5% 🔴 0.70 / 0.71 / -1.7%
tpcds_q74/duckdb:parquet 94848078 / 100436380 / -5.6% 103670808 / 109971314 / -5.7% 0.91 / 0.91 / +0.2%
tpcds_q75/duckdb:parquet 48040528 / 40732178 / +17.9% 🔴 57343224 / 50135231 / +14.4% 🔴 0.84 / 0.81 / +3.1%
tpcds_q76/duckdb:parquet 20171904 / 14109778 / +43.0% 🔴 24448477 / 24284929 / +0.7% 0.83 / 0.58 / +42.0%
tpcds_q77/duckdb:parquet 26608429 / 17130981 / +55.3% 🔴 32401413 / 27986908 / +15.8% 🔴 0.82 / 0.61 / +34.2%
tpcds_q78/duckdb:parquet 83746649 / 48527172 / +72.6% 🔴 91327139 / 54340289 / +68.1% 🔴 0.92 / 0.89 / +2.7%
tpcds_q79/duckdb:parquet 24181700 / 21210280 / +14.0% 🔴 31962659 / 28635757 / +11.6% 🔴 0.76 / 0.74 / +2.1%
tpcds_q80/duckdb:parquet 40161162 / 33103297 / +21.3% 🔴 48292676 / 39716973 / +21.6% 🔴 0.83 / 0.83 / -0.2%
tpcds_q81/duckdb:parquet 45371901 / 31166525 / +45.6% 🔴 53354372 / 39565143 / +34.9% 🔴 0.85 / 0.79 / +8.0%
tpcds_q82/duckdb:parquet 15379150 / 12711915 / +21.0% 🔴 22695031 / 17522186 / +29.5% 🔴 0.68 / 0.73 / -6.6%
tpcds_q83/duckdb:parquet 22796308 / 16646226 / +36.9% 🔴 28790648 / 21535675 / +33.7% 🔴 0.79 / 0.77 / +2.4%
tpcds_q84/duckdb:parquet 27478468 / 18665523 / +47.2% 🔴 33332032 / 23897350 / +39.5% 🔴 0.82 / 0.78 / +5.5%
tpcds_q85/duckdb:parquet 36900782 / 35476000 / +4.0% 44558186 / 45145964 / -1.3% 0.83 / 0.79 / +5.4%
tpcds_q86/duckdb:parquet 13394292 / 11305670 / +18.5% 🔴 18993105 / 17047765 / +11.4% 🔴 0.71 / 0.66 / +6.3%
tpcds_q87/duckdb:parquet 34505886 / 28422697 / +21.4% 🔴 38494206 / 33354396 / +15.4% 🔴 0.90 / 0.85 / +5.2%
tpcds_q88/duckdb:parquet 42903740 / 27578428 / +55.6% 🔴 47557608 / 33065092 / +43.8% 🔴 0.90 / 0.83 / +8.2%
tpcds_q89/duckdb:parquet 15353288 / 12894110 / +19.1% 🔴 23372371 / 18651710 / +25.3% 🔴 0.66 / 0.69 / -5.0%
tpcds_q90/duckdb:parquet 11715338 / 7020338 / +66.9% 🔴 17598020 / 12984723 / +35.5% 🔴 0.67 / 0.54 / +23.1%
tpcds_q91/duckdb:parquet 27818432 / 21104766 / +31.8% 🔴 36035678 / 28418240 / +26.8% 🔴 0.77 / 0.74 / +3.9%
tpcds_q92/duckdb:parquet 19736314 / 14054076 / +40.4% 🔴 27201712 / 19522323 / +39.3% 🔴 0.73 / 0.72 / +0.8%
tpcds_q93/duckdb:parquet 15823631 / 21847620 / -27.6% 🟢 23270331 / 30335811 / -23.3% 🟢 0.68 / 0.72 / -5.6%
tpcds_q94/duckdb:parquet 37492998 / 16898198 / +121.9% 🔴 44603333 / 28470610 / +56.7% 🔴 0.84 / 0.59 / +41.6%
tpcds_q95/duckdb:parquet 47581450 / 90627895 / -47.5% 🟢 53277316 / 99103428 / -46.2% 🟢 0.89 / 0.91 / -2.3%
tpcds_q96/duckdb:parquet 9370277 / 7023016 / +33.4% 🔴 15304889 / 10965826 / +39.6% 🔴 0.61 / 0.64 / -4.4%
tpcds_q97/duckdb:parquet 31746554 / 25888218 / +22.6% 🔴 38589367 / 32404271 / +19.1% 🔴 0.82 / 0.80 / +3.0%
tpcds_q98/duckdb:parquet 18477392 / 16580331 / +11.4% 🔴 25660182 / 25485238 / +0.7% 0.72 / 0.65 / +10.7%
tpcds_q99/duckdb:parquet 20617340 / 17251199 / +19.5% 🔴 26424625 / 21541079 / +22.7% 🔴 0.78 / 0.80 / -2.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR eb261dbc vs base c1a2ca12
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.7%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-14.9%, environment too noisy confidence)
Vortex (geomean): hot 0.936x ➖ · cold 0.924x ➖
Parquet (geomean): hot 1.014x ➖ · cold 1.021x ➖
Shifts: Parquet (control) +1.4% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 90031289 / 91426433 / -1.5% 162564787 / 168519800 / -3.5% 0.55 / 0.54 / +2.1%
tpch_q02/datafusion:vortex-file-compressed 65355317 / 64723477 / +1.0% 97188904 / 97404502 / -0.2% 0.67 / 0.66 / +1.2%
tpch_q03/datafusion:vortex-file-compressed 64626150 / 64359796 / +0.4% 118008655 / 120074635 / -1.7% 0.55 / 0.54 / +2.2%
tpch_q04/datafusion:vortex-file-compressed 34790773 / 35631505 / -2.4% 77762575 / 80520909 / -3.4% 0.45 / 0.44 / +1.1%
tpch_q05/datafusion:vortex-file-compressed 115910991 / 118761799 / -2.4% 178844092 / 194311769 / -8.0% 0.65 / 0.61 / +6.0%
tpch_q06/datafusion:vortex-file-compressed 13817099 / 13826029 / -0.1% 69289553 / 72314804 / -4.2% 0.20 / 0.19 / +4.3%
tpch_q07/datafusion:vortex-file-compressed 139125438 / 138661301 / +0.3% 193011871 / 191018424 / +1.0% 0.72 / 0.73 / -0.7%
tpch_q08/datafusion:vortex-file-compressed 143659639 / 144881159 / -0.8% 204531156 / 216054835 / -5.3% 0.70 / 0.67 / +4.7%
tpch_q09/datafusion:vortex-file-compressed 179432632 / 182277513 / -1.6% 259232722 / 256364830 / +1.1% 0.69 / 0.71 / -2.6%
tpch_q10/datafusion:vortex-file-compressed 72687610 / 73610263 / -1.3% 139164457 / 144813542 / -3.9% 0.52 / 0.51 / +2.8%
tpch_q11/datafusion:vortex-file-compressed 42907881 / 43094314 / -0.4% 71694090 / 70048179 / +2.3% 0.60 / 0.62 / -2.7%
tpch_q12/datafusion:vortex-file-compressed 44681512 / 44047099 / +1.4% 93927439 / 98238748 / -4.4% 0.48 / 0.45 / +6.1%
tpch_q13/datafusion:vortex-file-compressed 43619767 / 43633751 / -0.0% 77453723 / 78502726 / -1.3% 0.56 / 0.56 / +1.3%
tpch_q14/datafusion:vortex-file-compressed 25089971 / 24273338 / +3.4% 99353500 / 95312362 / +4.2% 0.25 / 0.25 / -0.8%
tpch_q15/datafusion:vortex-file-compressed 36451014 / 36791705 / -0.9% 103362165 / 98527706 / +4.9% 0.35 / 0.37 / -5.6%
tpch_q16/datafusion:vortex-file-compressed 38320454 / 38041640 / +0.7% 67228372 / 66407490 / +1.2% 0.57 / 0.57 / -0.5%
tpch_q17/datafusion:vortex-file-compressed 171796352 / 174973790 / -1.8% 229347879 / 228089155 / +0.6% 0.75 / 0.77 / -2.4%
tpch_q18/datafusion:vortex-file-compressed 204718545 / 204140179 / +0.3% 259251212 / 266449981 / -2.7% 0.79 / 0.77 / +3.1%
tpch_q19/datafusion:vortex-file-compressed 34982111 / 35175295 / -0.5% 90539459 / 94383146 / -4.1% 0.39 / 0.37 / +3.7%
tpch_q20/datafusion:vortex-file-compressed 63517600 / 63017116 / +0.8% 127016677 / 128665477 / -1.3% 0.50 / 0.49 / +2.1%
tpch_q21/datafusion:vortex-file-compressed 179626760 / 180730652 / -0.6% 245532118 / 247511155 / -0.8% 0.73 / 0.73 / +0.2%
tpch_q22/datafusion:vortex-file-compressed 25514185 / 25603644 / -0.3% 53126484 / 52281021 / +1.6% 0.48 / 0.49 / -1.9%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 86144707 / 86833562 / -0.8% 129963761 / 143771450 / -9.6% 0.66 / 0.60 / +9.7%
tpch_q02/datafusion:parquet 158913254 / 158708777 / +0.1% 186635117 / 188337247 / -0.9% 0.85 / 0.84 / +1.0%
tpch_q03/datafusion:parquet 142493461 / 144074196 / -1.1% 190708218 / 200486396 / -4.9% 0.75 / 0.72 / +4.0%
tpch_q04/datafusion:parquet 59555116 / 59786448 / -0.4% 100615572 / 99757318 / +0.9% 0.59 / 0.60 / -1.2%
tpch_q05/datafusion:parquet 180218017 / 181567425 / -0.7% 241794765 / 244562702 / -1.1% 0.75 / 0.74 / +0.4%
tpch_q06/datafusion:parquet 35341041 / 35318708 / +0.1% 76455672 / 85946825 / -11.0% 🟢 0.46 / 0.41 / +12.5%
tpch_q07/datafusion:parquet 232244200 / 230893337 / +0.6% 300983186 / 302313297 / -0.4% 0.77 / 0.76 / +1.0%
tpch_q08/datafusion:parquet 234744050 / 235889411 / -0.5% 303532000 / 308014567 / -1.5% 0.77 / 0.77 / +1.0%
tpch_q09/datafusion:parquet 315847433 / 313921886 / +0.6% 380147767 / 392134962 / -3.1% 0.83 / 0.80 / +3.8%
tpch_q10/datafusion:parquet 407811431 / 406278057 / +0.4% 466612978 / 464810761 / +0.4% 0.87 / 0.87 / -0.0%
tpch_q11/datafusion:parquet 106105023 / 105631804 / +0.4% 129819387 / 130332825 / -0.4% 0.82 / 0.81 / +0.8%
tpch_q12/datafusion:parquet 84582492 / 85606919 / -1.2% 127965345 / 132181372 / -3.2% 0.66 / 0.65 / +2.1%
tpch_q13/datafusion:parquet 227408257 / 227883057 / -0.2% 259102447 / 260132131 / -0.4% 0.88 / 0.88 / +0.2%
tpch_q14/datafusion:parquet 89255197 / 90121745 / -1.0% 194960331 / 196539418 / -0.8% 0.46 / 0.46 / -0.2%
tpch_q15/datafusion:parquet 90701561 / 91583924 / -1.0% 140683809 / 147656625 / -4.7% 0.64 / 0.62 / +3.9%
tpch_q16/datafusion:parquet 95328112 / 95047090 / +0.3% 124121874 / 124222406 / -0.1% 0.77 / 0.77 / +0.4%
tpch_q17/datafusion:parquet 214384818 / 216817170 / -1.1% 268422341 / 275683333 / -2.6% 0.80 / 0.79 / +1.6%
tpch_q18/datafusion:parquet 292566992 / 291722490 / +0.3% 328510488 / 332653579 / -1.2% 0.89 / 0.88 / +1.6%
tpch_q19/datafusion:parquet 110516180 / 109400783 / +1.0% 174087523 / 175948919 / -1.1% 0.63 / 0.62 / +2.1%
tpch_q20/datafusion:parquet 183660059 / 186764279 / -1.7% 244076992 / 251255479 / -2.9% 0.75 / 0.74 / +1.2%
tpch_q21/datafusion:parquet 244472318 / 245674815 / -0.5% 316104749 / 320814042 / -1.5% 0.77 / 0.77 / +1.0%
tpch_q22/datafusion:parquet 199013270 / 199973429 / -0.5% 225476074 / 221411489 / +1.8% 0.88 / 0.90 / -2.3%
duckdb / vortex-file-compressed / ns (0.878x ✅, 9↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 42699885 / 53928506 / -20.8% 🟢 83674919 / 110215208 / -24.1% 🟢 0.51 / 0.49 / +4.3%
tpch_q02/duckdb:vortex-file-compressed 29412123 / 31338408 / -6.1% 44728738 / 50267679 / -11.0% 🟢 0.66 / 0.62 / +5.5%
tpch_q03/duckdb:vortex-file-compressed 59860593 / 57684623 / +3.8% 112130427 / 113610746 / -1.3% 0.53 / 0.51 / +5.1%
tpch_q04/duckdb:vortex-file-compressed 54308255 / 82139200 / -33.9% 🟢 94640036 / 129608388 / -27.0% 🟢 0.57 / 0.63 / -9.5%
tpch_q05/duckdb:vortex-file-compressed 74380829 / 66116286 / +12.5% 🔴 120814526 / 127597996 / -5.3% 0.62 / 0.52 / +18.8%
tpch_q06/duckdb:vortex-file-compressed 19354818 / 20022685 / -3.3% 63860227 / 69066401 / -7.5% 0.30 / 0.29 / +4.5%
tpch_q07/duckdb:vortex-file-compressed 61189252 / 59906692 / +2.1% 126199002 / 136232963 / -7.4% 0.48 / 0.44 / +10.3%
tpch_q08/duckdb:vortex-file-compressed 89158567 / 83750947 / +6.5% 141219972 / 153124409 / -7.8% 0.63 / 0.55 / +15.4%
tpch_q09/duckdb:vortex-file-compressed 108984279 / 163598197 / -33.4% 🟢 173851613 / 238379552 / -27.1% 🟢 0.63 / 0.69 / -8.7%
tpch_q10/duckdb:vortex-file-compressed 102243992 / 112043615 / -8.7% 149186893 / 173183311 / -13.9% 🟢 0.69 / 0.65 / +5.9%
tpch_q11/duckdb:vortex-file-compressed 14924893 / 17482615 / -14.6% 🟢 27473028 / 36106584 / -23.9% 🟢 0.54 / 0.48 / +12.2%
tpch_q12/duckdb:vortex-file-compressed 56561211 / 53678925 / +5.4% 106477803 / 104722177 / +1.7% 0.53 / 0.51 / +3.6%
tpch_q13/duckdb:vortex-file-compressed 78750389 / 81111859 / -2.9% 105543453 / 135219214 / -21.9% 🟢 0.75 / 0.60 / +24.4%
tpch_q14/duckdb:vortex-file-compressed 30960539 / 29494967 / +5.0% 79062946 / 75859013 / +4.2% 0.39 / 0.39 / +0.7%
tpch_q15/duckdb:vortex-file-compressed 26443346 / 36536319 / -27.6% 🟢 72407486 / 86907716 / -16.7% 🟢 0.37 / 0.42 / -13.1%
tpch_q16/duckdb:vortex-file-compressed 53304637 / 41565844 / +28.2% 🔴 63140049 / 53796075 / +17.4% 🔴 0.84 / 0.77 / +9.3%
tpch_q17/duckdb:vortex-file-compressed 42279277 / 55664829 / -24.0% 🟢 81964424 / 103595665 / -20.9% 🟢 0.52 / 0.54 / -4.0%
tpch_q18/duckdb:vortex-file-compressed 103594578 / 126028999 / -17.8% 🟢 134087158 / 160100887 / -16.2% 🟢 0.77 / 0.79 / -1.9%
tpch_q19/duckdb:vortex-file-compressed 32014744 / 42495994 / -24.7% 🟢 87304248 / 101303309 / -13.8% 🟢 0.37 / 0.42 / -12.6%
tpch_q20/duckdb:vortex-file-compressed 51011161 / 55062844 / -7.4% 107741336 / 121341227 / -11.2% 🟢 0.47 / 0.45 / +4.3%
tpch_q21/duckdb:vortex-file-compressed 108620350 / 245398321 / -55.7% 🟢 157058786 / 294005558 / -46.6% 🟢 0.69 / 0.83 / -17.1%
tpch_q22/duckdb:vortex-file-compressed 36351696 / 38261738 / -5.0% 56149459 / 52693775 / +6.6% 0.65 / 0.73 / -10.8%
duckdb / parquet / ns (1.031x ➖, 3↑ 11↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 69192879 / 71963054 / -3.8% 92858357 / 88829001 / +4.5% 0.75 / 0.81 / -8.0%
tpch_q02/duckdb:parquet 82538399 / 80642140 / +2.4% 94203421 / 91255350 / +3.2% 0.88 / 0.88 / -0.9%
tpch_q03/duckdb:parquet 120704487 / 121719270 / -0.8% 158687191 / 156509459 / +1.4% 0.76 / 0.78 / -2.2%
tpch_q04/duckdb:parquet 85017251 / 75558863 / +12.5% 🔴 112377015 / 103722354 / +8.3% 0.76 / 0.73 / +3.9%
tpch_q05/duckdb:parquet 145595721 / 128992310 / +12.9% 🔴 179332713 / 180160264 / -0.5% 0.81 / 0.72 / +13.4%
tpch_q06/duckdb:parquet 34890392 / 33431810 / +4.4% 61711863 / 50156305 / +23.0% 🔴 0.57 / 0.67 / -15.2%
tpch_q07/duckdb:parquet 114515253 / 93056077 / +23.1% 🔴 152543109 / 132786660 / +14.9% 🔴 0.75 / 0.70 / +7.1%
tpch_q08/duckdb:parquet 171751308 / 149777116 / +14.7% 🔴 216790327 / 194765481 / +11.3% 🔴 0.79 / 0.77 / +3.0%
tpch_q09/duckdb:parquet 273096207 / 230128402 / +18.7% 🔴 323424408 / 268194753 / +20.6% 🔴 0.84 / 0.86 / -1.6%
tpch_q10/duckdb:parquet 543917648 / 514358167 / +5.7% 581673080 / 548412555 / +6.1% 0.94 / 0.94 / -0.3%
tpch_q11/duckdb:parquet 38361466 / 33613480 / +14.1% 🔴 46709195 / 38733601 / +20.6% 🔴 0.82 / 0.87 / -5.4%
tpch_q12/duckdb:parquet 75244253 / 75366779 / -0.2% 101773166 / 90538229 / +12.4% 🔴 0.74 / 0.83 / -11.2%
tpch_q13/duckdb:parquet 357878336 / 324478658 / +10.3% 🔴 378007976 / 336492159 / +12.3% 🔴 0.95 / 0.96 / -1.8%
tpch_q14/duckdb:parquet 118186088 / 110072795 / +7.4% 159442151 / 142404050 / +12.0% 🔴 0.74 / 0.77 / -4.1%
tpch_q15/duckdb:parquet 63444301 / 50186505 / +26.4% 🔴 92874441 / 68386073 / +35.8% 🔴 0.68 / 0.73 / -6.9%
tpch_q16/duckdb:parquet 114939797 / 118366786 / -2.9% 123104983 / 128869637 / -4.5% 0.93 / 0.92 / +1.7%
tpch_q17/duckdb:parquet 99604135 / 82378234 / +20.9% 🔴 133996619 / 110121430 / +21.7% 🔴 0.74 / 0.75 / -0.6%
tpch_q18/duckdb:parquet 173128072 / 213056079 / -18.7% 🟢 189842752 / 181035041 / +4.9% 0.91 / 1.18 / -22.5%
tpch_q19/duckdb:parquet 106486639 / 164597287 / -35.3% 🟢 143920861 / 197615449 / -27.2% 🟢 0.74 / 0.83 / -11.2%
tpch_q20/duckdb:parquet 166876217 / 136002978 / +22.7% 🔴 209169622 / 181699284 / +15.1% 🔴 0.80 / 0.75 / +6.6%
tpch_q21/duckdb:parquet 163986751 / 272953451 / -39.9% 🟢 195981791 / 300669177 / -34.8% 🟢 0.84 / 0.91 / -7.8%
tpch_q22/duckdb:parquet 297600332 / 267640222 / +11.2% 🔴 313154866 / 278487492 / +12.4% 🔴 0.95 / 0.96 / -1.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR eb261dbc vs base c087cd96
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +9.5%
Engines: DataFusion No clear signal (-11.5%, environment too noisy confidence) · DuckDB No clear signal (+35.5%, environment too noisy confidence)
Vortex (geomean): hot 0.990x ➖ · cold 1.040x ➖
Parquet (geomean): hot 0.904x ➖ · cold 0.871x ➖
Shifts: Parquet (control) -9.6% · Median polish +2.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.107x ➖, 1↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 229532554 / 229597048 / -0.0% 951443803 / 801894189 / +18.6% 0.24 / 0.29 / -15.7%
tpch_q02/datafusion:vortex-file-compressed 397399141 / 495658208 / -19.8% 712736288 / 907360321 / -21.4% 0.56 / 0.55 / +2.1%
tpch_q03/datafusion:vortex-file-compressed 447869074 / 356824958 / +25.5% 1162374881 / 1347894866 / -13.8% 0.39 / 0.26 / +45.5%
tpch_q04/datafusion:vortex-file-compressed 279491236 / 206230440 / +35.5% 🔴 641293960 / 426483980 / +50.4% 🔴 0.44 / 0.48 / -9.9%
tpch_q05/datafusion:vortex-file-compressed 486928738 / 418014335 / +16.5% 782528036 / 669626535 / +16.9% 0.62 / 0.62 / -0.3%
tpch_q06/datafusion:vortex-file-compressed 416420889 / 270378420 / +54.0% 🔴 535666838 / 471955103 / +13.5% 0.78 / 0.57 / +35.7%
tpch_q07/datafusion:vortex-file-compressed 421618692 / 481065149 / -12.4% 534670188 / 626339454 / -14.6% 0.79 / 0.77 / +2.7%
tpch_q08/datafusion:vortex-file-compressed 681373574 / 491171945 / +38.7% 🔴 763834559 / 638687450 / +19.6% 0.89 / 0.77 / +16.0%
tpch_q09/datafusion:vortex-file-compressed 547197001 / 463332427 / +18.1% 805669419 / 1036368564 / -22.3% 0.68 / 0.45 / +51.9%
tpch_q10/datafusion:vortex-file-compressed 469584690 / 391543230 / +19.9% 718220883 / 540568244 / +32.9% 🔴 0.65 / 0.72 / -9.7%
tpch_q11/datafusion:vortex-file-compressed 379219114 / 284525570 / +33.3% 🔴 538702247 / 446618180 / +20.6% 0.70 / 0.64 / +10.5%
tpch_q12/datafusion:vortex-file-compressed 331444524 / 369419654 / -10.3% 622467757 / 614630720 / +1.3% 0.53 / 0.60 / -11.4%
tpch_q13/datafusion:vortex-file-compressed 149608789 / 141405974 / +5.8% 440110526 / 383393325 / +14.8% 0.34 / 0.37 / -7.8%
tpch_q14/datafusion:vortex-file-compressed 200438698 / 214803784 / -6.7% 336772669 / 370215770 / -9.0% 0.60 / 0.58 / +2.6%
tpch_q15/datafusion:vortex-file-compressed 1028006306 / 372402539 / +176.0% 🔴 2595921536 / 533151811 / +386.9% 🔴 0.40 / 0.70 / -43.3%
tpch_q16/datafusion:vortex-file-compressed 228278197 / 243566938 / -6.3% 433558996 / 330708020 / +31.1% 🔴 0.53 / 0.74 / -28.5%
tpch_q17/datafusion:vortex-file-compressed 554245513 / 601503404 / -7.9% 1039346920 / 563153212 / +84.6% 🔴 0.53 / 1.07 / -50.1%
tpch_q18/datafusion:vortex-file-compressed 290232168 / 886795301 / -67.3% 🟢 482407757 / 541132805 / -10.9% 0.60 / 1.64 / -63.3%
tpch_q19/datafusion:vortex-file-compressed 690920119 / 430509908 / +60.5% 🔴 905540850 / 580126546 / +56.1% 🔴 0.76 / 0.74 / +2.8%
tpch_q20/datafusion:vortex-file-compressed 368786456 / 350169497 / +5.3% 497540885 / 503951100 / -1.3% 0.74 / 0.69 / +6.7%
tpch_q21/datafusion:vortex-file-compressed 697841319 / 544331856 / +28.2% 1047417294 / 635675675 / +64.8% 🔴 0.67 / 0.86 / -22.2%
tpch_q22/datafusion:vortex-file-compressed 195749876 / 174561886 / +12.1% 531379220 / 368324168 / +44.3% 🔴 0.37 / 0.47 / -22.3%
datafusion / parquet / ns (1.251x ➖, 0↑ 9↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 180406928 / 158261059 / +14.0% 465340409 / 452234862 / +2.9% 0.39 / 0.35 / +10.8%
tpch_q02/datafusion:parquet 293245978 / 330211978 / -11.2% 595188450 / 1234411126 / -51.8% 🟢 0.49 / 0.27 / +84.2%
tpch_q03/datafusion:parquet 299301979 / 238986207 / +25.2% 706672066 / 647889724 / +9.1% 0.42 / 0.37 / +14.8%
tpch_q04/datafusion:parquet 222947526 / 183315720 / +21.6% 478409747 / 382066823 / +25.2% 0.47 / 0.48 / -2.9%
tpch_q05/datafusion:parquet 457474375 / 345992656 / +32.2% 🔴 519694402 / 447401665 / +16.2% 0.88 / 0.77 / +13.8%
tpch_q06/datafusion:parquet 167190631 / 114084176 / +46.6% 🔴 361987582 / 238781339 / +51.6% 🔴 0.46 / 0.48 / -3.3%
tpch_q07/datafusion:parquet 451471960 / 337123072 / +33.9% 🔴 525563873 / 477204221 / +10.1% 0.86 / 0.71 / +21.6%
tpch_q08/datafusion:parquet 713085123 / 406070650 / +75.6% 🔴 834129924 / 517159826 / +61.3% 🔴 0.85 / 0.79 / +8.9%
tpch_q09/datafusion:parquet 501686724 / 409198141 / +22.6% 623413892 / 610334933 / +2.1% 0.80 / 0.67 / +20.0%
tpch_q10/datafusion:parquet 431797723 / 319370760 / +35.2% 🔴 576854370 / 448667737 / +28.6% 0.75 / 0.71 / +5.2%
tpch_q11/datafusion:parquet 289465301 / 258834776 / +11.8% 535222139 / 407848172 / +31.2% 🔴 0.54 / 0.63 / -14.8%
tpch_q12/datafusion:parquet 214467497 / 173140363 / +23.9% 445877797 / 299471714 / +48.9% 🔴 0.48 / 0.58 / -16.8%
tpch_q13/datafusion:parquet 371458041 / 361143296 / +2.9% 453048953 / 540497083 / -16.2% 0.82 / 0.67 / +22.7%
tpch_q14/datafusion:parquet 208008465 / 190925542 / +8.9% 301687278 / 319121126 / -5.5% 0.69 / 0.60 / +15.2%
tpch_q15/datafusion:parquet 356905816 / 298889850 / +19.4% 491532172 / 493747955 / -0.4% 0.73 / 0.61 / +19.9%
tpch_q16/datafusion:parquet 117493795 / 120806611 / -2.7% 319587896 / 262411422 / +21.8% 0.37 / 0.46 / -20.1%
tpch_q17/datafusion:parquet 381316448 / 316012632 / +20.7% 503736791 / 472125185 / +6.7% 0.76 / 0.67 / +13.1%
tpch_q18/datafusion:parquet 479684155 / 354063308 / +35.5% 🔴 786303073 / 546660845 / +43.8% 🔴 0.61 / 0.65 / -5.8%
tpch_q19/datafusion:parquet 248386683 / 178994766 / +38.8% 🔴 387265474 / 318016401 / +21.8% 0.64 / 0.56 / +14.0%
tpch_q20/datafusion:parquet 315537202 / 267732590 / +17.9% 396208734 / 517474373 / -23.4% 0.80 / 0.52 / +53.9%
tpch_q21/datafusion:parquet 554148253 / 305732238 / +81.3% 🔴 1146033132 / 431686055 / +165.5% 🔴 0.48 / 0.71 / -31.7%
tpch_q22/datafusion:parquet 208002915 / 153528027 / +35.5% 🔴 489083230 / 334246528 / +46.3% 🔴 0.43 / 0.46 / -7.4%
duckdb / vortex-file-compressed / ns (0.885x ➖, 5↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 234423943 / 240040920 / -2.3% 427414406 / 492330766 / -13.2% 0.55 / 0.49 / +12.5%
tpch_q02/duckdb:vortex-file-compressed 328614485 / 474244003 / -30.7% 🟢 361221557 / 508145475 / -28.9% 0.91 / 0.93 / -2.5%
tpch_q03/duckdb:vortex-file-compressed 520738970 / 482350443 / +8.0% 509760599 / 536048502 / -4.9% 1.02 / 0.90 / +13.5%
tpch_q04/duckdb:vortex-file-compressed 337855447 / 338955161 / -0.3% 335061806 / 432058755 / -22.4% 1.01 / 0.78 / +28.5%
tpch_q05/duckdb:vortex-file-compressed 461201322 / 496482085 / -7.1% 582365084 / 670984129 / -13.2% 0.79 / 0.74 / +7.0%
tpch_q06/duckdb:vortex-file-compressed 317972640 / 328082450 / -3.1% 351628360 / 329645420 / +6.7% 0.90 / 1.00 / -9.1%
tpch_q07/duckdb:vortex-file-compressed 351921463 / 521289082 / -32.5% 🟢 444780985 / 624051045 / -28.7% 0.79 / 0.84 / -5.3%
tpch_q08/duckdb:vortex-file-compressed 556859131 / 609292369 / -8.6% 459392388 / 636780712 / -27.9% 1.21 / 0.96 / +26.7%
tpch_q09/duckdb:vortex-file-compressed 694367615 / 483703881 / +43.6% 🔴 555109734 / 485099571 / +14.4% 1.25 / 1.00 / +25.4%
tpch_q10/duckdb:vortex-file-compressed 471863632 / 479139623 / -1.5% 570653143 / 606429825 / -5.9% 0.83 / 0.79 / +4.7%
tpch_q11/duckdb:vortex-file-compressed 186294158 / 191101981 / -2.5% 201250434 / 237821132 / -15.4% 0.93 / 0.80 / +15.2%
tpch_q12/duckdb:vortex-file-compressed 584867265 / 580403599 / +0.8% 625904729 / 499126439 / +25.4% 0.93 / 1.16 / -19.6%
tpch_q13/duckdb:vortex-file-compressed 172237528 / 328289821 / -47.5% 🟢 336112752 / 386940966 / -13.1% 0.51 / 0.85 / -39.6%
tpch_q14/duckdb:vortex-file-compressed 182257017 / 302048195 / -39.7% 🟢 230977242 / 390590205 / -40.9% 🟢 0.79 / 0.77 / +2.0%
tpch_q15/duckdb:vortex-file-compressed 188017935 / 187875909 / +0.1% 232471777 / 266586990 / -12.8% 0.81 / 0.70 / +14.8%
tpch_q16/duckdb:vortex-file-compressed 164166242 / 212978538 / -22.9% 155261314 / 269017574 / -42.3% 🟢 1.06 / 0.79 / +33.6%
tpch_q17/duckdb:vortex-file-compressed 304486693 / 570131320 / -46.6% 🟢 389073185 / 599649880 / -35.1% 🟢 0.78 / 0.95 / -17.7%
tpch_q18/duckdb:vortex-file-compressed 288934191 / 331907778 / -12.9% 359866388 / 358773168 / +0.3% 0.80 / 0.93 / -13.2%
tpch_q19/duckdb:vortex-file-compressed 420326121 / 346823307 / +21.2% 496278837 / 507693149 / -2.2% 0.85 / 0.68 / +24.0%
tpch_q20/duckdb:vortex-file-compressed 392275749 / 452488904 / -13.3% 505525146 / 522834841 / -3.3% 0.78 / 0.87 / -10.3%
tpch_q21/duckdb:vortex-file-compressed 713142747 / 718756232 / -0.8% 651508608 / 754046243 / -13.6% 1.09 / 0.95 / +14.8%
tpch_q22/duckdb:vortex-file-compressed 189860489 / 185770399 / +2.2% 418085712 / 206971213 / +102.0% 🔴 0.45 / 0.90 / -49.4%
duckdb / parquet / ns (0.653x ✅, 15↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 268982929 / 285178124 / -5.7% 352031385 / 514237728 / -31.5% 🟢 0.76 / 0.55 / +37.8%
tpch_q02/duckdb:parquet 355401783 / 677343388 / -47.5% 🟢 391481426 / 987498791 / -60.4% 🟢 0.91 / 0.69 / +32.4%
tpch_q03/duckdb:parquet 388787867 / 777729485 / -50.0% 🟢 447636567 / 869347389 / -48.5% 🟢 0.87 / 0.89 / -2.9%
tpch_q04/duckdb:parquet 292173945 / 437185104 / -33.2% 🟢 423094594 / 601310574 / -29.6% 0.69 / 0.73 / -5.0%
tpch_q05/duckdb:parquet 693255636 / 871493317 / -20.5% 667646738 / 862239451 / -22.6% 1.04 / 1.01 / +2.7%
tpch_q06/duckdb:parquet 228029187 / 383060580 / -40.5% 🟢 197452140 / 313789442 / -37.1% 🟢 1.15 / 1.22 / -5.4%
tpch_q07/duckdb:parquet 490846462 / 831996599 / -41.0% 🟢 490172830 / 824018707 / -40.5% 🟢 1.00 / 1.01 / -0.8%
tpch_q08/duckdb:parquet 646286830 / 1002233341 / -35.5% 🟢 703865090 / 1060322454 / -33.6% 🟢 0.92 / 0.95 / -2.9%
tpch_q09/duckdb:parquet 720694256 / 1026839227 / -29.8% 632043559 / 1189304899 / -46.9% 🟢 1.14 / 0.86 / +32.1%
tpch_q10/duckdb:parquet 561673859 / 935785005 / -40.0% 🟢 587039497 / 948407925 / -38.1% 🟢 0.96 / 0.99 / -3.0%
tpch_q11/duckdb:parquet 210276467 / 434759450 / -51.6% 🟢 235033217 / 428194569 / -45.1% 🟢 0.89 / 1.02 / -11.9%
tpch_q12/duckdb:parquet 324885834 / 551678352 / -41.1% 🟢 366173650 / 736890241 / -50.3% 🟢 0.89 / 0.75 / +18.5%
tpch_q13/duckdb:parquet 493026057 / 687290658 / -28.3% 576039882 / 765139519 / -24.7% 0.86 / 0.90 / -4.7%
tpch_q14/duckdb:parquet 298638468 / 485633628 / -38.5% 🟢 338415090 / 561663630 / -39.7% 🟢 0.88 / 0.86 / +2.1%
tpch_q15/duckdb:parquet 233445057 / 346503455 / -32.6% 🟢 262785340 / 404818701 / -35.1% 🟢 0.89 / 0.86 / +3.8%
tpch_q16/duckdb:parquet 286573733 / 507296208 / -43.5% 🟢 398440402 / 827035148 / -51.8% 🟢 0.72 / 0.61 / +17.3%
tpch_q17/duckdb:parquet 448865440 / 455587003 / -1.5% 654704232 / 439338040 / +49.0% 🔴 0.69 / 1.04 / -33.9%
tpch_q18/duckdb:parquet 391288202 / 592386880 / -33.9% 🟢 488610704 / 575244592 / -15.1% 0.80 / 1.03 / -22.2%
tpch_q19/duckdb:parquet 321089152 / 534671976 / -39.9% 🟢 381867998 / 556822984 / -31.4% 🟢 0.84 / 0.96 / -12.4%
tpch_q20/duckdb:parquet 531093721 / 872331612 / -39.1% 🟢 618096195 / 935817759 / -34.0% 🟢 0.86 / 0.93 / -7.8%
tpch_q21/duckdb:parquet 545598207 / 708415505 / -23.0% 503149233 / 716654113 / -29.8% 1.08 / 0.99 / +9.7%
tpch_q22/duckdb:parquet 320864490 / 413734953 / -22.4% 315245095 / 394680840 / -20.1% 1.02 / 1.05 / -2.9%

Regenerated with the sqllogictest runner's --complete against DuckDB
8588363b. The plan changes come from DuckDB's optimizer (for example avg
is no longer rewritten to sum/count, and duplicate pushed-down scan
filters are deduplicated); the set of Vortex scans and pushed-down
filters is unchanged. TPC-DS q9's last bucket differs by one unit in the
16th significant digit on both Parquet and Vortex, from a change in
DuckDB's floating-point summation order.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_013h1DozjdAzpYiyEykgbhPi
Signed-off-by: Claude <noreply@anthropic.com>

This branch was successfully deployed

1 active (outdated) deployment
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants