Skip to content

deser array tree from a vortex array#8063

Open
onursatici wants to merge 1 commit into
developfrom
os/array-serialise-columnar
Open

deser array tree from a vortex array#8063
onursatici wants to merge 1 commit into
developfrom
os/array-serialise-columnar

Conversation

@onursatici

Copy link
Copy Markdown
Contributor

Summary

Add support for serialising a ArrayNode tree into a vortex array, with array stats. Before we always serialised these into flatbuffers that were appended to the tail of the serialised array buffers. This PR adds the scaffolding to get a vortex array that can later at read time used to deserialise the buffers into ArrayRef's.

Main user of this would be the array tree layout, which will land in a followup PR

@onursatici
onursatici requested a review from joseph-isaacs May 22, 2026 13:32
@codspeed-hq

codspeed-hq Bot commented May 22, 2026

Copy link
Copy Markdown

Merging this PR will improve performance by 30.52%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 15 improved benchmarks
❌ 2 regressed benchmarks
✅ 1528 untouched benchmarks
⏩ 10 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation decompress_rd[f64, (100000, 0.01)] 845.4 µs 980.6 µs -13.79%
Simulation decompress_rd[f64, (100000, 0.1)] 845.4 µs 980.6 µs -13.78%
Simulation bitwise_and_vortex_buffer[65536] 24.4 µs 15.2 µs +60.66%
Simulation bitwise_or_vortex_buffer[65536] 24.3 µs 15.2 µs +59.85%
Simulation bitwise_and_vortex_buffer[2048] 4.4 µs 3 µs +48.83%
Simulation bitwise_and_vortex_buffer[16384] 10 µs 6.8 µs +47.21%
Simulation bitwise_and_vortex_buffer[1024] 4.1 µs 2.8 µs +46.02%
Simulation bitwise_or_vortex_buffer[16384] 10 µs 6.9 µs +45.75%
Simulation bitwise_or_vortex_buffer[2048] 4.4 µs 3 µs +44.03%
Simulation bitwise_or_vortex_buffer[1024] 4 µs 2.8 µs +43.95%
Simulation bitwise_and_vortex_buffer[128] 4.8 µs 3.5 µs +37.79%
Simulation bitwise_or_vortex_buffer[128] 4.7 µs 3.5 µs +35.81%
Simulation bitwise_not_vortex_buffer_mut[128] 244.4 ns 186.1 ns +31.34%
Simulation bitwise_not_vortex_buffer_mut[1024] 304.7 ns 246.4 ns +23.68%
Simulation decompress_rd[f64, (100000, 0.0)] 1,024.1 µs 844.9 µs +21.2%
Simulation decompress_rd[f32, (100000, 0.0)] 586.5 µs 498.4 µs +17.67%
Simulation bitwise_not_vortex_buffer_mut[2048] 427.8 ns 369.4 ns +15.79%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing os/array-serialise-columnar (eb11f18) with develop (fb5cbbe)2

Open in CodSpeed

Footnotes

  1. 10 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. No successful run was found on develop (9b5447a) during the generation of this report, so fb5cbbe was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

@onursatici
onursatici force-pushed the os/array-serialise-columnar branch from 93e517d to 3257531 Compare May 28, 2026 14:16
@onursatici
onursatici force-pushed the os/layout-overrides branch from 906945c to 34bf8aa Compare June 2, 2026 13:09
@onursatici
onursatici force-pushed the os/array-serialise-columnar branch from 3257531 to 3c34669 Compare June 2, 2026 13:12
Base automatically changed from os/layout-overrides to develop June 2, 2026 13:21
@onursatici
onursatici force-pushed the os/array-serialise-columnar branch from 3c34669 to c33a177 Compare June 2, 2026 13:29
@onursatici
onursatici force-pushed the os/array-serialise-columnar branch from c33a177 to e40b94f Compare June 2, 2026 13:57
@onursatici onursatici added the changelog/feature A new feature label Jun 2, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jun 9, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 9, 2026
Comment thread vortex-array/src/serde/columnar.rs Outdated
/// `fba::ArrayStats`. Binary columns hold `ScalarValue::to_proto_bytes` blobs (decoded
/// using the array's dtype at read time); the `*_exact` bools tag whether `min`/`max`
/// were exact. `sum` is exact-only by construction so there is no `sum_exact` column.
pub static STATS_COLUMNS_DTYPE: LazyLock<DType> = LazyLock::new(|| {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is soon doing to be a extensible scalar (that is from the agg partial).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you import

@joseph-isaacs joseph-isaacs left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My main question is about the hard coded stat serde

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done e40b94f 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.6%
Engines: DataFusion No clear signal (+1.2%, low confidence) · DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): 1.014x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.018x ➖, 0↑ 1↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6545898 4826540 1.36
fineweb_q01/datafusion:vortex-file-compressed 33648170 34945719 0.96
fineweb_q02/datafusion:vortex-file-compressed 36214959 38251437 0.95
fineweb_q03/datafusion:vortex-file-compressed 62274090 57819391 1.08
fineweb_q04/datafusion:vortex-file-compressed 282124337 274561473 1.03
fineweb_q05/datafusion:vortex-file-compressed 219419398 223027297 0.98
fineweb_q06/datafusion:vortex-file-compressed 48864968 49339305 0.99
fineweb_q07/datafusion:vortex-file-compressed 52810470 56179044 0.94
fineweb_q08/datafusion:vortex-file-compressed 20694954 22025544 0.94
datafusion / vortex-compact (0.992x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5592153 5322727 1.05
fineweb_q01/datafusion:vortex-compact 94733404 98913150 0.96
fineweb_q02/datafusion:vortex-compact 104320271 103022685 1.01
fineweb_q03/datafusion:vortex-compact 876325334 872328144 1.00
fineweb_q04/datafusion:vortex-compact 909835546 918813196 0.99
fineweb_q05/datafusion:vortex-compact 823477341 831053123 0.99
fineweb_q06/datafusion:vortex-compact 470231310 465453639 1.01
fineweb_q07/datafusion:vortex-compact 481601266 483955870 1.00
fineweb_q08/datafusion:vortex-compact 20021145 21800985 0.92
datafusion / parquet (0.993x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6431213 6824818 0.94
fineweb_q01/datafusion:parquet 284052621 301604652 0.94
fineweb_q02/datafusion:parquet 295936983 297577428 0.99
fineweb_q03/datafusion:parquet 295719341 288150687 1.03
fineweb_q04/datafusion:parquet 303428459 302299546 1.00
fineweb_q05/datafusion:parquet 301684495 296388885 1.02
fineweb_q06/datafusion:parquet 290314861 301704042 0.96
fineweb_q07/datafusion:parquet 283890239 275932597 1.03
fineweb_q08/datafusion:parquet 281665866 276026863 1.02
duckdb / vortex-file-compressed (1.033x ➖, 0↑ 1↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3622950 3558024 1.02
fineweb_q01/duckdb:vortex-file-compressed 33762886 33926524 1.00
fineweb_q02/duckdb:vortex-file-compressed 39201390 38142731 1.03
fineweb_q03/duckdb:vortex-file-compressed 🚨 162101095 127042907 1.28
fineweb_q04/duckdb:vortex-file-compressed 268448982 266305793 1.01
fineweb_q05/duckdb:vortex-file-compressed 212390149 217624753 0.98
fineweb_q06/duckdb:vortex-file-compressed 51164107 53170836 0.96
fineweb_q07/duckdb:vortex-file-compressed 55659145 53351423 1.04
fineweb_q08/duckdb:vortex-file-compressed 23648501 23084391 1.02
duckdb / vortex-compact (1.014x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4223233 4144150 1.02
fineweb_q01/duckdb:vortex-compact 104638368 103474051 1.01
fineweb_q02/duckdb:vortex-compact 115633130 113826859 1.02
fineweb_q03/duckdb:vortex-compact 866317448 852311686 1.02
fineweb_q04/duckdb:vortex-compact 898223525 896384725 1.00
fineweb_q05/duckdb:vortex-compact 800004257 807554140 0.99
fineweb_q06/duckdb:vortex-compact 463213964 460885504 1.01
fineweb_q07/duckdb:vortex-compact 482605290 477637835 1.01
fineweb_q08/duckdb:vortex-compact 19904584 18855704 1.06
duckdb / parquet (1.005x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30083719 31060527 0.97
fineweb_q01/duckdb:parquet 85462156 83544947 1.02
fineweb_q02/duckdb:parquet 85530509 84910636 1.01
fineweb_q03/duckdb:parquet 318023635 314223169 1.01
fineweb_q04/duckdb:parquet 448977789 446598601 1.01
fineweb_q05/duckdb:parquet 415721268 413580845 1.01
fineweb_q06/duckdb:parquet 206101880 202870507 1.02
fineweb_q07/duckdb:parquet 216062158 215241939 1.00
fineweb_q08/duckdb:parquet 32771226 32634214 1.00

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +184.34 KB +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +5.1% -4.5% +10.0% +51.2% ➖ noise
0 datafusion:vortex-file-compressed +35.6% -4.5% +42.0% +100.0% ➖ noise
0 duckdb:vortex-compact +1.9% -4.5% +6.7% +47.9% ➖ noise
0 duckdb:vortex-file-compressed +1.8% -4.5% +6.6% +73.3% ➖ noise
1 datafusion:vortex-compact -4.2% -1.8% -2.4% +19.3% ➖ noise
1 datafusion:vortex-file-compressed -3.7% -1.8% -1.9% +21.1% ➖ noise
1 duckdb:vortex-compact +1.1% -1.8% +3.0% +14.5% ➖ noise
1 duckdb:vortex-file-compressed -0.5% -1.8% +1.4% +42.4% ➖ noise
2 datafusion:vortex-compact +1.3% +0.1% +1.2% +15.1% ➖ noise
2 datafusion:vortex-file-compressed -5.3% +0.1% -5.4% +10.0% ➖ noise
2 duckdb:vortex-compact +1.6% +0.1% +1.5% +13.3% ➖ noise
2 duckdb:vortex-file-compressed +2.8% +0.1% +2.7% +10.0% ➖ noise
3 datafusion:vortex-compact +0.5% +1.9% -1.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +7.7% +1.9% +5.7% +22.6% ➖ noise
3 duckdb:vortex-compact +1.6% +1.9% -0.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +27.6% +1.9% +25.2% +41.9% ➖ noise
4 datafusion:vortex-compact -1.0% +0.5% -1.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.8% +0.5% +2.3% +10.0% ➖ noise
4 duckdb:vortex-compact +0.2% +0.5% -0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.8% +0.5% +0.4% +10.0% ➖ noise
5 datafusion:vortex-compact -0.9% +1.2% -2.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.6% +1.2% -2.7% +10.0% ➖ noise
5 duckdb:vortex-compact -0.9% +1.2% -2.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.4% +1.2% -3.5% +10.0% ➖ noise
6 datafusion:vortex-compact +1.0% -1.1% +2.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.0% -1.1% +0.2% +14.9% ➖ noise
6 duckdb:vortex-compact +0.5% -1.1% +1.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.8% -1.1% -2.7% +13.9% ➖ noise
7 datafusion:vortex-compact -0.5% +1.6% -2.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -6.0% +1.6% -7.5% +17.7% ➖ noise
7 duckdb:vortex-compact +1.0% +1.6% -0.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.3% +1.6% +2.7% +20.9% ➖ noise
8 datafusion:vortex-compact -8.2% +1.2% -9.3% +21.0% ➖ noise
8 datafusion:vortex-file-compressed -6.0% +1.2% -7.2% +14.4% ➖ noise
8 duckdb:vortex-compact +5.6% +1.2% +4.3% +40.7% ➖ noise
8 duckdb:vortex-file-compressed +2.4% +1.2% +1.2% +24.1% ➖ noise

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.6%
Engines: DataFusion No clear signal (+5.2%, environment too noisy confidence) · DuckDB No clear signal (+0.1%, environment too noisy confidence)
Vortex (geomean): 1.031x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.058x ➖, 0↑ 5↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49369924 49386191 1.00
tpch_q02/datafusion:vortex-file-compressed 22735804 22514392 1.01
tpch_q03/datafusion:vortex-file-compressed 🚨 28537911 25464750 1.12
tpch_q04/datafusion:vortex-file-compressed 20488448 19441936 1.05
tpch_q05/datafusion:vortex-file-compressed 49689946 48634282 1.02
tpch_q06/datafusion:vortex-file-compressed 🚨 10549752 9197612 1.15
tpch_q07/datafusion:vortex-file-compressed 55671425 54562983 1.02
tpch_q08/datafusion:vortex-file-compressed 41393100 39942607 1.04
tpch_q09/datafusion:vortex-file-compressed 51705793 51697637 1.00
tpch_q10/datafusion:vortex-file-compressed 46392230 43112931 1.08
tpch_q11/datafusion:vortex-file-compressed 16042394 15848048 1.01
tpch_q12/datafusion:vortex-file-compressed 🚨 24848898 22104562 1.12
tpch_q13/datafusion:vortex-file-compressed 26752825 26601312 1.01
tpch_q14/datafusion:vortex-file-compressed 15867061 15236654 1.04
tpch_q15/datafusion:vortex-file-compressed 🚨 25119804 22045788 1.14
tpch_q16/datafusion:vortex-file-compressed 19879495 19539505 1.02
tpch_q17/datafusion:vortex-file-compressed 69926900 68864299 1.02
tpch_q18/datafusion:vortex-file-compressed 84554172 80522742 1.05
tpch_q19/datafusion:vortex-file-compressed 🚨 21192826 16484346 1.29
tpch_q20/datafusion:vortex-file-compressed 29541766 28423684 1.04
tpch_q21/datafusion:vortex-file-compressed 72225405 69490779 1.04
tpch_q22/datafusion:vortex-file-compressed 11687535 11095472 1.05
datafusion / vortex-compact (1.039x ➖, 0↑ 1↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 56499857 55127304 1.02
tpch_q02/datafusion:vortex-compact 26433513 26070336 1.01
tpch_q03/datafusion:vortex-compact 28869575 26762405 1.08
tpch_q04/datafusion:vortex-compact 21980826 21554134 1.02
tpch_q05/datafusion:vortex-compact 50391559 50355097 1.00
tpch_q06/datafusion:vortex-compact 12775311 11829387 1.08
tpch_q07/datafusion:vortex-compact 60118809 57238633 1.05
tpch_q08/datafusion:vortex-compact 42789794 41937297 1.02
tpch_q09/datafusion:vortex-compact 57549728 55414576 1.04
tpch_q10/datafusion:vortex-compact 46093462 44121278 1.04
tpch_q11/datafusion:vortex-compact 17730837 16913109 1.05
tpch_q12/datafusion:vortex-compact 30821570 30002474 1.03
tpch_q13/datafusion:vortex-compact 32008032 31367271 1.02
tpch_q14/datafusion:vortex-compact 18741585 18706005 1.00
tpch_q15/datafusion:vortex-compact 30773896 28753684 1.07
tpch_q16/datafusion:vortex-compact 24575901 24428752 1.01
tpch_q17/datafusion:vortex-compact 72028735 69006794 1.04
tpch_q18/datafusion:vortex-compact 85318669 82174703 1.04
tpch_q19/datafusion:vortex-compact 🚨 31836771 27301334 1.17
tpch_q20/datafusion:vortex-compact 33182704 32789963 1.01
tpch_q21/datafusion:vortex-compact 75751996 73823262 1.03
tpch_q22/datafusion:vortex-compact 12417999 12051388 1.03
datafusion / parquet (0.983x ➖, 2↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 109631360 133481651 0.82
tpch_q02/datafusion:parquet 61291474 60848649 1.01
tpch_q03/datafusion:parquet 72160310 74646769 0.97
tpch_q04/datafusion:parquet 42992180 44005168 0.98
tpch_q05/datafusion:parquet 91613328 93879589 0.98
tpch_q06/datafusion:parquet 39610524 39405813 1.01
tpch_q07/datafusion:parquet 107052743 105131018 1.02
tpch_q08/datafusion:parquet 94339813 98501290 0.96
tpch_q09/datafusion:parquet 130780349 123880348 1.06
tpch_q10/datafusion:parquet 111015284 111153421 1.00
tpch_q11/datafusion:parquet 41661627 40486914 1.03
tpch_q12/datafusion:parquet 82382165 86745062 0.95
tpch_q13/datafusion:parquet 198703418 202106053 0.98
tpch_q14/datafusion:parquet 46998756 48595875 0.97
tpch_q15/datafusion:parquet 57118823 58669771 0.97
tpch_q16/datafusion:parquet 41004587 40963060 1.00
tpch_q17/datafusion:parquet 129931631 121786857 1.07
tpch_q18/datafusion:parquet 167447737 164067562 1.02
tpch_q19/datafusion:parquet 🚀 69656730 82716460 0.84
tpch_q20/datafusion:parquet 68799826 68673391 1.00
tpch_q21/datafusion:parquet 138204410 137790922 1.00
tpch_q22/datafusion:parquet 32285183 31101729 1.04
datafusion / arrow (1.005x ➖, 0↑ 1↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 50863649 56336783 0.90
tpch_q02/datafusion:arrow 18608914 18989294 0.98
tpch_q03/datafusion:arrow 29216801 29229798 1.00
tpch_q04/datafusion:arrow 26545372 24581763 1.08
tpch_q05/datafusion:arrow 79604410 72687923 1.10
tpch_q06/datafusion:arrow 🚨 22701010 19450732 1.17
tpch_q07/datafusion:arrow 102071116 102624791 0.99
tpch_q08/datafusion:arrow 39997239 42975709 0.93
tpch_q09/datafusion:arrow 63735915 66812317 0.95
tpch_q10/datafusion:arrow 46060098 49732671 0.93
tpch_q11/datafusion:arrow 8929722 9257575 0.96
tpch_q12/datafusion:arrow 51396218 50228413 1.02
tpch_q13/datafusion:arrow 48159916 46748742 1.03
tpch_q14/datafusion:arrow 22002753 20817746 1.06
tpch_q15/datafusion:arrow 42105865 41477300 1.02
tpch_q16/datafusion:arrow 18993348 18525023 1.03
tpch_q17/datafusion:arrow 66989774 68033346 0.98
tpch_q18/datafusion:arrow 132339394 132768664 1.00
tpch_q19/datafusion:arrow 34328832 34606223 0.99
tpch_q20/datafusion:arrow 33308694 33302930 1.00
tpch_q21/datafusion:arrow 150118140 145838260 1.03
tpch_q22/datafusion:arrow 17287887 17316897 1.00
duckdb / vortex-file-compressed (1.014x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31422324 30798536 1.02
tpch_q02/duckdb:vortex-file-compressed 24901733 24693085 1.01
tpch_q03/duckdb:vortex-file-compressed 32678853 32541075 1.00
tpch_q04/duckdb:vortex-file-compressed 28889577 28003291 1.03
tpch_q05/duckdb:vortex-file-compressed 37144101 36990124 1.00
tpch_q06/duckdb:vortex-file-compressed 8017885 8058488 0.99
tpch_q07/duckdb:vortex-file-compressed 35039131 33931739 1.03
tpch_q08/duckdb:vortex-file-compressed 37397778 36209474 1.03
tpch_q09/duckdb:vortex-file-compressed 57394675 57307693 1.00
tpch_q10/duckdb:vortex-file-compressed 41104898 40705944 1.01
tpch_q11/duckdb:vortex-file-compressed 14980728 14427231 1.04
tpch_q12/duckdb:vortex-file-compressed 22892813 22386235 1.02
tpch_q13/duckdb:vortex-file-compressed 41270721 40986192 1.01
tpch_q14/duckdb:vortex-file-compressed 21431097 21688262 0.99
tpch_q15/duckdb:vortex-file-compressed 17055060 16849621 1.01
tpch_q16/duckdb:vortex-file-compressed 30202289 29822565 1.01
tpch_q17/duckdb:vortex-file-compressed 24145102 23918952 1.01
tpch_q18/duckdb:vortex-file-compressed 52883139 52536525 1.01
tpch_q19/duckdb:vortex-file-compressed 28727177 28848986 1.00
tpch_q20/duckdb:vortex-file-compressed 33030582 32136013 1.03
tpch_q21/duckdb:vortex-file-compressed 101056514 98666990 1.02
tpch_q22/duckdb:vortex-file-compressed 17451767 16915172 1.03
duckdb / vortex-compact (1.014x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38599632 37900537 1.02
tpch_q02/duckdb:vortex-compact 33639162 32803939 1.03
tpch_q03/duckdb:vortex-compact 34561024 33951555 1.02
tpch_q04/duckdb:vortex-compact 31567967 31310473 1.01
tpch_q05/duckdb:vortex-compact 40593678 40481908 1.00
tpch_q06/duckdb:vortex-compact 11825338 10754869 1.10
tpch_q07/duckdb:vortex-compact 40732116 40984249 0.99
tpch_q08/duckdb:vortex-compact 42565597 40853849 1.04
tpch_q09/duckdb:vortex-compact 65284285 64470805 1.01
tpch_q10/duckdb:vortex-compact 44956243 44771403 1.00
tpch_q11/duckdb:vortex-compact 18365706 18437760 1.00
tpch_q12/duckdb:vortex-compact 29640875 29499989 1.00
tpch_q13/duckdb:vortex-compact 46351394 46824188 0.99
tpch_q14/duckdb:vortex-compact 25813256 25855048 1.00
tpch_q15/duckdb:vortex-compact 19863256 19888460 1.00
tpch_q16/duckdb:vortex-compact 33058734 31478137 1.05
tpch_q17/duckdb:vortex-compact 29633795 29656703 1.00
tpch_q18/duckdb:vortex-compact 53563906 52520726 1.02
tpch_q19/duckdb:vortex-compact 32770257 32217665 1.02
tpch_q20/duckdb:vortex-compact 40480718 39735934 1.02
tpch_q21/duckdb:vortex-compact 102078002 102545878 1.00
tpch_q22/duckdb:vortex-compact 18130086 17987976 1.01
duckdb / parquet (1.009x ➖, 1↑ 3↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77276930 78145058 0.99
tpch_q02/duckdb:parquet 39487865 39213361 1.01
tpch_q03/duckdb:parquet 70661805 70242904 1.01
tpch_q04/duckdb:parquet 🚀 49669233 57102782 0.87
tpch_q05/duckdb:parquet 68452093 68486287 1.00
tpch_q06/duckdb:parquet 22450459 22835972 0.98
tpch_q07/duckdb:parquet 🚨 83508078 71582845 1.17
tpch_q08/duckdb:parquet 82759604 83466705 0.99
tpch_q09/duckdb:parquet 🚨 158052693 132736404 1.19
tpch_q10/duckdb:parquet 126237593 129264573 0.98
tpch_q11/duckdb:parquet 22484765 22187516 1.01
tpch_q12/duckdb:parquet 52590557 55865140 0.94
tpch_q13/duckdb:parquet 251350661 252327914 1.00
tpch_q14/duckdb:parquet 50536429 50790468 0.99
tpch_q15/duckdb:parquet 25911916 25814870 1.00
tpch_q16/duckdb:parquet 58367666 58144736 1.00
tpch_q17/duckdb:parquet 56423324 58085674 0.97
tpch_q18/duckdb:parquet 121000156 125359997 0.97
tpch_q19/duckdb:parquet 🚨 87446945 71601262 1.22
tpch_q20/duckdb:parquet 65558867 65706494 1.00
tpch_q21/duckdb:parquet 174144653 180727029 0.96
tpch_q22/duckdb:parquet 53847207 53462561 1.01
duckdb / duckdb (1.000x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17723816 17391382 1.02
tpch_q02/duckdb:duckdb 14447649 14034480 1.03
tpch_q03/duckdb:duckdb 22467089 22463034 1.00
tpch_q04/duckdb:duckdb 21643852 22577657 0.96
tpch_q05/duckdb:duckdb 23034286 23645267 0.97
tpch_q06/duckdb:duckdb 7046933 7020438 1.00
tpch_q07/duckdb:duckdb 25140383 25212208 1.00
tpch_q08/duckdb:duckdb 24022760 23990271 1.00
tpch_q09/duckdb:duckdb 57964211 55987356 1.04
tpch_q10/duckdb:duckdb 50248467 50257232 1.00
tpch_q11/duckdb:duckdb 7222802 7106013 1.02
tpch_q12/duckdb:duckdb 18004311 17878221 1.01
tpch_q13/duckdb:duckdb 39641329 39628252 1.00
tpch_q14/duckdb:duckdb 21515768 21664955 0.99
tpch_q15/duckdb:duckdb 13642570 13756767 0.99
tpch_q16/duckdb:duckdb 26144004 26055578 1.00
tpch_q17/duckdb:duckdb 16247767 16481328 0.99
tpch_q18/duckdb:duckdb 40729811 40686308 1.00
tpch_q19/duckdb:duckdb 31323499 30791674 1.02
tpch_q20/duckdb:duckdb 24969785 25527516 0.98
tpch_q21/duckdb:duckdb 62111329 61914861 1.00
tpch_q22/duckdb:duckdb 25553424 25738432 0.99

File Size Changes (9 files changed, -0.1% overall, 4↑ 5↓)
File Scale Format Base HEAD Change %
part_0.vortex 1.0 vortex-compact 3.38 MB 3.41 MB +31.45 KB +0.9%
partsupp_0.vortex 1.0 vortex-compact 20.75 MB 20.79 MB +35.78 KB +0.2%
customer_0.vortex 1.0 vortex-file-compressed 8.89 MB 8.90 MB +6.65 KB +0.1%
partsupp_0.vortex 1.0 vortex-file-compressed 23.79 MB 23.81 MB +12.12 KB +0.0%
lineitem_0.vortex 1.0 vortex-file-compressed 85.13 MB 85.09 MB 47.77 KB -0.1%
lineitem_1.vortex 1.0 vortex-file-compressed 84.63 MB 84.53 MB 105.23 KB -0.1%
part_0.vortex 1.0 vortex-file-compressed 5.05 MB 5.01 MB 37.57 KB -0.7%
orders_0.vortex 1.0 vortex-file-compressed 38.85 MB 38.54 MB 319.76 KB -0.8%
supplier_0.vortex 1.0 vortex-file-compressed 617.39 KB 611.19 KB 6.20 KB -1.0%

Totals:

  • vortex-compact: 190.09 MB → 190.15 MB (+0.0%)
  • vortex-file-compressed: 247.23 MB → 246.75 MB (-0.2%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -9.7% -9.9% +0.2% +19.3% ➖ noise
1 datafusion:vortex-compact +2.5% -9.9% +13.7% +19.6% ➖ noise
1 datafusion:vortex-file-compressed -0.0% -9.9% +10.9% +19.9% ➖ noise
1 duckdb:duckdb +1.9% -9.9% +13.1% +16.8% ➖ noise
1 duckdb:vortex-compact +1.8% -9.9% +13.0% +17.0% ➖ noise
1 duckdb:vortex-file-compressed +2.0% -9.9% +13.2% +19.3% ➖ noise
2 datafusion:arrow -2.0% +0.7% -2.7% +12.6% ➖ noise
2 datafusion:vortex-compact +1.4% +0.7% +0.7% +12.6% ➖ noise
2 datafusion:vortex-file-compressed +1.0% +0.7% +0.3% +12.8% ➖ noise
2 duckdb:duckdb +2.9% +0.7% +2.2% +12.6% ➖ noise
2 duckdb:vortex-compact +2.5% +0.7% +1.8% +12.6% ➖ noise
2 duckdb:vortex-file-compressed +0.8% +0.7% +0.1% +12.6% ➖ noise
3 datafusion:arrow -0.0% -1.4% +1.4% +12.6% ➖ noise
3 datafusion:vortex-compact +7.9% -1.4% +9.4% +12.6% ➖ noise
3 datafusion:vortex-file-compressed +12.1% -1.4% +13.6% +12.6% 🚨 regression
3 duckdb:duckdb +0.0% -1.4% +1.4% +12.6% ➖ noise
3 duckdb:vortex-compact +1.8% -1.4% +3.2% +12.6% ➖ noise
3 duckdb:vortex-file-compressed +0.4% -1.4% +1.8% +12.6% ➖ noise
4 datafusion:arrow +8.0% -7.8% +17.1% +12.6% 🚨 regression
4 datafusion:vortex-compact +2.0% -7.8% +10.6% +12.6% ➖ noise
4 datafusion:vortex-file-compressed +5.4% -7.8% +14.3% +13.7% 🚨 regression
4 duckdb:duckdb -4.1% -7.8% +4.0% +12.6% ➖ noise
4 duckdb:vortex-compact +0.8% -7.8% +9.4% +14.8% ➖ noise
4 duckdb:vortex-file-compressed +3.2% -7.8% +11.9% +12.6% ➖ noise
5 datafusion:arrow +9.5% -1.2% +10.9% +12.6% ➖ noise
5 datafusion:vortex-compact +0.1% -1.2% +1.3% +12.6% ➖ noise
5 datafusion:vortex-file-compressed +2.2% -1.2% +3.5% +12.6% ➖ noise
5 duckdb:duckdb -2.6% -1.2% -1.4% +12.6% ➖ noise
5 duckdb:vortex-compact +0.3% -1.2% +1.5% +12.6% ➖ noise
5 duckdb:vortex-file-compressed +0.4% -1.2% +1.7% +12.6% ➖ noise
6 datafusion:arrow +16.7% -0.6% +17.4% +15.5% 🚨 regression
6 datafusion:vortex-compact +8.0% -0.6% +8.6% +21.8% ➖ noise
6 datafusion:vortex-file-compressed +14.7% -0.6% +15.4% +18.3% ➖ noise
6 duckdb:duckdb +0.4% -0.6% +1.0% +15.4% ➖ noise
6 duckdb:vortex-compact +10.0% -0.6% +10.6% +22.4% ➖ noise
6 duckdb:vortex-file-compressed -0.5% -0.6% +0.1% +18.0% ➖ noise
7 datafusion:arrow -0.5% +9.0% -8.7% +12.6% ➖ noise
7 datafusion:vortex-compact +5.0% +9.0% -3.6% +12.6% ➖ noise
7 datafusion:vortex-file-compressed +2.0% +9.0% -6.4% +12.6% ➖ noise
7 duckdb:duckdb -0.3% +9.0% -8.5% +12.6% ➖ noise
7 duckdb:vortex-compact -0.6% +9.0% -8.8% +12.6% ➖ noise
7 duckdb:vortex-file-compressed +3.3% +9.0% -5.3% +12.6% ➖ noise
8 datafusion:arrow -6.9% -2.6% -4.5% +12.6% ➖ noise
8 datafusion:vortex-compact +2.0% -2.6% +4.7% +12.6% ➖ noise
8 datafusion:vortex-file-compressed +3.6% -2.6% +6.3% +12.6% ➖ noise
8 duckdb:duckdb +0.1% -2.6% +2.8% +12.6% ➖ noise
8 duckdb:vortex-compact +4.2% -2.6% +6.9% +12.6% ➖ noise
8 duckdb:vortex-file-compressed +3.3% -2.6% +6.0% +12.6% ➖ noise
9 datafusion:arrow -4.6% +12.1% -14.9% +12.6% ✅ faster
9 datafusion:vortex-compact +3.9% +12.1% -7.4% +12.6% ➖ noise
9 datafusion:vortex-file-compressed +0.0% +12.1% -10.8% +12.6% ➖ noise
9 duckdb:duckdb +3.5% +12.1% -7.7% +12.6% ➖ noise
9 duckdb:vortex-compact +1.3% +12.1% -9.7% +12.6% ➖ noise
9 duckdb:vortex-file-compressed +0.2% +12.1% -10.7% +12.6% ➖ noise
10 datafusion:arrow -7.4% -1.2% -6.2% +12.6% ➖ noise
10 datafusion:vortex-compact +4.5% -1.2% +5.8% +12.6% ➖ noise
10 datafusion:vortex-file-compressed +7.6% -1.2% +9.0% +12.6% ➖ noise
10 duckdb:duckdb -0.0% -1.2% +1.2% +12.6% ➖ noise
10 duckdb:vortex-compact +0.4% -1.2% +1.7% +12.6% ➖ noise
10 duckdb:vortex-file-compressed +1.0% -1.2% +2.2% +12.6% ➖ noise
11 datafusion:arrow -3.5% +2.1% -5.5% +12.6% ➖ noise
11 datafusion:vortex-compact +4.8% +2.1% +2.7% +12.6% ➖ noise
11 datafusion:vortex-file-compressed +1.2% +2.1% -0.9% +12.6% ➖ noise
11 duckdb:duckdb +1.6% +2.1% -0.5% +12.6% ➖ noise
11 duckdb:vortex-compact -0.4% +2.1% -2.5% +12.6% ➖ noise
11 duckdb:vortex-file-compressed +3.8% +2.1% +1.7% +20.4% ➖ noise
12 datafusion:arrow +2.3% -5.4% +8.2% +19.3% ➖ noise
12 datafusion:vortex-compact +2.7% -5.4% +8.6% +13.8% ➖ noise
12 datafusion:vortex-file-compressed +12.4% -5.4% +18.9% +15.0% 🚨 regression
12 duckdb:duckdb +0.7% -5.4% +6.5% +12.6% ➖ noise
12 duckdb:vortex-compact +0.5% -5.4% +6.3% +12.6% ➖ noise
12 duckdb:vortex-file-compressed +2.3% -5.4% +8.2% +12.6% ➖ noise
13 datafusion:arrow +3.0% -1.0% +4.1% +12.6% ➖ noise
13 datafusion:vortex-compact +2.0% -1.0% +3.1% +12.6% ➖ noise
13 datafusion:vortex-file-compressed +0.6% -1.0% +1.6% +12.6% ➖ noise
13 duckdb:duckdb +0.0% -1.0% +1.1% +12.6% ➖ noise
13 duckdb:vortex-compact -1.0% -1.0% +0.0% +12.6% ➖ noise
13 duckdb:vortex-file-compressed +0.7% -1.0% +1.7% +12.6% ➖ noise
14 datafusion:arrow +5.7% -1.9% +7.7% +12.6% ➖ noise
14 datafusion:vortex-compact +0.2% -1.9% +2.1% +12.6% ➖ noise
14 datafusion:vortex-file-compressed +4.1% -1.9% +6.2% +12.6% ➖ noise
14 duckdb:duckdb -0.7% -1.9% +1.2% +12.6% ➖ noise
14 duckdb:vortex-compact -0.2% -1.9% +1.8% +12.6% ➖ noise
14 duckdb:vortex-file-compressed -1.2% -1.9% +0.7% +13.5% ➖ noise
15 datafusion:arrow +1.5% -1.1% +2.7% +12.6% ➖ noise
15 datafusion:vortex-compact +7.0% -1.1% +8.3% +12.6% ➖ noise
15 datafusion:vortex-file-compressed +13.9% -1.1% +15.3% +12.6% 🚨 regression
15 duckdb:duckdb -0.8% -1.1% +0.3% +12.6% ➖ noise
15 duckdb:vortex-compact -0.1% -1.1% +1.0% +12.6% ➖ noise
15 duckdb:vortex-file-compressed +1.2% -1.1% +2.4% +12.6% ➖ noise
16 datafusion:arrow +2.5% +0.2% +2.3% +12.6% ➖ noise
16 datafusion:vortex-compact +0.6% +0.2% +0.4% +12.6% ➖ noise
16 datafusion:vortex-file-compressed +1.7% +0.2% +1.5% +12.6% ➖ noise
16 duckdb:duckdb +0.3% +0.2% +0.1% +12.6% ➖ noise
16 duckdb:vortex-compact +5.0% +0.2% +4.8% +12.6% ➖ noise
16 duckdb:vortex-file-compressed +1.3% +0.2% +1.0% +12.6% ➖ noise
17 datafusion:arrow -1.5% +1.8% -3.3% +12.6% ➖ noise
17 datafusion:vortex-compact +4.4% +1.8% +2.5% +12.6% ➖ noise
17 datafusion:vortex-file-compressed +1.5% +1.8% -0.3% +12.6% ➖ noise
17 duckdb:duckdb -1.4% +1.8% -3.2% +12.6% ➖ noise
17 duckdb:vortex-compact -0.1% +1.8% -1.8% +12.6% ➖ noise
17 duckdb:vortex-file-compressed +0.9% +1.8% -0.8% +15.5% ➖ noise
18 datafusion:arrow -0.3% -0.7% +0.4% +12.6% ➖ noise
18 datafusion:vortex-compact +3.8% -0.7% +4.6% +12.6% ➖ noise
18 datafusion:vortex-file-compressed +5.0% -0.7% +5.8% +12.6% ➖ noise
18 duckdb:duckdb +0.1% -0.7% +0.9% +12.6% ➖ noise
18 duckdb:vortex-compact +2.0% -0.7% +2.8% +12.6% ➖ noise
18 duckdb:vortex-file-compressed +0.7% -0.7% +1.4% +12.6% ➖ noise
19 datafusion:arrow -0.8% +1.4% -2.2% +16.4% ➖ noise
19 datafusion:vortex-compact +16.6% +1.4% +15.0% +15.9% ➖ noise
19 datafusion:vortex-file-compressed +28.6% +1.4% +26.8% +15.2% 🚨 regression
19 duckdb:duckdb +1.7% +1.4% +0.3% +12.6% ➖ noise
19 duckdb:vortex-compact +1.7% +1.4% +0.3% +15.0% ➖ noise
19 duckdb:vortex-file-compressed -0.4% +1.4% -1.8% +12.6% ➖ noise
20 datafusion:arrow +0.0% -0.0% +0.0% +12.6% ➖ noise
20 datafusion:vortex-compact +1.2% -0.0% +1.2% +12.6% ➖ noise
20 datafusion:vortex-file-compressed +3.9% -0.0% +4.0% +12.6% ➖ noise
20 duckdb:duckdb -2.2% -0.0% -2.2% +12.6% ➖ noise
20 duckdb:vortex-compact +1.9% -0.0% +1.9% +12.6% ➖ noise
20 duckdb:vortex-file-compressed +2.8% -0.0% +2.8% +12.6% ➖ noise
21 datafusion:arrow +2.9% -1.7% +4.7% +12.6% ➖ noise
21 datafusion:vortex-compact +2.6% -1.7% +4.4% +12.6% ➖ noise
21 datafusion:vortex-file-compressed +3.9% -1.7% +5.7% +12.6% ➖ noise
21 duckdb:duckdb +0.3% -1.7% +2.0% +12.6% ➖ noise
21 duckdb:vortex-compact -0.5% -1.7% +1.3% +12.6% ➖ noise
21 duckdb:vortex-file-compressed +2.4% -1.7% +4.2% +12.6% ➖ noise
22 datafusion:arrow -0.2% +2.3% -2.4% +12.6% ➖ noise
22 datafusion:vortex-compact +3.0% +2.3% +0.8% +12.6% ➖ noise
22 datafusion:vortex-file-compressed +5.3% +2.3% +3.0% +17.6% ➖ noise
22 duckdb:duckdb -0.7% +2.3% -2.9% +12.6% ➖ noise
22 duckdb:vortex-compact +0.8% +2.3% -1.4% +14.6% ➖ noise
22 duckdb:vortex-file-compressed +3.2% +2.3% +0.9% +12.6% ➖ noise

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.217x ❌

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.217x ❌, 0↑ 8↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 119093503 113559708 1.05
polarsignals_q01/datafusion:vortex-file-compressed 🚨 328249153 270238272 1.21
polarsignals_q02/datafusion:vortex-file-compressed 🚨 29730595 24077410 1.23
polarsignals_q03/datafusion:vortex-file-compressed 🚨 321785743 263182881 1.22
polarsignals_q04/datafusion:vortex-file-compressed 🚨 12984130 8890594 1.46
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17586032 13097760 1.34
polarsignals_q06/datafusion:vortex-file-compressed 🚨 21545791 17905822 1.20
polarsignals_q07/datafusion:vortex-file-compressed 🚨 18126743 13222374 1.37
polarsignals_q08/datafusion:vortex-file-compressed 🚨 446815426 400129744 1.12
polarsignals_q09/datafusion:vortex-file-compressed 11438640 11129599 1.03

No file size changes detected.

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (+1.6%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): 1.009x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.018x ➖, 0↑ 10↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 28791808 25894933 1.11
tpcds_q02/datafusion:vortex-file-compressed 47371616 46784561 1.01
tpcds_q03/datafusion:vortex-file-compressed 🚨 16682282 14910394 1.12
tpcds_q04/datafusion:vortex-file-compressed 253354484 251004872 1.01
tpcds_q05/datafusion:vortex-file-compressed 45645567 43659833 1.05
tpcds_q06/datafusion:vortex-file-compressed 59929918 58102551 1.03
tpcds_q07/datafusion:vortex-file-compressed 42119327 42018415 1.00
tpcds_q08/datafusion:vortex-file-compressed 28859379 28465177 1.01
tpcds_q09/datafusion:vortex-file-compressed 37849644 36037021 1.05
tpcds_q10/datafusion:vortex-file-compressed 🚨 40491853 36417773 1.11
tpcds_q11/datafusion:vortex-file-compressed 126197592 136547829 0.92
tpcds_q12/datafusion:vortex-file-compressed 19311512 18596349 1.04
tpcds_q13/datafusion:vortex-file-compressed 🚨 51964895 44701010 1.16
tpcds_q14/datafusion:vortex-file-compressed 175737975 166649334 1.05
tpcds_q15/datafusion:vortex-file-compressed 29314506 27923844 1.05
tpcds_q16/datafusion:vortex-file-compressed 28012076 28096178 1.00
tpcds_q17/datafusion:vortex-file-compressed 64238063 63473560 1.01
tpcds_q18/datafusion:vortex-file-compressed 70148368 69421115 1.01
tpcds_q19/datafusion:vortex-file-compressed 23196351 21799262 1.06
tpcds_q20/datafusion:vortex-file-compressed 22614182 22185210 1.02
tpcds_q21/datafusion:vortex-file-compressed 36447612 37879453 0.96
tpcds_q22/datafusion:vortex-file-compressed 118065714 118389431 1.00
tpcds_q23/datafusion:vortex-file-compressed 150843921 154827294 0.97
tpcds_q24/datafusion:vortex-file-compressed 85509860 88752345 0.96
tpcds_q25/datafusion:vortex-file-compressed 64975932 68013603 0.96
tpcds_q26/datafusion:vortex-file-compressed 34291429 34051456 1.01
tpcds_q27/datafusion:vortex-file-compressed 110461036 108086543 1.02
tpcds_q28/datafusion:vortex-file-compressed 🚨 33861002 28009685 1.21
tpcds_q29/datafusion:vortex-file-compressed 62444016 62404986 1.00
tpcds_q30/datafusion:vortex-file-compressed 23785808 24357248 0.98
tpcds_q31/datafusion:vortex-file-compressed 74241587 71677833 1.04
tpcds_q32/datafusion:vortex-file-compressed 19666211 19104557 1.03
tpcds_q33/datafusion:vortex-file-compressed 29600390 30287890 0.98
tpcds_q34/datafusion:vortex-file-compressed 24337044 24571498 0.99
tpcds_q35/datafusion:vortex-file-compressed 45904945 44413666 1.03
tpcds_q36/datafusion:vortex-file-compressed 57979183 61265800 0.95
tpcds_q37/datafusion:vortex-file-compressed 24400074 24168041 1.01
tpcds_q38/datafusion:vortex-file-compressed 43569825 42937651 1.01
tpcds_q39/datafusion:vortex-file-compressed 108281270 107364391 1.01
tpcds_q40/datafusion:vortex-file-compressed 33558716 33738178 0.99
tpcds_q41/datafusion:vortex-file-compressed 15810383 14851415 1.06
tpcds_q42/datafusion:vortex-file-compressed 14469204 13490347 1.07
tpcds_q43/datafusion:vortex-file-compressed 18896146 18974677 1.00
tpcds_q44/datafusion:vortex-file-compressed 🚨 32449561 29471563 1.10
tpcds_q45/datafusion:vortex-file-compressed 27889496 28039275 0.99
tpcds_q46/datafusion:vortex-file-compressed 🚨 39530999 34442846 1.15
tpcds_q47/datafusion:vortex-file-compressed 131465496 132493252 0.99
tpcds_q48/datafusion:vortex-file-compressed 🚨 38696816 33583348 1.15
tpcds_q49/datafusion:vortex-file-compressed 59088479 58531212 1.01
tpcds_q50/datafusion:vortex-file-compressed 39795627 39707968 1.00
tpcds_q51/datafusion:vortex-file-compressed 91503609 89671128 1.02
tpcds_q52/datafusion:vortex-file-compressed 🚨 15481228 14049826 1.10
tpcds_q53/datafusion:vortex-file-compressed 22037045 21444052 1.03
tpcds_q54/datafusion:vortex-file-compressed 35162645 35687232 0.99
tpcds_q55/datafusion:vortex-file-compressed 14376438 13251880 1.08
tpcds_q56/datafusion:vortex-file-compressed 29212785 30075703 0.97
tpcds_q57/datafusion:vortex-file-compressed 108710976 106196821 1.02
tpcds_q58/datafusion:vortex-file-compressed 52424673 54143827 0.97
tpcds_q59/datafusion:vortex-file-compressed 56863979 55967334 1.02
tpcds_q60/datafusion:vortex-file-compressed 29470863 29076820 1.01
tpcds_q61/datafusion:vortex-file-compressed 43750326 40908263 1.07
tpcds_q62/datafusion:vortex-file-compressed 26308809 27563912 0.95
tpcds_q63/datafusion:vortex-file-compressed 22258110 22315453 1.00
tpcds_q64/datafusion:vortex-file-compressed 417603701 427254717 0.98
tpcds_q65/datafusion:vortex-file-compressed 38848485 40113613 0.97
tpcds_q66/datafusion:vortex-file-compressed 73402343 72067407 1.02
tpcds_q67/datafusion:vortex-file-compressed 145872561 145455132 1.00
tpcds_q68/datafusion:vortex-file-compressed 32962155 32318559 1.02
tpcds_q69/datafusion:vortex-file-compressed 36249866 35602755 1.02
tpcds_q70/datafusion:vortex-file-compressed 83616193 84065025 0.99
tpcds_q71/datafusion:vortex-file-compressed 22573384 22394504 1.01
tpcds_q72/datafusion:vortex-file-compressed 2193792811 2184429860 1.00
tpcds_q73/datafusion:vortex-file-compressed 23043231 22972931 1.00
tpcds_q74/datafusion:vortex-file-compressed 83003252 82271190 1.01
tpcds_q75/datafusion:vortex-file-compressed 107019331 112057697 0.96
tpcds_q76/datafusion:vortex-file-compressed 33536099 31337890 1.07
tpcds_q77/datafusion:vortex-file-compressed 40377504 41332408 0.98
tpcds_q78/datafusion:vortex-file-compressed 123732269 127464972 0.97
tpcds_q79/datafusion:vortex-file-compressed 29318523 28355820 1.03
tpcds_q80/datafusion:vortex-file-compressed 93104535 97671048 0.95
tpcds_q81/datafusion:vortex-file-compressed 23646382 23709272 1.00
tpcds_q82/datafusion:vortex-file-compressed 24458602 24710026 0.99
tpcds_q83/datafusion:vortex-file-compressed 33792588 34013052 0.99
tpcds_q84/datafusion:vortex-file-compressed 13860821 13059421 1.06
tpcds_q85/datafusion:vortex-file-compressed 91317121 93490677 0.98
tpcds_q86/datafusion:vortex-file-compressed 16461029 18034941 0.91
tpcds_q87/datafusion:vortex-file-compressed 42934510 41859636 1.03
tpcds_q88/datafusion:vortex-file-compressed 57566231 54093913 1.06
tpcds_q89/datafusion:vortex-file-compressed 25185122 25366671 0.99
tpcds_q90/datafusion:vortex-file-compressed 14433152 14503527 1.00
tpcds_q91/datafusion:vortex-file-compressed 18358656 18206592 1.01
tpcds_q92/datafusion:vortex-file-compressed 17989427 18083107 0.99
tpcds_q93/datafusion:vortex-file-compressed 34880215 33369728 1.05
tpcds_q94/datafusion:vortex-file-compressed 23368489 23562769 0.99
tpcds_q95/datafusion:vortex-file-compressed 63309112 62629160 1.01
tpcds_q96/datafusion:vortex-file-compressed 14111902 13655198 1.03
tpcds_q97/datafusion:vortex-file-compressed 31666717 31707003 1.00
tpcds_q98/datafusion:vortex-file-compressed 23976383 24305376 0.99
tpcds_q99/datafusion:vortex-file-compressed 🚨 32154957 29207539 1.10
datafusion / vortex-compact (1.000x ➖, 1↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25422195 25999648 0.98
tpcds_q02/datafusion:vortex-compact 54328303 53221536 1.02
tpcds_q03/datafusion:vortex-compact 20943073 20317050 1.03
tpcds_q04/datafusion:vortex-compact 299074250 298845214 1.00
tpcds_q05/datafusion:vortex-compact 50415719 47608238 1.06
tpcds_q06/datafusion:vortex-compact 63172914 63025193 1.00
tpcds_q07/datafusion:vortex-compact 51394519 53305747 0.96
tpcds_q08/datafusion:vortex-compact 36070372 35222151 1.02
tpcds_q09/datafusion:vortex-compact 52266104 49757085 1.05
tpcds_q10/datafusion:vortex-compact 49027771 48413254 1.01
tpcds_q11/datafusion:vortex-compact 159308855 159611284 1.00
tpcds_q12/datafusion:vortex-compact 26027299 24211982 1.07
tpcds_q13/datafusion:vortex-compact 124064861 122226190 1.02
tpcds_q14/datafusion:vortex-compact 196474112 200881010 0.98
tpcds_q15/datafusion:vortex-compact 32647954 30988938 1.05
tpcds_q16/datafusion:vortex-compact 32425693 31780330 1.02
tpcds_q17/datafusion:vortex-compact 74321909 76195164 0.98
tpcds_q18/datafusion:vortex-compact 77516718 78596092 0.99
tpcds_q19/datafusion:vortex-compact 30205554 31722501 0.95
tpcds_q20/datafusion:vortex-compact 26067907 25868458 1.01
tpcds_q21/datafusion:vortex-compact 38218510 40732501 0.94
tpcds_q22/datafusion:vortex-compact 119609321 115016815 1.04
tpcds_q23/datafusion:vortex-compact 164506811 164826149 1.00
tpcds_q24/datafusion:vortex-compact 98430913 98458559 1.00
tpcds_q25/datafusion:vortex-compact 79409590 78386269 1.01
tpcds_q26/datafusion:vortex-compact 46608288 44156765 1.06
tpcds_q27/datafusion:vortex-compact 123470280 127043895 0.97
tpcds_q28/datafusion:vortex-compact 97587635 95101805 1.03
tpcds_q29/datafusion:vortex-compact 74822608 74696487 1.00
tpcds_q30/datafusion:vortex-compact 26765182 29088070 0.92
tpcds_q31/datafusion:vortex-compact 100660359 94146410 1.07
tpcds_q32/datafusion:vortex-compact 25359587 25941318 0.98
tpcds_q33/datafusion:vortex-compact 36636087 36965998 0.99
tpcds_q34/datafusion:vortex-compact 32801017 33472492 0.98
tpcds_q35/datafusion:vortex-compact 53242041 50608992 1.05
tpcds_q36/datafusion:vortex-compact 74084632 80691832 0.92
tpcds_q37/datafusion:vortex-compact 34590199 34611624 1.00
tpcds_q38/datafusion:vortex-compact 52934823 49394564 1.07
tpcds_q39/datafusion:vortex-compact 113745580 118044492 0.96
tpcds_q40/datafusion:vortex-compact 37071580 37416827 0.99
tpcds_q41/datafusion:vortex-compact 18562523 17428388 1.07
tpcds_q42/datafusion:vortex-compact 19357048 18495285 1.05
tpcds_q43/datafusion:vortex-compact 26157598 25043347 1.04
tpcds_q44/datafusion:vortex-compact 47703498 46765600 1.02
tpcds_q45/datafusion:vortex-compact 31263351 34036341 0.92
tpcds_q46/datafusion:vortex-compact 44598883 48275707 0.92
tpcds_q47/datafusion:vortex-compact 149592996 160248063 0.93
tpcds_q48/datafusion:vortex-compact 82184181 80099178 1.03
tpcds_q49/datafusion:vortex-compact 70731007 69824538 1.01
tpcds_q50/datafusion:vortex-compact 48548434 48643646 1.00
tpcds_q51/datafusion:vortex-compact 97696557 95299060 1.03
tpcds_q52/datafusion:vortex-compact 🚀 18767517 20911789 0.90
tpcds_q53/datafusion:vortex-compact 28525095 29167592 0.98
tpcds_q54/datafusion:vortex-compact 42094030 43262070 0.97
tpcds_q55/datafusion:vortex-compact 17852850 18190720 0.98
tpcds_q56/datafusion:vortex-compact 36348871 36235880 1.00
tpcds_q57/datafusion:vortex-compact 122491671 112212336 1.09
tpcds_q58/datafusion:vortex-compact 64872241 63464654 1.02
tpcds_q59/datafusion:vortex-compact 71796388 70815381 1.01
tpcds_q60/datafusion:vortex-compact 36607528 38357189 0.95
tpcds_q61/datafusion:vortex-compact 54681718 55715984 0.98
tpcds_q62/datafusion:vortex-compact 31066116 28788977 1.08
tpcds_q63/datafusion:vortex-compact 28313883 28598879 0.99
tpcds_q64/datafusion:vortex-compact 471305691 466471170 1.01
tpcds_q65/datafusion:vortex-compact 54917668 53741145 1.02
tpcds_q66/datafusion:vortex-compact 76206248 75644216 1.01
tpcds_q67/datafusion:vortex-compact 154748985 158862560 0.97
tpcds_q68/datafusion:vortex-compact 45487647 45819212 0.99
tpcds_q69/datafusion:vortex-compact 46286922 45500009 1.02
tpcds_q70/datafusion:vortex-compact 98230139 97948241 1.00
tpcds_q71/datafusion:vortex-compact 29639695 30513286 0.97
tpcds_q72/datafusion:vortex-compact 2215000179 2207903140 1.00
tpcds_q73/datafusion:vortex-compact 30975044 30945951 1.00
tpcds_q74/datafusion:vortex-compact 99208121 97363530 1.02
tpcds_q75/datafusion:vortex-compact 129569510 129092451 1.00
tpcds_q76/datafusion:vortex-compact 32347621 35919593 0.90
tpcds_q77/datafusion:vortex-compact 49755576 50689765 0.98
tpcds_q78/datafusion:vortex-compact 139064133 140979166 0.99
tpcds_q79/datafusion:vortex-compact 38749911 39020747 0.99
tpcds_q80/datafusion:vortex-compact 106690999 106164788 1.00
tpcds_q81/datafusion:vortex-compact 28466430 28440766 1.00
tpcds_q82/datafusion:vortex-compact 34842749 37468248 0.93
tpcds_q83/datafusion:vortex-compact 33429876 34471668 0.97
tpcds_q84/datafusion:vortex-compact 14226180 14272488 1.00
tpcds_q85/datafusion:vortex-compact 161700338 160064379 1.01
tpcds_q86/datafusion:vortex-compact 18361648 18577729 0.99
tpcds_q87/datafusion:vortex-compact 51787086 50583378 1.02
tpcds_q88/datafusion:vortex-compact 79094127 77240600 1.02
tpcds_q89/datafusion:vortex-compact 31541405 31895775 0.99
tpcds_q90/datafusion:vortex-compact 15594380 14747188 1.06
tpcds_q91/datafusion:vortex-compact 34262117 32705151 1.05
tpcds_q92/datafusion:vortex-compact 22113440 23678422 0.93
tpcds_q93/datafusion:vortex-compact 38957992 38983910 1.00
tpcds_q94/datafusion:vortex-compact 25752159 25973647 0.99
tpcds_q95/datafusion:vortex-compact 65903758 64633750 1.02
tpcds_q96/datafusion:vortex-compact 17510908 16820030 1.04
tpcds_q97/datafusion:vortex-compact 36344625 35561549 1.02
tpcds_q98/datafusion:vortex-compact 32309571 29684630 1.09
tpcds_q99/datafusion:vortex-compact 30842945 33355383 0.92
datafusion / parquet (0.993x ➖, 2↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30382238 32413679 0.94
tpcds_q02/datafusion:parquet 41416549 41330481 1.00
tpcds_q03/datafusion:parquet 12958043 13261339 0.98
tpcds_q04/datafusion:parquet 254789303 264045652 0.96
tpcds_q05/datafusion:parquet 43501049 43180452 1.01
tpcds_q06/datafusion:parquet 57680999 61840926 0.93
tpcds_q07/datafusion:parquet 77025894 76124300 1.01
tpcds_q08/datafusion:parquet 27022954 25303460 1.07
tpcds_q09/datafusion:parquet 46724155 45167453 1.03
tpcds_q10/datafusion:parquet 71986370 68972971 1.04
tpcds_q11/datafusion:parquet 145466126 148790670 0.98
tpcds_q12/datafusion:parquet 18142870 18031275 1.01
tpcds_q13/datafusion:parquet 76102365 73383713 1.04
tpcds_q14/datafusion:parquet 159972442 162019507 0.99
tpcds_q15/datafusion:parquet 21235071 20583445 1.03
tpcds_q16/datafusion:parquet 22939176 23142180 0.99
tpcds_q17/datafusion:parquet 61932246 67215148 0.92
tpcds_q18/datafusion:parquet 113609265 115220474 0.99
tpcds_q19/datafusion:parquet 22623232 22583811 1.00
tpcds_q20/datafusion:parquet 17624858 17206153 1.02
tpcds_q21/datafusion:parquet 18362518 18570948 0.99
tpcds_q22/datafusion:parquet 150425545 139009980 1.08
tpcds_q23/datafusion:parquet 142558647 147010531 0.97
tpcds_q24/datafusion:parquet 93319384 92292809 1.01
tpcds_q25/datafusion:parquet 66183844 63563095 1.04
tpcds_q26/datafusion:parquet 65843781 65555152 1.00
tpcds_q27/datafusion:parquet 144088594 145448896 0.99
tpcds_q28/datafusion:parquet 44843702 42904209 1.05
tpcds_q29/datafusion:parquet 68606645 67096510 1.02
tpcds_q30/datafusion:parquet 34338302 33901855 1.01
tpcds_q31/datafusion:parquet 63297112 64331136 0.98
tpcds_q32/datafusion:parquet 18422938 18353313 1.00
tpcds_q33/datafusion:parquet 26570529 26548411 1.00
tpcds_q34/datafusion:parquet 22978739 21720688 1.06
tpcds_q35/datafusion:parquet 69542858 69937527 0.99
tpcds_q36/datafusion:parquet 58012852 56809088 1.02
tpcds_q37/datafusion:parquet 19170776 18706544 1.02
tpcds_q38/datafusion:parquet 41118280 42453178 0.97
tpcds_q39/datafusion:parquet 75025399 76442077 0.98
tpcds_q40/datafusion:parquet 23135285 23953986 0.97
tpcds_q41/datafusion:parquet 13148751 13386278 0.98
tpcds_q42/datafusion:parquet 11570119 12350162 0.94
tpcds_q43/datafusion:parquet 17733955 17073591 1.04
tpcds_q44/datafusion:parquet 32899794 32489915 1.01
tpcds_q45/datafusion:parquet 28563492 27816481 1.03
tpcds_q46/datafusion:parquet 33099452 32845178 1.01
tpcds_q47/datafusion:parquet 125543856 126489363 0.99
tpcds_q48/datafusion:parquet 70137828 68831403 1.02
tpcds_q49/datafusion:parquet 55709778 56208308 0.99
tpcds_q50/datafusion:parquet 44730660 43276629 1.03
tpcds_q51/datafusion:parquet 84873556 88691672 0.96
tpcds_q52/datafusion:parquet 🚀 11438890 13502771 0.85
tpcds_q53/datafusion:parquet 17686267 17577543 1.01
tpcds_q54/datafusion:parquet 34583333 33873090 1.02
tpcds_q55/datafusion:parquet 11364078 11517391 0.99
tpcds_q56/datafusion:parquet 26881971 27310776 0.98
tpcds_q57/datafusion:parquet 97622164 98605112 0.99
tpcds_q58/datafusion:parquet 49553895 50851588 0.97
tpcds_q59/datafusion:parquet 56730186 56377237 1.01
tpcds_q60/datafusion:parquet 28696224 27313121 1.05
tpcds_q61/datafusion:parquet 44466564 42835802 1.04
tpcds_q62/datafusion:parquet 🚀 19535331 25206364 0.78
tpcds_q63/datafusion:parquet 17658541 17343584 1.02
tpcds_q64/datafusion:parquet 521326765 521976545 1.00
tpcds_q65/datafusion:parquet 39122257 36794582 1.06
tpcds_q66/datafusion:parquet 69194051 70978279 0.97
tpcds_q67/datafusion:parquet 141858743 143259446 0.99
tpcds_q68/datafusion:parquet 31051456 31492969 0.99
tpcds_q69/datafusion:parquet 66421975 63654423 1.04
tpcds_q70/datafusion:parquet 85197478 90431084 0.94
tpcds_q71/datafusion:parquet 21595893 22866045 0.94
tpcds_q72/datafusion:parquet 617950884 627902668 0.98
tpcds_q73/datafusion:parquet 20556290 20666084 0.99
tpcds_q74/datafusion:parquet 82865297 87015889 0.95
tpcds_q75/datafusion:parquet 99055945 98952523 1.00
tpcds_q76/datafusion:parquet 30008942 29886990 1.00
tpcds_q77/datafusion:parquet 41206928 38457588 1.07
tpcds_q78/datafusion:parquet 113981918 112971811 1.01
tpcds_q79/datafusion:parquet 25964303 26155010 0.99
tpcds_q80/datafusion:parquet 80701743 83742633 0.96
tpcds_q81/datafusion:parquet 31558099 31411721 1.00
tpcds_q82/datafusion:parquet 19371285 18881234 1.03
tpcds_q83/datafusion:parquet 36342705 36511759 1.00
tpcds_q84/datafusion:parquet 37820282 38300698 0.99
tpcds_q85/datafusion:parquet 148361151 153432736 0.97
tpcds_q86/datafusion:parquet 15598596 16316165 0.96
tpcds_q87/datafusion:parquet 42116641 43231603 0.97
tpcds_q88/datafusion:parquet 61429761 61017973 1.01
tpcds_q89/datafusion:parquet 22932327 21941020 1.05
tpcds_q90/datafusion:parquet 14096222 14653667 0.96
tpcds_q91/datafusion:parquet 57559100 57204464 1.01
tpcds_q92/datafusion:parquet 17779937 17542062 1.01
tpcds_q93/datafusion:parquet 32517556 32327601 1.01
tpcds_q94/datafusion:parquet 19414793 20583165 0.94
tpcds_q95/datafusion:parquet 58932501 61300335 0.96
tpcds_q96/datafusion:parquet 11474044 12083619 0.95
tpcds_q97/datafusion:parquet 31195119 31291509 1.00
tpcds_q98/datafusion:parquet 20727174 21447054 0.97
tpcds_q99/datafusion:parquet 29547875 32096146 0.92
duckdb / vortex-file-compressed (1.016x ➖, 1↑ 3↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25394360 23780875 1.07
tpcds_q02/duckdb:vortex-file-compressed 🚀 32654581 36671786 0.89
tpcds_q03/duckdb:vortex-file-compressed 🚨 22970937 15554003 1.48
tpcds_q04/duckdb:vortex-file-compressed 95405300 93893857 1.02
tpcds_q05/duckdb:vortex-file-compressed 32095535 32511313 0.99
tpcds_q06/duckdb:vortex-file-compressed 32916839 32384885 1.02
tpcds_q07/duckdb:vortex-file-compressed 21501957 21347043 1.01
tpcds_q08/duckdb:vortex-file-compressed 27247657 26776126 1.02
tpcds_q09/duckdb:vortex-file-compressed 17622006 16673915 1.06
tpcds_q10/duckdb:vortex-file-compressed 37839754 36417067 1.04
tpcds_q11/duckdb:vortex-file-compressed 65117368 64816318 1.00
tpcds_q12/duckdb:vortex-file-compressed 16065417 15360347 1.05
tpcds_q13/duckdb:vortex-file-compressed 32453092 32791603 0.99
tpcds_q14/duckdb:vortex-file-compressed 97548542 95869728 1.02
tpcds_q15/duckdb:vortex-file-compressed 26791308 26473268 1.01
tpcds_q16/duckdb:vortex-file-compressed 26237845 25788690 1.02
tpcds_q17/duckdb:vortex-file-compressed 43238744 44294552 0.98
tpcds_q18/duckdb:vortex-file-compressed 36848675 36271776 1.02
tpcds_q19/duckdb:vortex-file-compressed 32846846 32127800 1.02
tpcds_q20/duckdb:vortex-file-compressed 16846928 16943254 0.99
tpcds_q21/duckdb:vortex-file-compressed 16438462 16495977 1.00
tpcds_q22/duckdb:vortex-file-compressed 75771380 76449894 0.99
tpcds_q23/duckdb:vortex-file-compressed 88490221 94962500 0.93
tpcds_q24/duckdb:vortex-file-compressed 47093922 48305796 0.97
tpcds_q25/duckdb:vortex-file-compressed 41584755 40260286 1.03
tpcds_q26/duckdb:vortex-file-compressed 20842861 19447300 1.07
tpcds_q27/duckdb:vortex-file-compressed 24088004 24169084 1.00
tpcds_q28/duckdb:vortex-file-compressed 11973583 11708040 1.02
tpcds_q29/duckdb:vortex-file-compressed 40094463 39594703 1.01
tpcds_q30/duckdb:vortex-file-compressed 24562905 24896059 0.99
tpcds_q31/duckdb:vortex-file-compressed 29354013 29535454 0.99
tpcds_q32/duckdb:vortex-file-compressed 13344192 12879602 1.04
tpcds_q33/duckdb:vortex-file-compressed 23941875 24063640 0.99
tpcds_q34/duckdb:vortex-file-compressed 24974978 25075153 1.00
tpcds_q35/duckdb:vortex-file-compressed 64101925 63983397 1.00
tpcds_q36/duckdb:vortex-file-compressed 24392578 23367786 1.04
tpcds_q37/duckdb:vortex-file-compressed 19572642 19095664 1.02
tpcds_q38/duckdb:vortex-file-compressed 36205680 36179941 1.00
tpcds_q39/duckdb:vortex-file-compressed 35457153 34685509 1.02
tpcds_q40/duckdb:vortex-file-compressed 20388132 20563831 0.99
tpcds_q41/duckdb:vortex-file-compressed 🚨 10435391 8925288 1.17
tpcds_q42/duckdb:vortex-file-compressed 13707811 12946767 1.06
tpcds_q43/duckdb:vortex-file-compressed 21456058 21009240 1.02
tpcds_q44/duckdb:vortex-file-compressed 21117392 20357879 1.04
tpcds_q45/duckdb:vortex-file-compressed 29726082 29459882 1.01
tpcds_q46/duckdb:vortex-file-compressed 32305964 32871550 0.98
tpcds_q47/duckdb:vortex-file-compressed 51259764 50864631 1.01
tpcds_q48/duckdb:vortex-file-compressed 28592029 28668964 1.00
tpcds_q49/duckdb:vortex-file-compressed 35324662 34077165 1.04
tpcds_q50/duckdb:vortex-file-compressed 26802010 25727181 1.04
tpcds_q51/duckdb:vortex-file-compressed 106413199 103750992 1.03
tpcds_q52/duckdb:vortex-file-compressed 14455158 13192008 1.10
tpcds_q53/duckdb:vortex-file-compressed 22362347 22443309 1.00
tpcds_q54/duckdb:vortex-file-compressed 28486423 28099873 1.01
tpcds_q55/duckdb:vortex-file-compressed 12511308 12508680 1.00
tpcds_q56/duckdb:vortex-file-compressed 25292012 24370961 1.04
tpcds_q57/duckdb:vortex-file-compressed 41868430 42628590 0.98
tpcds_q58/duckdb:vortex-file-compressed 30364338 31125272 0.98
tpcds_q59/duckdb:vortex-file-compressed 56579705 55615016 1.02
tpcds_q60/duckdb:vortex-file-compressed 25760447 25825543 1.00
tpcds_q61/duckdb:vortex-file-compressed 30944919 31177982 0.99
tpcds_q62/duckdb:vortex-file-compressed 15158183 15272723 0.99
tpcds_q63/duckdb:vortex-file-compressed 20436543 19988959 1.02
tpcds_q64/duckdb:vortex-file-compressed 91827246 92244636 1.00
tpcds_q65/duckdb:vortex-file-compressed 22953807 22378719 1.03
tpcds_q66/duckdb:vortex-file-compressed 29601628 29522184 1.00
tpcds_q67/duckdb:vortex-file-compressed 142717074 144345179 0.99
tpcds_q68/duckdb:vortex-file-compressed 29327442 32346184 0.91
tpcds_q69/duckdb:vortex-file-compressed 39633833 39309252 1.01
tpcds_q70/duckdb:vortex-file-compressed 37027416 36948997 1.00
tpcds_q71/duckdb:vortex-file-compressed 21531809 20229074 1.06
tpcds_q72/duckdb:vortex-file-compressed 168190060 169200213 0.99
tpcds_q73/duckdb:vortex-file-compressed 25466781 24190685 1.05
tpcds_q74/duckdb:vortex-file-compressed 42869386 41394081 1.04
tpcds_q75/duckdb:vortex-file-compressed 49417152 50953018 0.97
tpcds_q76/duckdb:vortex-file-compressed 🚨 23676926 20287720 1.17
tpcds_q77/duckdb:vortex-file-compressed 22759157 22529432 1.01
tpcds_q78/duckdb:vortex-file-compressed 76254519 74464031 1.02
tpcds_q79/duckdb:vortex-file-compressed 25168913 25584894 0.98
tpcds_q80/duckdb:vortex-file-compressed 46494742 47222224 0.98
tpcds_q81/duckdb:vortex-file-compressed 29148410 29120624 1.00
tpcds_q82/duckdb:vortex-file-compressed 45372685 45533478 1.00
tpcds_q83/duckdb:vortex-file-compressed 26978356 25214739 1.07
tpcds_q84/duckdb:vortex-file-compressed 17069668 16820376 1.01
tpcds_q85/duckdb:vortex-file-compressed 40593320 38931357 1.04
tpcds_q86/duckdb:vortex-file-compressed 16747657 16125872 1.04
tpcds_q87/duckdb:vortex-file-compressed 39852862 39395232 1.01
tpcds_q88/duckdb:vortex-file-compressed 50349621 51262591 0.98
tpcds_q89/duckdb:vortex-file-compressed 21575271 21209428 1.02
tpcds_q90/duckdb:vortex-file-compressed 10150652 9970608 1.02
tpcds_q91/duckdb:vortex-file-compressed 21029013 21774435 0.97
tpcds_q92/duckdb:vortex-file-compressed 19308691 18674124 1.03
tpcds_q93/duckdb:vortex-file-compressed 30593505 29569400 1.03
tpcds_q94/duckdb:vortex-file-compressed 21320131 21306927 1.00
tpcds_q95/duckdb:vortex-file-compressed 150207098 149690259 1.00
tpcds_q96/duckdb:vortex-file-compressed 12292757 12582453 0.98
tpcds_q97/duckdb:vortex-file-compressed 38268695 38464946 0.99
tpcds_q98/duckdb:vortex-file-compressed 19177455 20047578 0.96
tpcds_q99/duckdb:vortex-file-compressed 22929215 22594128 1.01
duckdb / vortex-compact (1.004x ➖, 1↑ 2↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 28800681 24453787 1.18
tpcds_q02/duckdb:vortex-compact 38629328 38862601 0.99
tpcds_q03/duckdb:vortex-compact 48928950 46116823 1.06
tpcds_q04/duckdb:vortex-compact 106792550 109460324 0.98
tpcds_q05/duckdb:vortex-compact 39215618 42563990 0.92
tpcds_q06/duckdb:vortex-compact 39316795 38412570 1.02
tpcds_q07/duckdb:vortex-compact 35655158 34423088 1.04
tpcds_q08/duckdb:vortex-compact 41348543 40921549 1.01
tpcds_q09/duckdb:vortex-compact 19260376 19561937 0.98
tpcds_q10/duckdb:vortex-compact 53410169 51694826 1.03
tpcds_q11/duckdb:vortex-compact 74677107 73954453 1.01
tpcds_q12/duckdb:vortex-compact 21499910 22355553 0.96
tpcds_q13/duckdb:vortex-compact 51977043 53342045 0.97
tpcds_q14/duckdb:vortex-compact 118393553 112441465 1.05
tpcds_q15/duckdb:vortex-compact 29691013 30201705 0.98
tpcds_q16/duckdb:vortex-compact 27734415 26719390 1.04
tpcds_q17/duckdb:vortex-compact 56278483 54562245 1.03
tpcds_q18/duckdb:vortex-compact 47832738 51242293 0.93
tpcds_q19/duckdb:vortex-compact 43294373 44549574 0.97
tpcds_q20/duckdb:vortex-compact 21061453 20466863 1.03
tpcds_q21/duckdb:vortex-compact 17735014 17672002 1.00
tpcds_q22/duckdb:vortex-compact 78233270 80478344 0.97
tpcds_q23/duckdb:vortex-compact 107763956 109790622 0.98
tpcds_q24/duckdb:vortex-compact 57748103 57017451 1.01
tpcds_q25/duckdb:vortex-compact 54409153 54043665 1.01
tpcds_q26/duckdb:vortex-compact 29537231 30316336 0.97
tpcds_q27/duckdb:vortex-compact 37152212 36569530 1.02
tpcds_q28/duckdb:vortex-compact 33813456 35683308 0.95
tpcds_q29/duckdb:vortex-compact 52303460 53168626 0.98
tpcds_q30/duckdb:vortex-compact 28811832 29839101 0.97
tpcds_q31/duckdb:vortex-compact 35946244 36167621 0.99
tpcds_q32/duckdb:vortex-compact 20604001 20371249 1.01
tpcds_q33/duckdb:vortex-compact 31324764 31981437 0.98
tpcds_q34/duckdb:vortex-compact 30940705 29635316 1.04
tpcds_q35/duckdb:vortex-compact 75621913 75029679 1.01
tpcds_q36/duckdb:vortex-compact 35585809 35504343 1.00
tpcds_q37/duckdb:vortex-compact 24363677 23338004 1.04
tpcds_q38/duckdb:vortex-compact 41279841 41387968 1.00
tpcds_q39/duckdb:vortex-compact 37696521 37585703 1.00
tpcds_q40/duckdb:vortex-compact 23471017 23829805 0.98
tpcds_q41/duckdb:vortex-compact 🚨 11627233 10486910 1.11
tpcds_q42/duckdb:vortex-compact 18447914 19166709 0.96
tpcds_q43/duckdb:vortex-compact 32670669 30614377 1.07
tpcds_q44/duckdb:vortex-compact 29285042 30207820 0.97
tpcds_q45/duckdb:vortex-compact 34593544 35629433 0.97
tpcds_q46/duckdb:vortex-compact 45933436 45298728 1.01
tpcds_q47/duckdb:vortex-compact 61900081 61766904 1.00
tpcds_q48/duckdb:vortex-compact 44532721 45379363 0.98
tpcds_q49/duckdb:vortex-compact 48063326 49104614 0.98
tpcds_q50/duckdb:vortex-compact 37676486 37112428 1.02
tpcds_q51/duckdb:vortex-compact 110626861 111679421 0.99
tpcds_q52/duckdb:vortex-compact 19882886 18989933 1.05
tpcds_q53/duckdb:vortex-compact 33489715 33011739 1.01
tpcds_q54/duckdb:vortex-compact 36651352 37039573 0.99
tpcds_q55/duckdb:vortex-compact 18540391 19274469 0.96
tpcds_q56/duckdb:vortex-compact 33726770 33719624 1.00
tpcds_q57/duckdb:vortex-compact 47336711 45813188 1.03
tpcds_q58/duckdb:vortex-compact 37123997 35276949 1.05
tpcds_q59/duckdb:vortex-compact 66974138 67064833 1.00
tpcds_q60/duckdb:vortex-compact 35502162 34828237 1.02
tpcds_q61/duckdb:vortex-compact 52475629 52771289 0.99
tpcds_q62/duckdb:vortex-compact 21168609 23211122 0.91
tpcds_q63/duckdb:vortex-compact 32709746 32171884 1.02
tpcds_q64/duckdb:vortex-compact 125545425 124948455 1.00
tpcds_q65/duckdb:vortex-compact 30297007 31547412 0.96
tpcds_q66/duckdb:vortex-compact 35479099 35808083 0.99
tpcds_q67/duckdb:vortex-compact 152592762 151288544 1.01
tpcds_q68/duckdb:vortex-compact 45048635 45273833 1.00
tpcds_q69/duckdb:vortex-compact 54831994 56377052 0.97
tpcds_q70/duckdb:vortex-compact 60528815 60323545 1.00
tpcds_q71/duckdb:vortex-compact 28840972 28125986 1.03
tpcds_q72/duckdb:vortex-compact 187180015 184606698 1.01
tpcds_q73/duckdb:vortex-compact 28961364 28852266 1.00
tpcds_q74/duckdb:vortex-compact 47770928 48317157 0.99
tpcds_q75/duckdb:vortex-compact 59142294 59116760 1.00
tpcds_q76/duckdb:vortex-compact 30981200 30961345 1.00
tpcds_q77/duckdb:vortex-compact 39839457 37299100 1.07
tpcds_q78/duckdb:vortex-compact 87158179 89949830 0.97
tpcds_q79/duckdb:vortex-compact 39527970 42566613 0.93
tpcds_q80/duckdb:vortex-compact 71018641 70944958 1.00
tpcds_q81/duckdb:vortex-compact 33368765 32986048 1.01
tpcds_q82/duckdb:vortex-compact 53528117 49882822 1.07
tpcds_q83/duckdb:vortex-compact 35371391 35882257 0.99
tpcds_q84/duckdb:vortex-compact 20629110 20419338 1.01
tpcds_q85/duckdb:vortex-compact 55854074 54487593 1.03
tpcds_q86/duckdb:vortex-compact 20329953 19906214 1.02
tpcds_q87/duckdb:vortex-compact 43759710 45532886 0.96
tpcds_q88/duckdb:vortex-compact 75389035 75233173 1.00
tpcds_q89/duckdb:vortex-compact 34610752 32936670 1.05
tpcds_q90/duckdb:vortex-compact 10637090 10439560 1.02
tpcds_q91/duckdb:vortex-compact 40467693 39490918 1.02
tpcds_q92/duckdb:vortex-compact 46347541 43820703 1.06
tpcds_q93/duckdb:vortex-compact 34021174 32782257 1.04
tpcds_q94/duckdb:vortex-compact 29198747 27297589 1.07
tpcds_q95/duckdb:vortex-compact 🚀 148110160 165279148 0.90
tpcds_q96/duckdb:vortex-compact 16363081 17029794 0.96
tpcds_q97/duckdb:vortex-compact 42652060 41418188 1.03
tpcds_q98/duckdb:vortex-compact 26803572 27525804 0.97
tpcds_q99/duckdb:vortex-compact 27441966 26290420 1.04
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29017435 29678901 0.98
tpcds_q02/duckdb:parquet 24455827 24363535 1.00
tpcds_q03/duckdb:parquet 12893745 13160469 0.98
tpcds_q04/duckdb:parquet 167947089 175095261 0.96
tpcds_q05/duckdb:parquet 32945459 31887654 1.03
tpcds_q06/duckdb:parquet 34406986 34509519 1.00
tpcds_q07/duckdb:parquet 24267667 24549381 0.99
tpcds_q08/duckdb:parquet 29046862 29290968 0.99
tpcds_q09/duckdb:parquet 44793470 44324620 1.01
tpcds_q10/duckdb:parquet 37623361 37651033 1.00
tpcds_q11/duckdb:parquet 94843802 87968091 1.08
tpcds_q12/duckdb:parquet 17079844 17093681 1.00
tpcds_q13/duckdb:parquet 35147150 35106743 1.00
tpcds_q14/duckdb:parquet 103606429 103738877 1.00
tpcds_q15/duckdb:parquet 31069530 30736699 1.01
tpcds_q16/duckdb:parquet 22395862 22839238 0.98
tpcds_q17/duckdb:parquet 38710166 38415384 1.01
tpcds_q18/duckdb:parquet 48841734 48820175 1.00
tpcds_q19/duckdb:parquet 31852284 31477006 1.01
tpcds_q20/duckdb:parquet 19019116 18653895 1.02
tpcds_q21/duckdb:parquet 11522792 11547137 1.00
tpcds_q22/duckdb:parquet 70136198 72031298 0.97
tpcds_q23/duckdb:parquet 82464038 82537472 1.00
tpcds_q24/duckdb:parquet 47624071 46571208 1.02
tpcds_q25/duckdb:parquet 35701767 35672911 1.00
tpcds_q26/duckdb:parquet 39803224 39719379 1.00
tpcds_q27/duckdb:parquet 54928296 52816023 1.04
tpcds_q28/duckdb:parquet 42473888 43472442 0.98
tpcds_q29/duckdb:parquet 39031591 36824937 1.06
tpcds_q30/duckdb:parquet 38107018 37626506 1.01
tpcds_q31/duckdb:parquet 28403586 28536516 1.00
tpcds_q32/duckdb:parquet 12872667 12662942 1.02
tpcds_q33/duckdb:parquet 23288746 23011907 1.01
tpcds_q34/duckdb:parquet 22259258 22162246 1.00
tpcds_q35/duckdb:parquet 60607589 62769418 0.97
tpcds_q36/duckdb:parquet 22299607 22423421 0.99
tpcds_q37/duckdb:parquet 14388833 14325456 1.00
tpcds_q38/duckdb:parquet 36733360 36206801 1.01
tpcds_q39/duckdb:parquet 32373995 32916692 0.98
tpcds_q40/duckdb:parquet 19488816 19513717 1.00
tpcds_q41/duckdb:parquet 8850121 9105004 0.97
tpcds_q42/duckdb:parquet 12669973 12468497 1.02
tpcds_q43/duckdb:parquet 18229377 18156995 1.00
tpcds_q44/duckdb:parquet 26081988 25799929 1.01
tpcds_q45/duckdb:parquet 28606970 28734948 1.00
tpcds_q46/duckdb:parquet 47488609 47766580 0.99
tpcds_q47/duckdb:parquet 48915412 50855730 0.96
tpcds_q48/duckdb:parquet 31957187 32520994 0.98
tpcds_q49/duckdb:parquet 29450475 28275881 1.04
tpcds_q50/duckdb:parquet 26157458 26138513 1.00
tpcds_q51/duckdb:parquet 103137759 104688547 0.99
tpcds_q52/duckdb:parquet 12775868 12460031 1.03
tpcds_q53/duckdb:parquet 20154505 19117910 1.05
tpcds_q54/duckdb:parquet 28889047 29474412 0.98
tpcds_q55/duckdb:parquet 12042436 12146896 0.99
tpcds_q56/duckdb:parquet 23499887 24258914 0.97
tpcds_q57/duckdb:parquet 38223447 38194231 1.00
tpcds_q58/duckdb:parquet 25947289 26201189 0.99
tpcds_q59/duckdb:parquet 36374746 36754536 0.99
tpcds_q60/duckdb:parquet 24357316 26411033 0.92
tpcds_q61/duckdb:parquet 32865618 33878828 0.97
tpcds_q62/duckdb:parquet 12589642 12478292 1.01
tpcds_q63/duckdb:parquet 17517404 17682022 0.99
tpcds_q64/duckdb:parquet 75550363 80510616 0.94
tpcds_q65/duckdb:parquet 23403600 23126102 1.01
tpcds_q66/duckdb:parquet 29243035 29345026 1.00
tpcds_q67/duckdb:parquet 137408612 137815102 1.00
tpcds_q68/duckdb:parquet 39135576 39323871 1.00
tpcds_q69/duckdb:parquet 38724459 38664774 1.00
tpcds_q70/duckdb:parquet 22451238 22162542 1.01
tpcds_q71/duckdb:parquet 21670338 22815621 0.95
tpcds_q72/duckdb:parquet 166469873 167649032 0.99
tpcds_q73/duckdb:parquet 20006327 19492848 1.03
tpcds_q74/duckdb:parquet 126342221 126842280 1.00
tpcds_q75/duckdb:parquet 57466183 54943760 1.05
tpcds_q76/duckdb:parquet 21936157 22223301 0.99
tpcds_q77/duckdb:parquet 25351045 25482092 0.99
tpcds_q78/duckdb:parquet 77057313 77641276 0.99
tpcds_q79/duckdb:parquet 30716603 30286225 1.01
tpcds_q80/duckdb:parquet 43119567 45077874 0.96
tpcds_q81/duckdb:parquet 35596774 34680032 1.03
tpcds_q82/duckdb:parquet 16256368 16727637 0.97
tpcds_q83/duckdb:parquet 18552733 18538199 1.00
tpcds_q84/duckdb:parquet 21453321 21708465 0.99
tpcds_q85/duckdb:parquet 41820051 41575182 1.01
tpcds_q86/duckdb:parquet 13689814 13622809 1.00
tpcds_q87/duckdb:parquet 39241898 38924626 1.01
tpcds_q88/duckdb:parquet 53715164 54401520 0.99
tpcds_q89/duckdb:parquet 21944525 22070631 0.99
tpcds_q90/duckdb:parquet 8619450 8388918 1.03
tpcds_q91/duckdb:parquet 25501061 25112678 1.02
tpcds_q92/duckdb:parquet 13073741 13081472 1.00
tpcds_q93/duckdb:parquet 31996582 31978268 1.00
tpcds_q94/duckdb:parquet 17928115 17979531 1.00
tpcds_q95/duckdb:parquet 146200212 145323157 1.01
tpcds_q96/duckdb:parquet 10348227 10587152 0.98
tpcds_q97/duckdb:parquet 38541592 38200692 1.01
tpcds_q98/duckdb:parquet 23755665 24085761 0.99
tpcds_q99/duckdb:parquet 20300683 20008577 1.01
duckdb / duckdb (1.000x ➖, 3↑ 1↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 22364596 22557835 0.99
tpcds_q02/duckdb:duckdb 19362340 20600871 0.94
tpcds_q03/duckdb:duckdb 10396353 10346974 1.00
tpcds_q04/duckdb:duckdb 173979149 181342684 0.96
tpcds_q05/duckdb:duckdb 21248015 22112862 0.96
tpcds_q06/duckdb:duckdb 28542425 28684926 1.00
tpcds_q07/duckdb:duckdb 40264754 40999634 0.98
tpcds_q08/duckdb:duckdb 120466334 119627529 1.01
tpcds_q09/duckdb:duckdb 20555683 20795407 0.99
tpcds_q10/duckdb:duckdb 27390867 27456422 1.00
tpcds_q11/duckdb:duckdb 91794941 95851409 0.96
tpcds_q12/duckdb:duckdb 14791460 13860317 1.07
tpcds_q13/duckdb:duckdb 26399815 26104238 1.01
tpcds_q14/duckdb:duckdb 93013424 94279856 0.99
tpcds_q15/duckdb:duckdb 24823037 24638169 1.01
tpcds_q16/duckdb:duckdb 19264316 19001898 1.01
tpcds_q17/duckdb:duckdb 23567896 25348615 0.93
tpcds_q18/duckdb:duckdb 47044895 47149337 1.00
tpcds_q19/duckdb:duckdb 19537260 19368232 1.01
tpcds_q20/duckdb:duckdb 14455992 14089111 1.03
tpcds_q21/duckdb:duckdb 7756490 7555847 1.03
tpcds_q22/duckdb:duckdb 61492020 61866005 0.99
tpcds_q23/duckdb:duckdb 76072440 75577479 1.01
tpcds_q24/duckdb:duckdb 25522042 25381978 1.01
tpcds_q25/duckdb:duckdb 18962572 18786336 1.01
tpcds_q26/duckdb:duckdb 28265043 28676864 0.99
tpcds_q27/duckdb:duckdb 41024534 43337548 0.95
tpcds_q28/duckdb:duckdb 26343029 26225311 1.00
tpcds_q29/duckdb:duckdb 24320352 24301530 1.00
tpcds_q30/duckdb:duckdb 31400501 30758308 1.02
tpcds_q31/duckdb:duckdb 52498733 51633696 1.02
tpcds_q32/duckdb:duckdb 8193709 7865922 1.04
tpcds_q33/duckdb:duckdb 16622783 16500647 1.01
tpcds_q34/duckdb:duckdb 18986271 18756249 1.01
tpcds_q35/duckdb:duckdb 37936754 37633527 1.01
tpcds_q36/duckdb:duckdb 72056960 70590728 1.02
tpcds_q37/duckdb:duckdb 9053212 8854317 1.02
tpcds_q38/duckdb:duckdb 34020584 33263664 1.02
tpcds_q39/duckdb:duckdb 28164658 29033490 0.97
tpcds_q40/duckdb:duckdb 14898694 15411903 0.97
tpcds_q41/duckdb:duckdb 10134423 9915227 1.02
tpcds_q42/duckdb:duckdb 🚨 10218010 8859883 1.15
tpcds_q43/duckdb:duckdb 14896478 14731633 1.01
tpcds_q44/duckdb:duckdb 15828723 15776405 1.00
tpcds_q45/duckdb:duckdb 18873750 18702580 1.01
tpcds_q46/duckdb:duckdb 38334064 38946159 0.98
tpcds_q47/duckdb:duckdb 48223969 45387194 1.06
tpcds_q48/duckdb:duckdb 25321305 25144458 1.01
tpcds_q49/duckdb:duckdb 21160935 22074486 0.96
tpcds_q50/duckdb:duckdb 16457690 16268916 1.01
tpcds_q51/duckdb:duckdb 100783924 104258211 0.97
tpcds_q52/duckdb:duckdb 🚀 8989027 10450946 0.86
tpcds_q53/duckdb:duckdb 18306840 17738817 1.03
tpcds_q54/duckdb:duckdb 19095966 18446525 1.04
tpcds_q55/duckdb:duckdb 🚀 8983630 9990985 0.90
tpcds_q56/duckdb:duckdb 17169862 17132716 1.00
tpcds_q57/duckdb:duckdb 36272759 36591510 0.99
tpcds_q58/duckdb:duckdb 17450742 17155991 1.02
tpcds_q59/duckdb:duckdb 37095620 37191326 1.00
tpcds_q60/duckdb:duckdb 18577735 18739368 0.99
tpcds_q61/duckdb:duckdb 17506812 16894393 1.04
tpcds_q62/duckdb:duckdb 9974900 9721248 1.03
tpcds_q63/duckdb:duckdb 15845772 16114039 0.98
tpcds_q64/duckdb:duckdb 59112436 58101694 1.02
tpcds_q65/duckdb:duckdb 36204589 36223255 1.00
tpcds_q66/duckdb:duckdb 26920750 26202766 1.03
tpcds_q67/duckdb:duckdb 131824153 135389238 0.97
tpcds_q68/duckdb:duckdb 27252271 27461310 0.99
tpcds_q69/duckdb:duckdb 28229170 28430773 0.99
tpcds_q70/duckdb:duckdb 16900710 16936078 1.00
tpcds_q71/duckdb:duckdb 16036493 16676159 0.96
tpcds_q72/duckdb:duckdb 45989373 46016631 1.00
tpcds_q73/duckdb:duckdb 14791394 14303885 1.03
tpcds_q74/duckdb:duckdb 146314180 145936020 1.00
tpcds_q75/duckdb:duckdb 47212870 47530870 0.99
tpcds_q76/duckdb:duckdb 15148138 14915786 1.02
tpcds_q77/duckdb:duckdb 16473894 15603176 1.06
tpcds_q78/duckdb:duckdb 66048885 64128672 1.03
tpcds_q79/duckdb:duckdb 20219549 20488420 0.99
tpcds_q80/duckdb:duckdb 31506205 31053293 1.01
tpcds_q81/duckdb:duckdb 42378800 40159214 1.06
tpcds_q82/duckdb:duckdb 10502824 10148822 1.03
tpcds_q83/duckdb:duckdb 11003589 11067675 0.99
tpcds_q84/duckdb:duckdb 14871074 14785801 1.01
tpcds_q85/duckdb:duckdb 26295180 25896768 1.02
tpcds_q86/duckdb:duckdb 12052010 12135436 0.99
tpcds_q87/duckdb:duckdb 35502555 35668990 1.00
tpcds_q88/duckdb:duckdb 31042854 30622417 1.01
tpcds_q89/duckdb:duckdb 22754200 22254923 1.02
tpcds_q90/duckdb:duckdb 6268657 6191273 1.01
tpcds_q91/duckdb:duckdb 14277097 14669390 0.97
tpcds_q92/duckdb:duckdb 9904977 9925025 1.00
tpcds_q93/duckdb:duckdb 23854620 23785440 1.00
tpcds_q94/duckdb:duckdb 14663154 14490642 1.01
tpcds_q95/duckdb:duckdb 🚀 110651675 130476124 0.85
tpcds_q96/duckdb:duckdb 5818679 5935466 0.98
tpcds_q97/duckdb:duckdb 32295803 32996438 0.98
tpcds_q98/duckdb:duckdb 21238210 20999153 1.01
tpcds_q99/duckdb:duckdb 16738626 16531355 1.01

File Size Changes (6 files changed, -0.0% overall, 1↑ 5↓)
File Scale Format Base HEAD Change %
time_dim.vortex 1.0 vortex-file-compressed 380.85 KB 384.30 KB +3.45 KB +0.9%
item.vortex 1.0 vortex-file-compressed 1.66 MB 1.66 MB 48 B -0.0%
item.vortex 1.0 vortex-compact 994.61 KB 994.36 KB 264 B -0.0%
catalog_page.vortex 1.0 vortex-file-compressed 572.19 KB 571.48 KB 720 B -0.1%
customer_address.vortex 1.0 vortex-file-compressed 827.03 KB 825.84 KB 1.20 KB -0.1%
customer.vortex 1.0 vortex-file-compressed 4.27 MB 4.18 MB 93.07 KB -2.1%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (-0.0%)
  • vortex-file-compressed: 271.85 MB → 271.76 MB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.2% -4.3% +2.1% +22.7% ➖ noise
1 datafusion:vortex-file-compressed +11.2% -4.3% +16.1% +23.6% ➖ noise
1 duckdb:duckdb -0.9% -4.3% +3.6% +25.1% ➖ noise
1 duckdb:vortex-compact +17.8% -4.3% +23.0% +24.1% ➖ noise
1 duckdb:vortex-file-compressed +6.8% -4.3% +11.5% +30.9% ➖ noise
2 datafusion:vortex-compact +2.1% +0.3% +1.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +1.3% +0.3% +1.0% +10.0% ➖ noise
2 duckdb:duckdb -6.0% +0.3% -6.3% +29.5% ➖ noise
2 duckdb:vortex-compact -0.6% +0.3% -0.9% +18.3% ➖ noise
2 duckdb:vortex-file-compressed -11.0% +0.3% -11.2% +27.2% ➖ noise
3 datafusion:vortex-compact +3.1% -2.2% +5.4% +22.3% ➖ noise
3 datafusion:vortex-file-compressed +11.9% -2.2% +14.4% +11.3% 🚨 regression
3 duckdb:duckdb +0.5% -2.2% +2.7% +10.0% ➖ noise
3 duckdb:vortex-compact +6.1% -2.2% +8.4% +11.7% ➖ noise
3 duckdb:vortex-file-compressed +47.7% -2.2% +50.9% +19.2% 🚨 regression
4 datafusion:vortex-compact +0.1% -3.8% +4.0% +12.2% ➖ noise
4 datafusion:vortex-file-compressed +0.9% -3.8% +4.9% +10.0% ➖ noise
4 duckdb:duckdb -4.1% -3.8% -0.3% +10.0% ➖ noise
4 duckdb:vortex-compact -2.4% -3.8% +1.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.6% -3.8% +5.6% +13.5% ➖ noise
5 datafusion:vortex-compact +5.9% +2.0% +3.8% +17.4% ➖ noise
5 datafusion:vortex-file-compressed +4.5% +2.0% +2.5% +21.3% ➖ noise
5 duckdb:duckdb -3.9% +2.0% -5.8% +13.2% ➖ noise
5 duckdb:vortex-compact -7.9% +2.0% -9.7% +10.3% ✅ faster
5 duckdb:vortex-file-compressed -1.3% +2.0% -3.2% +10.4% ➖ noise
6 datafusion:vortex-compact +0.2% -3.6% +3.9% +13.8% ➖ noise
6 datafusion:vortex-file-compressed +3.1% -3.6% +7.0% +19.4% ➖ noise
6 duckdb:duckdb -0.5% -3.6% +3.2% +10.0% ➖ noise
6 duckdb:vortex-compact +2.4% -3.6% +6.1% +17.8% ➖ noise
6 duckdb:vortex-file-compressed +1.6% -3.6% +5.4% +10.0% ➖ noise
7 datafusion:vortex-compact -3.6% +0.0% -3.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.2% +0.0% +0.2% +10.0% ➖ noise
7 duckdb:duckdb -1.8% +0.0% -1.8% +10.0% ➖ noise
7 duckdb:vortex-compact +3.6% +0.0% +3.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.7% +0.0% +0.7% +10.0% ➖ noise
8 datafusion:vortex-compact +2.4% +2.9% -0.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.4% +2.9% -1.5% +10.0% ➖ noise
8 duckdb:duckdb +0.7% +2.9% -2.1% +10.0% ➖ noise
8 duckdb:vortex-compact +1.0% +2.9% -1.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.8% +2.9% -1.1% +30.3% ➖ noise
9 datafusion:vortex-compact +5.0% +2.2% +2.7% +10.1% ➖ noise
9 datafusion:vortex-file-compressed +5.0% +2.2% +2.7% +10.0% ➖ noise
9 duckdb:duckdb -1.2% +2.2% -3.3% +10.0% ➖ noise
9 duckdb:vortex-compact -1.5% +2.2% -3.7% +26.4% ➖ noise
9 duckdb:vortex-file-compressed +5.7% +2.2% +3.4% +13.8% ➖ noise
10 datafusion:vortex-compact +1.3% +2.1% -0.8% +12.9% ➖ noise
10 datafusion:vortex-file-compressed +11.2% +2.1% +8.9% +11.6% ➖ noise
10 duckdb:duckdb -0.2% +2.1% -2.3% +10.0% ➖ noise
10 duckdb:vortex-compact +3.3% +2.1% +1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +3.9% +2.1% +1.7% +10.0% ➖ noise
11 datafusion:vortex-compact -0.2% +2.7% -2.8% +12.5% ➖ noise
11 datafusion:vortex-file-compressed -7.6% +2.7% -10.0% +14.3% ➖ noise
11 duckdb:duckdb -4.2% +2.7% -6.7% +15.7% ➖ noise
11 duckdb:vortex-compact +1.0% +2.7% -1.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.5% +2.7% -2.1% +10.0% ➖ noise
12 datafusion:vortex-compact +7.5% +0.3% +7.2% +32.1% ➖ noise
12 datafusion:vortex-file-compressed +3.8% +0.3% +3.6% +10.0% ➖ noise
12 duckdb:duckdb +6.7% +0.3% +6.4% +10.0% ➖ noise
12 duckdb:vortex-compact -3.8% +0.3% -4.1% +18.1% ➖ noise
12 duckdb:vortex-file-compressed +4.6% +0.3% +4.3% +14.6% ➖ noise
13 datafusion:vortex-compact +1.5% +1.9% -0.4% +13.2% ➖ noise
13 datafusion:vortex-file-compressed +16.2% +1.9% +14.1% +10.5% 🚨 regression
13 duckdb:duckdb +1.1% +1.9% -0.7% +10.0% ➖ noise
13 duckdb:vortex-compact -2.6% +1.9% -4.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.0% +1.9% -2.9% +19.6% ➖ noise
14 datafusion:vortex-compact -2.2% -0.7% -1.5% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +5.5% -0.7% +6.2% +12.1% ➖ noise
14 duckdb:duckdb -1.3% -0.7% -0.7% +10.0% ➖ noise
14 duckdb:vortex-compact +5.3% -0.7% +6.0% +18.6% ➖ noise
14 duckdb:vortex-file-compressed +1.8% -0.7% +2.5% +10.0% ➖ noise
15 datafusion:vortex-compact +5.4% +2.1% +3.2% +32.6% ➖ noise
15 datafusion:vortex-file-compressed +5.0% +2.1% +2.8% +10.4% ➖ noise
15 duckdb:duckdb +0.8% +2.1% -1.3% +10.0% ➖ noise
15 duckdb:vortex-compact -1.7% +2.1% -3.7% +17.1% ➖ noise
15 duckdb:vortex-file-compressed +1.2% +2.1% -0.9% +23.4% ➖ noise
16 datafusion:vortex-compact +2.0% -1.4% +3.5% +26.1% ➖ noise
16 datafusion:vortex-file-compressed -0.3% -1.4% +1.1% +45.1% ➖ noise
16 duckdb:duckdb +1.4% -1.4% +2.8% +10.1% ➖ noise
16 duckdb:vortex-compact +3.8% -1.4% +5.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.7% -1.4% +3.2% +12.7% ➖ noise
17 datafusion:vortex-compact -2.5% -3.6% +1.2% +13.4% ➖ noise
17 datafusion:vortex-file-compressed +1.2% -3.6% +5.0% +10.0% ➖ noise
17 duckdb:duckdb -7.0% -3.6% -3.5% +13.8% ➖ noise
17 duckdb:vortex-compact +3.1% -3.6% +7.0% +12.7% ➖ noise
17 duckdb:vortex-file-compressed -2.4% -3.6% +1.3% +12.7% ➖ noise
18 datafusion:vortex-compact -1.4% -0.7% -0.7% +11.7% ➖ noise
18 datafusion:vortex-file-compressed +1.0% -0.7% +1.7% +15.1% ➖ noise
18 duckdb:duckdb -0.2% -0.7% +0.5% +10.0% ➖ noise
18 duckdb:vortex-compact -6.7% -0.7% -6.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.6% -0.7% +2.3% +10.0% ➖ noise
19 datafusion:vortex-compact -4.8% +0.7% -5.4% +16.3% ➖ noise
19 datafusion:vortex-file-compressed +6.4% +0.7% +5.7% +10.0% ➖ noise
19 duckdb:duckdb +0.9% +0.7% +0.2% +10.0% ➖ noise
19 duckdb:vortex-compact -2.8% +0.7% -3.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +2.2% +0.7% +1.5% +23.3% ➖ noise
20 datafusion:vortex-compact +0.8% +2.2% -1.4% +19.7% ➖ noise
20 datafusion:vortex-file-compressed +1.9% +2.2% -0.3% +32.7% ➖ noise
20 duckdb:duckdb +2.6% +2.2% +0.4% +12.0% ➖ noise
20 duckdb:vortex-compact +2.9% +2.2% +0.7% +13.0% ➖ noise
20 duckdb:vortex-file-compressed -0.6% +2.2% -2.7% +13.1% ➖ noise
21 datafusion:vortex-compact -6.2% -0.7% -5.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -3.8% -0.7% -3.1% +10.0% ➖ noise
21 duckdb:duckdb +2.7% -0.7% +3.3% +16.3% ➖ noise
21 duckdb:vortex-compact +0.4% -0.7% +1.0% +11.9% ➖ noise
21 duckdb:vortex-file-compressed -0.3% -0.7% +0.3% +10.9% ➖ noise
22 datafusion:vortex-compact +4.0% +2.6% +1.3% +11.4% ➖ noise
22 datafusion:vortex-file-compressed -0.3% +2.6% -2.8% +19.0% ➖ noise
22 duckdb:duckdb -0.6% +2.6% -3.2% +11.4% ➖ noise
22 duckdb:vortex-compact -2.8% +2.6% -5.3% +11.4% ➖ noise
22 duckdb:vortex-file-compressed -0.9% +2.6% -3.4% +11.5% ➖ noise
23 datafusion:vortex-compact -0.2% -1.6% +1.4% +14.9% ➖ noise
23 datafusion:vortex-file-compressed -2.6% -1.6% -1.0% +10.0% ➖ noise
23 duckdb:duckdb +0.7% -1.6% +2.3% +15.8% ➖ noise
23 duckdb:vortex-compact -1.8% -1.6% -0.3% +17.1% ➖ noise
23 duckdb:vortex-file-compressed -6.8% -1.6% -5.3% +14.2% ➖ noise
24 datafusion:vortex-compact -0.0% +1.7% -1.7% +14.3% ➖ noise
24 datafusion:vortex-file-compressed -3.7% +1.7% -5.2% +16.4% ➖ noise
24 duckdb:duckdb +0.6% +1.7% -1.1% +10.0% ➖ noise
24 duckdb:vortex-compact +1.3% +1.7% -0.4% +16.1% ➖ noise
24 duckdb:vortex-file-compressed -2.5% +1.7% -4.1% +10.0% ➖ noise
25 datafusion:vortex-compact +1.3% +2.1% -0.8% +11.7% ➖ noise
25 datafusion:vortex-file-compressed -4.5% +2.1% -6.4% +10.0% ➖ noise
25 duckdb:duckdb +0.9% +2.1% -1.1% +10.0% ➖ noise
25 duckdb:vortex-compact +0.7% +2.1% -1.4% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +3.3% +2.1% +1.2% +10.0% ➖ noise
26 datafusion:vortex-compact +5.6% +0.3% +5.2% +10.3% ➖ noise
26 datafusion:vortex-file-compressed +0.7% +0.3% +0.4% +10.0% ➖ noise
26 duckdb:duckdb -1.4% +0.3% -1.8% +10.0% ➖ noise
26 duckdb:vortex-compact -2.6% +0.3% -2.9% +21.1% ➖ noise
26 duckdb:vortex-file-compressed +7.2% +0.3% +6.8% +20.0% ➖ noise
27 datafusion:vortex-compact -2.8% +1.5% -4.3% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +2.2% +1.5% +0.7% +18.5% ➖ noise
27 duckdb:duckdb -5.3% +1.5% -6.7% +10.9% ➖ noise
27 duckdb:vortex-compact +1.6% +1.5% +0.1% +13.5% ➖ noise
27 duckdb:vortex-file-compressed -0.3% +1.5% -1.8% +10.0% ➖ noise
28 datafusion:vortex-compact +2.6% +1.1% +1.5% +11.6% ➖ noise
28 datafusion:vortex-file-compressed +20.9% +1.1% +19.6% +10.0% 🚨 regression
28 duckdb:duckdb +0.4% +1.1% -0.6% +10.0% ➖ noise
28 duckdb:vortex-compact -5.2% +1.1% -6.2% +23.4% ➖ noise
28 duckdb:vortex-file-compressed +2.3% +1.1% +1.2% +10.0% ➖ noise
29 datafusion:vortex-compact +0.2% +4.1% -3.8% +19.6% ➖ noise
29 datafusion:vortex-file-compressed +0.1% +4.1% -3.9% +10.0% ➖ noise
29 duckdb:duckdb +0.1% +4.1% -3.9% +11.8% ➖ noise
29 duckdb:vortex-compact -1.6% +4.1% -5.5% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +1.3% +4.1% -2.7% +10.0% ➖ noise
30 datafusion:vortex-compact -8.0% +1.3% -9.2% +10.1% ➖ noise
30 datafusion:vortex-file-compressed -2.3% +1.3% -3.6% +10.8% ➖ noise
30 duckdb:duckdb +2.1% +1.3% +0.8% +10.0% ➖ noise
30 duckdb:vortex-compact -3.4% +1.3% -4.7% +14.0% ➖ noise
30 duckdb:vortex-file-compressed -1.3% +1.3% -2.6% +10.0% ➖ noise
31 datafusion:vortex-compact +6.9% -1.0% +8.0% +13.1% ➖ noise
31 datafusion:vortex-file-compressed +3.6% -1.0% +4.7% +13.4% ➖ noise
31 duckdb:duckdb +1.7% -1.0% +2.7% +10.0% ➖ noise
31 duckdb:vortex-compact -0.6% -1.0% +0.4% +12.8% ➖ noise
31 duckdb:vortex-file-compressed -0.6% -1.0% +0.4% +28.2% ➖ noise
32 datafusion:vortex-compact -2.2% +1.0% -3.2% +24.1% ➖ noise
32 datafusion:vortex-file-compressed +2.9% +1.0% +1.9% +10.0% ➖ noise
32 duckdb:duckdb +4.2% +1.0% +3.1% +10.0% ➖ noise
32 duckdb:vortex-compact +1.1% +1.0% +0.1% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +3.6% +1.0% +2.6% +10.0% ➖ noise
33 datafusion:vortex-compact -0.9% +0.6% -1.5% +10.2% ➖ noise
33 datafusion:vortex-file-compressed -2.3% +0.6% -2.9% +10.4% ➖ noise
33 duckdb:duckdb +0.7% +0.6% +0.1% +10.0% ➖ noise
33 duckdb:vortex-compact -2.1% +0.6% -2.7% +10.7% ➖ noise
33 duckdb:vortex-file-compressed -0.5% +0.6% -1.1% +10.0% ➖ noise
34 datafusion:vortex-compact -2.0% +3.1% -4.9% +10.5% ➖ noise
34 datafusion:vortex-file-compressed -1.0% +3.1% -3.9% +11.2% ➖ noise
34 duckdb:duckdb +1.2% +3.1% -1.8% +10.0% ➖ noise
34 duckdb:vortex-compact +4.4% +3.1% +1.3% +22.2% ➖ noise
34 duckdb:vortex-file-compressed -0.4% +3.1% -3.4% +12.0% ➖ noise
35 datafusion:vortex-compact +5.2% -2.0% +7.4% +17.1% ➖ noise
35 datafusion:vortex-file-compressed +3.4% -2.0% +5.5% +12.8% ➖ noise
35 duckdb:duckdb +0.8% -2.0% +2.9% +10.7% ➖ noise
35 duckdb:vortex-compact +0.8% -2.0% +2.9% +15.9% ➖ noise
35 duckdb:vortex-file-compressed +0.2% -2.0% +2.2% +10.0% ➖ noise
36 datafusion:vortex-compact -8.2% +0.8% -8.9% +10.6% ➖ noise
36 datafusion:vortex-file-compressed -5.4% +0.8% -6.1% +10.8% ➖ noise
36 duckdb:duckdb +2.1% +0.8% +1.3% +10.0% ➖ noise
36 duckdb:vortex-compact +0.2% +0.8% -0.5% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +4.4% +0.8% +3.6% +10.0% ➖ noise
37 datafusion:vortex-compact -0.1% +1.5% -1.5% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +1.0% +1.5% -0.5% +10.0% ➖ noise
37 duckdb:duckdb +2.2% +1.5% +0.8% +10.0% ➖ noise
37 duckdb:vortex-compact +4.4% +1.5% +2.9% +21.1% ➖ noise
37 duckdb:vortex-file-compressed +2.5% +1.5% +1.0% +10.0% ➖ noise
38 datafusion:vortex-compact +7.2% -0.9% +8.1% +11.6% ➖ noise
38 datafusion:vortex-file-compressed +1.5% -0.9% +2.4% +10.0% ➖ noise
38 duckdb:duckdb +2.3% -0.9% +3.2% +10.0% ➖ noise
38 duckdb:vortex-compact -0.3% -0.9% +0.6% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +0.1% -0.9% +1.0% +10.0% ➖ noise
39 datafusion:vortex-compact -3.6% -1.8% -1.9% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +0.9% -1.8% +2.7% +10.0% ➖ noise
39 duckdb:duckdb -3.0% -1.8% -1.3% +10.0% ➖ noise
39 duckdb:vortex-compact +0.3% -1.8% +2.1% +10.0% ➖ noise
39 duckdb:vortex-file-compressed +2.2% -1.8% +4.0% +18.7% ➖ noise
40 datafusion:vortex-compact -0.9% -1.8% +0.9% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -0.5% -1.8% +1.3% +22.3% ➖ noise
40 duckdb:duckdb -3.3% -1.8% -1.6% +10.0% ➖ noise
40 duckdb:vortex-compact -1.5% -1.8% +0.3% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -0.9% -1.8% +0.9% +27.2% ➖ noise
41 datafusion:vortex-compact +6.5% -2.3% +9.0% +10.1% ➖ noise
41 datafusion:vortex-file-compressed +6.5% -2.3% +9.0% +10.5% ➖ noise
41 duckdb:duckdb +2.2% -2.3% +4.6% +10.0% ➖ noise
41 duckdb:vortex-compact +10.9% -2.3% +13.5% +10.0% 🚨 regression
41 duckdb:vortex-file-compressed +16.9% -2.3% +19.7% +10.0% 🚨 regression
42 datafusion:vortex-compact +4.7% -2.4% +7.3% +20.7% ➖ noise
42 datafusion:vortex-file-compressed +7.3% -2.4% +9.9% +12.3% ➖ noise
42 duckdb:duckdb +15.3% -2.4% +18.2% +23.0% ➖ noise
42 duckdb:vortex-compact -3.8% -2.4% -1.4% +19.8% ➖ noise
42 duckdb:vortex-file-compressed +5.9% -2.4% +8.5% +10.6% ➖ noise
43 datafusion:vortex-compact +4.4% +2.1% +2.3% +10.2% ➖ noise
43 datafusion:vortex-file-compressed -0.4% +2.1% -2.5% +10.0% ➖ noise
43 duckdb:duckdb +1.1% +2.1% -1.0% +10.0% ➖ noise
43 duckdb:vortex-compact +6.7% +2.1% +4.5% +14.3% ➖ noise
43 duckdb:vortex-file-compressed +2.1% +2.1% +0.0% +17.4% ➖ noise
44 datafusion:vortex-compact +2.0% +1.2% +0.8% +16.4% ➖ noise
44 datafusion:vortex-file-compressed +10.1% +1.2% +8.8% +10.0% ➖ noise
44 duckdb:duckdb +0.3% +1.2% -0.8% +10.0% ➖ noise
44 duckdb:vortex-compact -3.1% +1.2% -4.2% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +3.7% +1.2% +2.5% +10.0% ➖ noise
45 datafusion:vortex-compact -8.1% +1.1% -9.2% +10.4% ➖ noise
45 datafusion:vortex-file-compressed -0.5% +1.1% -1.6% +10.0% ➖ noise
45 duckdb:duckdb +0.9% +1.1% -0.2% +10.0% ➖ noise
45 duckdb:vortex-compact -2.9% +1.1% -4.0% +10.0% ➖ noise
45 duckdb:vortex-file-compressed +0.9% +1.1% -0.2% +13.4% ➖ noise
46 datafusion:vortex-compact -7.6% +0.1% -7.7% +11.4% ➖ noise
46 datafusion:vortex-file-compressed +14.8% +0.1% +14.7% +18.1% ➖ noise
46 duckdb:duckdb -1.6% +0.1% -1.7% +10.0% ➖ noise
46 duckdb:vortex-compact +1.4% +0.1% +1.3% +14.2% ➖ noise
46 duckdb:vortex-file-compressed -1.7% +0.1% -1.8% +22.6% ➖ noise
47 datafusion:vortex-compact -6.6% -2.3% -4.5% +10.7% ➖ noise
47 datafusion:vortex-file-compressed -0.8% -2.3% +1.6% +11.9% ➖ noise
47 duckdb:duckdb +6.3% -2.3% +8.7% +10.0% ➖ noise
47 duckdb:vortex-compact +0.2% -2.3% +2.6% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +0.8% -2.3% +3.1% +10.0% ➖ noise
48 datafusion:vortex-compact +2.6% +0.1% +2.5% +14.4% ➖ noise
48 datafusion:vortex-file-compressed +15.2% +0.1% +15.2% +12.0% 🚨 regression
48 duckdb:duckdb +0.7% +0.1% +0.6% +10.0% ➖ noise
48 duckdb:vortex-compact -1.9% +0.1% -1.9% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -0.3% +0.1% -0.3% +10.0% ➖ noise
49 datafusion:vortex-compact +1.3% +1.6% -0.3% +11.5% ➖ noise
49 datafusion:vortex-file-compressed +1.0% +1.6% -0.6% +15.3% ➖ noise
49 duckdb:duckdb -4.1% +1.6% -5.7% +10.2% ➖ noise
49 duckdb:vortex-compact -2.1% +1.6% -3.7% +20.0% ➖ noise
49 duckdb:vortex-file-compressed +3.7% +1.6% +2.0% +33.0% ➖ noise
50 datafusion:vortex-compact -0.2% +1.7% -1.9% +11.8% ➖ noise
50 datafusion:vortex-file-compressed +0.2% +1.7% -1.5% +10.0% ➖ noise
50 duckdb:duckdb +1.2% +1.7% -0.5% +10.0% ➖ noise
50 duckdb:vortex-compact +1.5% +1.7% -0.2% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +4.2% +1.7% +2.4% +10.0% ➖ noise
51 datafusion:vortex-compact +2.5% -2.9% +5.6% +12.2% ➖ noise
51 datafusion:vortex-file-compressed +2.0% -2.9% +5.1% +11.1% ➖ noise
51 duckdb:duckdb -3.3% -2.9% -0.4% +19.0% ➖ noise
51 duckdb:vortex-compact -0.9% -2.9% +2.0% +18.0% ➖ noise
51 duckdb:vortex-file-compressed +2.6% -2.9% +5.6% +18.1% ➖ noise
52 datafusion:vortex-compact -10.3% -6.8% -3.7% +22.7% ➖ noise
52 datafusion:vortex-file-compressed +10.2% -6.8% +18.2% +23.7% ➖ noise
52 duckdb:duckdb -14.0% -6.8% -7.7% +22.8% ➖ noise
52 duckdb:vortex-compact +4.7% -6.8% +12.3% +25.3% ➖ noise
52 duckdb:vortex-file-compressed +9.6% -6.8% +17.6% +51.0% ➖ noise
53 datafusion:vortex-compact -2.2% +3.0% -5.0% +11.4% ➖ noise
53 datafusion:vortex-file-compressed +2.8% +3.0% -0.2% +12.2% ➖ noise
53 duckdb:duckdb +3.2% +3.0% +0.2% +10.0% ➖ noise
53 duckdb:vortex-compact +1.4% +3.0% -1.5% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -0.4% +3.0% -3.3% +10.0% ➖ noise
54 datafusion:vortex-compact -2.7% +0.0% -2.7% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -1.5% +0.0% -1.5% +16.3% ➖ noise
54 duckdb:duckdb +3.5% +0.0% +3.5% +10.0% ➖ noise
54 duckdb:vortex-compact -1.0% +0.0% -1.1% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +1.4% +0.0% +1.3% +10.0% ➖ noise
55 datafusion:vortex-compact -1.9% -1.1% -0.8% +10.0% ➖ noise
55 datafusion:vortex-file-compressed +8.5% -1.1% +9.7% +10.3% ➖ noise
55 duckdb:duckdb -10.1% -1.1% -9.1% +16.4% ➖ noise
55 duckdb:vortex-compact -3.8% -1.1% -2.7% +12.0% ➖ noise
55 duckdb:vortex-file-compressed +0.0% -1.1% +1.1% +11.0% ➖ noise
56 datafusion:vortex-compact +0.3% -2.4% +2.7% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -2.9% -2.4% -0.5% +10.0% ➖ noise
56 duckdb:duckdb +0.2% -2.4% +2.6% +10.0% ➖ noise
56 duckdb:vortex-compact +0.0% -2.4% +2.4% +26.8% ➖ noise
56 duckdb:vortex-file-compressed +3.8% -2.4% +6.3% +10.0% ➖ noise
57 datafusion:vortex-compact +9.2% -0.5% +9.7% +13.2% ➖ noise
57 datafusion:vortex-file-compressed +2.4% -0.5% +2.8% +11.1% ➖ noise
57 duckdb:duckdb -0.9% -0.5% -0.4% +10.0% ➖ noise
57 duckdb:vortex-compact +3.3% -0.5% +3.8% +18.6% ➖ noise
57 duckdb:vortex-file-compressed -1.8% -0.5% -1.3% +16.1% ➖ noise
58 datafusion:vortex-compact +2.2% -1.8% +4.1% +12.7% ➖ noise
58 datafusion:vortex-file-compressed -3.2% -1.8% -1.4% +14.2% ➖ noise
58 duckdb:duckdb +1.7% -1.8% +3.5% +10.0% ➖ noise
58 duckdb:vortex-compact +5.2% -1.8% +7.1% +12.7% ➖ noise
58 duckdb:vortex-file-compressed -2.4% -1.8% -0.7% +11.9% ➖ noise
59 datafusion:vortex-compact +1.4% -0.2% +1.6% +11.2% ➖ noise
59 datafusion:vortex-file-compressed +1.6% -0.2% +1.8% +10.0% ➖ noise
59 duckdb:duckdb -0.3% -0.2% -0.1% +10.0% ➖ noise
59 duckdb:vortex-compact -0.1% -0.2% +0.1% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +1.7% -0.2% +1.9% +10.0% ➖ noise
60 datafusion:vortex-compact -4.6% -1.6% -3.0% +21.1% ➖ noise
60 datafusion:vortex-file-compressed +1.4% -1.6% +3.0% +11.4% ➖ noise
60 duckdb:duckdb -0.9% -1.6% +0.7% +10.0% ➖ noise
60 duckdb:vortex-compact +1.9% -1.6% +3.6% +11.4% ➖ noise
60 duckdb:vortex-file-compressed -0.3% -1.6% +1.3% +10.0% ➖ noise
61 datafusion:vortex-compact -1.9% +0.4% -2.2% +12.1% ➖ noise
61 datafusion:vortex-file-compressed +6.9% +0.4% +6.6% +17.0% ➖ noise
61 duckdb:duckdb +3.6% +0.4% +3.3% +10.0% ➖ noise
61 duckdb:vortex-compact -0.6% +0.4% -0.9% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -0.7% +0.4% -1.1% +22.0% ➖ noise
62 datafusion:vortex-compact +7.9% -11.6% +22.0% +24.7% ➖ noise
62 datafusion:vortex-file-compressed -4.6% -11.6% +7.9% +26.8% ➖ noise
62 duckdb:duckdb +2.6% -11.6% +16.0% +19.1% ➖ noise
62 duckdb:vortex-compact -8.8% -11.6% +3.1% +20.3% ➖ noise
62 duckdb:vortex-file-compressed -0.7% -11.6% +12.2% +13.5% ➖ noise
63 datafusion:vortex-compact -1.0% +0.4% -1.4% +19.6% ➖ noise
63 datafusion:vortex-file-compressed -0.3% +0.4% -0.7% +19.9% ➖ noise
63 duckdb:duckdb -1.7% +0.4% -2.1% +10.0% ➖ noise
63 duckdb:vortex-compact +1.7% +0.4% +1.2% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +2.2% +0.4% +1.8% +10.0% ➖ noise
64 datafusion:vortex-compact +1.0% -3.2% +4.4% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -2.3% -3.2% +1.0% +10.0% ➖ noise
64 duckdb:duckdb +1.7% -3.2% +5.1% +10.0% ➖ noise
64 duckdb:vortex-compact +0.5% -3.2% +3.8% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -0.5% -3.2% +2.8% +10.1% ➖ noise
65 datafusion:vortex-compact +2.2% +3.7% -1.5% +23.8% ➖ noise
65 datafusion:vortex-file-compressed -3.2% +3.7% -6.6% +17.4% ➖ noise
65 duckdb:duckdb -0.1% +3.7% -3.6% +15.1% ➖ noise
65 duckdb:vortex-compact -4.0% +3.7% -7.4% +15.5% ➖ noise
65 duckdb:vortex-file-compressed +2.6% +3.7% -1.1% +15.1% ➖ noise
66 datafusion:vortex-compact +0.7% -1.4% +2.2% +19.5% ➖ noise
66 datafusion:vortex-file-compressed +1.9% -1.4% +3.3% +13.1% ➖ noise
66 duckdb:duckdb +2.7% -1.4% +4.2% +10.6% ➖ noise
66 duckdb:vortex-compact -0.9% -1.4% +0.5% +15.1% ➖ noise
66 duckdb:vortex-file-compressed +0.3% -1.4% +1.7% +10.0% ➖ noise
67 datafusion:vortex-compact -2.6% -0.6% -2.0% +13.4% ➖ noise
67 datafusion:vortex-file-compressed +0.3% -0.6% +0.9% +15.4% ➖ noise
67 duckdb:duckdb -2.6% -0.6% -2.0% +10.7% ➖ noise
67 duckdb:vortex-compact +0.9% -0.6% +1.5% +10.1% ➖ noise
67 duckdb:vortex-file-compressed -1.1% -0.6% -0.5% +10.0% ➖ noise
68 datafusion:vortex-compact -0.7% -0.9% +0.2% +37.3% ➖ noise
68 datafusion:vortex-file-compressed +2.0% -0.9% +3.0% +29.0% ➖ noise
68 duckdb:duckdb -0.8% -0.9% +0.2% +10.0% ➖ noise
68 duckdb:vortex-compact -0.5% -0.9% +0.4% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -9.3% -0.9% -8.5% +13.4% ➖ noise
69 datafusion:vortex-compact +1.7% +2.2% -0.5% +13.9% ➖ noise
69 datafusion:vortex-file-compressed +1.8% +2.2% -0.4% +14.9% ➖ noise
69 duckdb:duckdb -0.7% +2.2% -2.9% +10.0% ➖ noise
69 duckdb:vortex-compact -2.7% +2.2% -4.9% +17.4% ➖ noise
69 duckdb:vortex-file-compressed +0.8% +2.2% -1.4% +10.0% ➖ noise
70 datafusion:vortex-compact +0.3% -2.3% +2.7% +16.1% ➖ noise
70 datafusion:vortex-file-compressed -0.5% -2.3% +1.8% +10.0% ➖ noise
70 duckdb:duckdb -0.2% -2.3% +2.1% +10.0% ➖ noise
70 duckdb:vortex-compact +0.3% -2.3% +2.7% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +0.2% -2.3% +2.6% +16.1% ➖ noise
71 datafusion:vortex-compact -2.9% -5.3% +2.6% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +0.8% -5.3% +6.4% +10.0% ➖ noise
71 duckdb:duckdb -3.8% -5.3% +1.5% +10.0% ➖ noise
71 duckdb:vortex-compact +2.5% -5.3% +8.3% +10.0% ➖ noise
71 duckdb:vortex-file-compressed +6.4% -5.3% +12.4% +10.0% 🚨 regression
72 datafusion:vortex-compact +0.3% -1.1% +1.5% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +0.4% -1.1% +1.6% +10.0% ➖ noise
72 duckdb:duckdb -0.1% -1.1% +1.1% +10.0% ➖ noise
72 duckdb:vortex-compact +1.4% -1.1% +2.6% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.6% -1.1% +0.6% +10.0% ➖ noise
73 datafusion:vortex-compact +0.1% +1.0% -0.9% +37.0% ➖ noise
73 datafusion:vortex-file-compressed +0.3% +1.0% -0.7% +11.9% ➖ noise
73 duckdb:duckdb +3.4% +1.0% +2.3% +10.0% ➖ noise
73 duckdb:vortex-compact +0.4% +1.0% -0.7% +15.3% ➖ noise
73 duckdb:vortex-file-compressed +5.3% +1.0% +4.2% +14.9% ➖ noise
74 datafusion:vortex-compact +1.9% -2.6% +4.6% +13.1% ➖ noise
74 datafusion:vortex-file-compressed +0.9% -2.6% +3.6% +20.9% ➖ noise
74 duckdb:duckdb +0.3% -2.6% +2.9% +10.0% ➖ noise
74 duckdb:vortex-compact -1.1% -2.6% +1.5% +16.6% ➖ noise
74 duckdb:vortex-file-compressed +3.6% -2.6% +6.3% +10.0% ➖ noise
75 datafusion:vortex-compact +0.4% +2.3% -1.9% +10.6% ➖ noise
75 datafusion:vortex-file-compressed -4.5% +2.3% -6.7% +11.3% ➖ noise
75 duckdb:duckdb -0.7% +2.3% -2.9% +10.0% ➖ noise
75 duckdb:vortex-compact +0.0% +2.3% -2.2% +10.4% ➖ noise
75 duckdb:vortex-file-compressed -3.0% +2.3% -5.2% +23.4% ➖ noise
76 datafusion:vortex-compact -9.9% -0.4% -9.5% +22.6% ➖ noise
76 datafusion:vortex-file-compressed +7.0% -0.4% +7.5% +23.8% ➖ noise
76 duckdb:duckdb +1.6% -0.4% +2.0% +22.9% ➖ noise
76 duckdb:vortex-compact +0.1% -0.4% +0.5% +20.4% ➖ noise
76 duckdb:vortex-file-compressed +16.7% -0.4% +17.2% +10.0% 🚨 regression
77 datafusion:vortex-compact -1.8% +3.2% -4.9% +13.9% ➖ noise
77 datafusion:vortex-file-compressed -2.3% +3.2% -5.4% +11.3% ➖ noise
77 duckdb:duckdb +5.6% +3.2% +2.3% +11.2% ➖ noise
77 duckdb:vortex-compact +6.8% +3.2% +3.5% +13.7% ➖ noise
77 duckdb:vortex-file-compressed +1.0% +3.2% -2.2% +13.4% ➖ noise
78 datafusion:vortex-compact -1.4% +0.1% -1.4% +10.2% ➖ noise
78 datafusion:vortex-file-compressed -2.9% +0.1% -3.0% +10.0% ➖ noise
78 duckdb:duckdb +3.0% +0.1% +2.9% +10.0% ➖ noise
78 duckdb:vortex-compact -3.1% +0.1% -3.2% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +2.4% +0.1% +2.3% +10.0% ➖ noise
79 datafusion:vortex-compact -0.7% +0.3% -1.0% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +3.4% +0.3% +3.0% +30.4% ➖ noise
79 duckdb:duckdb -1.3% +0.3% -1.6% +10.8% ➖ noise
79 duckdb:vortex-compact -7.1% +0.3% -7.5% +13.7% ➖ noise
79 duckdb:vortex-file-compressed -1.6% +0.3% -2.0% +34.8% ➖ noise
80 datafusion:vortex-compact +0.5% -4.0% +4.7% +15.9% ➖ noise
80 datafusion:vortex-file-compressed -4.7% -4.0% -0.7% +10.0% ➖ noise
80 duckdb:duckdb +1.5% -4.0% +5.7% +10.0% ➖ noise
80 duckdb:vortex-compact +0.1% -4.0% +4.3% +11.0% ➖ noise
80 duckdb:vortex-file-compressed -1.5% -4.0% +2.5% +13.5% ➖ noise
81 datafusion:vortex-compact +0.1% +1.5% -1.4% +10.0% ➖ noise
81 datafusion:vortex-file-compressed -0.3% +1.5% -1.8% +10.0% ➖ noise
81 duckdb:duckdb +5.5% +1.5% +3.9% +10.0% ➖ noise
81 duckdb:vortex-compact +1.2% +1.5% -0.4% +10.0% ➖ noise
81 duckdb:vortex-file-compressed +0.1% +1.5% -1.4% +10.0% ➖ noise
82 datafusion:vortex-compact -7.0% -0.1% -6.9% +20.1% ➖ noise
82 datafusion:vortex-file-compressed -1.0% -0.1% -0.9% +11.6% ➖ noise
82 duckdb:duckdb +3.5% -0.1% +3.6% +12.5% ➖ noise
82 duckdb:vortex-compact +7.3% -0.1% +7.5% +15.7% ➖ noise
82 duckdb:vortex-file-compressed -0.4% -0.1% -0.2% +10.0% ➖ noise
83 datafusion:vortex-compact -3.0% -0.2% -2.8% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -0.6% -0.2% -0.5% +10.0% ➖ noise
83 duckdb:duckdb -0.6% -0.2% -0.4% +10.0% ➖ noise
83 duckdb:vortex-compact -1.4% -0.2% -1.2% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +7.0% -0.2% +7.2% +10.0% ➖ noise
84 datafusion:vortex-compact -0.3% -1.2% +0.9% +10.0% ➖ noise
84 datafusion:vortex-file-compressed +6.1% -1.2% +7.4% +16.8% ➖ noise
84 duckdb:duckdb +0.6% -1.2% +1.8% +10.0% ➖ noise
84 duckdb:vortex-compact +1.0% -1.2% +2.3% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +1.5% -1.2% +2.7% +10.0% ➖ noise
85 datafusion:vortex-compact +1.0% -1.4% +2.4% +24.3% ➖ noise
85 datafusion:vortex-file-compressed -2.3% -1.4% -1.0% +10.0% ➖ noise
85 duckdb:duckdb +1.5% -1.4% +3.0% +10.0% ➖ noise
85 duckdb:vortex-compact +2.5% -1.4% +3.9% +10.9% ➖ noise
85 duckdb:vortex-file-compressed +4.3% -1.4% +5.7% +10.0% ➖ noise
86 datafusion:vortex-compact -1.2% -2.0% +0.8% +14.0% ➖ noise
86 datafusion:vortex-file-compressed -8.7% -2.0% -6.9% +16.2% ➖ noise
86 duckdb:duckdb -0.7% -2.0% +1.3% +10.0% ➖ noise
86 duckdb:vortex-compact +2.1% -2.0% +4.2% +10.8% ➖ noise
86 duckdb:vortex-file-compressed +3.9% -2.0% +6.0% +12.7% ➖ noise
87 datafusion:vortex-compact +2.4% -0.9% +3.3% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +2.6% -0.9% +3.5% +10.0% ➖ noise
87 duckdb:duckdb -0.5% -0.9% +0.4% +10.0% ➖ noise
87 duckdb:vortex-compact -3.9% -0.9% -3.0% +10.0% ➖ noise
87 duckdb:vortex-file-compressed +1.2% -0.9% +2.1% +13.7% ➖ noise
88 datafusion:vortex-compact +2.4% -0.3% +2.7% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +6.4% -0.3% +6.7% +12.1% ➖ noise
88 duckdb:duckdb +1.4% -0.3% +1.7% +10.0% ➖ noise
88 duckdb:vortex-compact +0.2% -0.3% +0.5% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -1.8% -0.3% -1.5% +11.3% ➖ noise
89 datafusion:vortex-compact -1.1% +1.9% -3.0% +18.4% ➖ noise
89 datafusion:vortex-file-compressed -0.7% +1.9% -2.6% +18.3% ➖ noise
89 duckdb:duckdb +2.2% +1.9% +0.3% +14.2% ➖ noise
89 duckdb:vortex-compact +5.1% +1.9% +3.1% +19.3% ➖ noise
89 duckdb:vortex-file-compressed +1.7% +1.9% -0.2% +10.0% ➖ noise
90 datafusion:vortex-compact +5.7% -0.6% +6.4% +13.6% ➖ noise
90 datafusion:vortex-file-compressed -0.5% -0.6% +0.1% +31.1% ➖ noise
90 duckdb:duckdb +1.2% -0.6% +1.8% +13.3% ➖ noise
90 duckdb:vortex-compact +1.9% -0.6% +2.5% +11.5% ➖ noise
90 duckdb:vortex-file-compressed +1.8% -0.6% +2.4% +10.0% ➖ noise
91 datafusion:vortex-compact +4.8% +1.1% +3.6% +17.7% ➖ noise
91 datafusion:vortex-file-compressed +0.8% +1.1% -0.2% +10.0% ➖ noise
91 duckdb:duckdb -2.7% +1.1% -3.7% +10.0% ➖ noise
91 duckdb:vortex-compact +2.5% +1.1% +1.4% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -3.4% +1.1% -4.5% +19.1% ➖ noise
92 datafusion:vortex-compact -6.6% +0.6% -7.2% +12.2% ➖ noise
92 datafusion:vortex-file-compressed -0.5% +0.6% -1.2% +10.0% ➖ noise
92 duckdb:duckdb -0.2% +0.6% -0.8% +10.0% ➖ noise
92 duckdb:vortex-compact +5.8% +0.6% +5.1% +27.7% ➖ noise
92 duckdb:vortex-file-compressed +3.4% +0.6% +2.7% +24.2% ➖ noise
93 datafusion:vortex-compact -0.1% +0.3% -0.4% +20.0% ➖ noise
93 datafusion:vortex-file-compressed +4.5% +0.3% +4.2% +10.0% ➖ noise
93 duckdb:duckdb +0.3% +0.3% -0.0% +10.0% ➖ noise
93 duckdb:vortex-compact +3.8% +0.3% +3.4% +22.2% ➖ noise
93 duckdb:vortex-file-compressed +3.5% +0.3% +3.1% +10.0% ➖ noise
94 datafusion:vortex-compact -0.9% -3.0% +2.2% +15.2% ➖ noise
94 datafusion:vortex-file-compressed -0.8% -3.0% +2.3% +15.4% ➖ noise
94 duckdb:duckdb +1.2% -3.0% +4.3% +12.7% ➖ noise
94 duckdb:vortex-compact +7.0% -3.0% +10.3% +13.9% ➖ noise
94 duckdb:vortex-file-compressed +0.1% -3.0% +3.2% +12.6% ➖ noise
95 datafusion:vortex-compact +2.0% -1.7% +3.7% +14.8% ➖ noise
95 datafusion:vortex-file-compressed +1.1% -1.7% +2.8% +13.2% ➖ noise
95 duckdb:duckdb -15.2% -1.7% -13.8% +17.8% ➖ noise
95 duckdb:vortex-compact -10.4% -1.7% -8.9% +17.5% ➖ noise
95 duckdb:vortex-file-compressed +0.3% -1.7% +2.0% +18.0% ➖ noise
96 datafusion:vortex-compact +4.1% -3.7% +8.1% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +3.3% -3.7% +7.3% +17.4% ➖ noise
96 duckdb:duckdb -2.0% -3.7% +1.8% +11.2% ➖ noise
96 duckdb:vortex-compact -3.9% -3.7% -0.3% +15.1% ➖ noise
96 duckdb:vortex-file-compressed -2.3% -3.7% +1.4% +14.9% ➖ noise
97 datafusion:vortex-compact +2.2% +0.3% +1.9% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -0.1% +0.3% -0.4% +12.6% ➖ noise
97 duckdb:duckdb -2.1% +0.3% -2.4% +10.0% ➖ noise
97 duckdb:vortex-compact +3.0% +0.3% +2.7% +10.0% ➖ noise
97 duckdb:vortex-file-compressed -0.5% +0.3% -0.8% +12.7% ➖ noise
98 datafusion:vortex-compact +8.8% -2.4% +11.5% +23.7% ➖ noise
98 datafusion:vortex-file-compressed -1.4% -2.4% +1.0% +10.0% ➖ noise
98 duckdb:duckdb +1.1% -2.4% +3.6% +11.6% ➖ noise
98 duckdb:vortex-compact -2.6% -2.4% -0.3% +21.8% ➖ noise
98 duckdb:vortex-file-compressed -4.3% -2.4% -2.0% +14.2% ➖ noise
99 datafusion:vortex-compact -7.5% -3.4% -4.3% +25.3% ➖ noise
99 datafusion:vortex-file-compressed +10.1% -3.4% +13.9% +22.9% ➖ noise
99 duckdb:duckdb +1.3% -3.4% +4.8% +17.7% ➖ noise
99 duckdb:vortex-compact +4.4% -3.4% +8.0% +25.0% ➖ noise
99 duckdb:vortex-file-compressed +1.5% -3.4% +5.0% +20.8% ➖ noise

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.8%
Engines: DataFusion No clear signal (-6.2%, environment too noisy confidence) · DuckDB No clear signal (-1.4%, environment too noisy confidence)
Vortex (geomean): 1.180x ➖
Parquet (geomean): 1.226x ➖
Shifts: Parquet (control) +22.6% · Median polish +10.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.368x ❌, 0↑ 3↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 87522497 30883560 2.83
fineweb_q01/datafusion:vortex-file-compressed 🚨 1032253103 461488852 2.24
fineweb_q02/datafusion:vortex-file-compressed 🚨 724699076 520747893 1.39
fineweb_q03/datafusion:vortex-file-compressed 1295807705 1076432719 1.20
fineweb_q04/datafusion:vortex-file-compressed 1152461654 1172548015 0.98
fineweb_q05/datafusion:vortex-file-compressed 1261997527 1094060137 1.15
fineweb_q06/datafusion:vortex-file-compressed 1517207584 1248839443 1.21
fineweb_q07/datafusion:vortex-file-compressed 1121496116 1086046595 1.03
fineweb_q08/datafusion:vortex-file-compressed 504286664 452485197 1.11
datafusion / vortex-compact (1.113x ➖, 0↑ 2↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 35948527 40530117 0.89
fineweb_q01/datafusion:vortex-compact 🚨 693560232 457800328 1.51
fineweb_q02/datafusion:vortex-compact 🚨 840909714 608412771 1.38
fineweb_q03/datafusion:vortex-compact 1364032187 1360087126 1.00
fineweb_q04/datafusion:vortex-compact 1617166651 1630996945 0.99
fineweb_q05/datafusion:vortex-compact 1376530291 1398179891 0.98
fineweb_q06/datafusion:vortex-compact 1369672374 1265839426 1.08
fineweb_q07/datafusion:vortex-compact 1194401295 1132633703 1.05
fineweb_q08/datafusion:vortex-compact 482597691 381698093 1.26
datafusion / parquet (1.316x ❌, 0↑ 5↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 1437935814 1044535919 1.38
fineweb_q01/datafusion:parquet 2132395906 1805287023 1.18
fineweb_q02/datafusion:parquet 2381915365 1870215193 1.27
fineweb_q03/datafusion:parquet 🚨 2324005216 1756257747 1.32
fineweb_q04/datafusion:parquet 🚨 2461278082 1761046079 1.40
fineweb_q05/datafusion:parquet 🚨 2343982995 1737683768 1.35
fineweb_q06/datafusion:parquet 2153252568 1762406897 1.22
fineweb_q07/datafusion:parquet 2082386688 1667818289 1.25
fineweb_q08/datafusion:parquet 🚨 2546408627 1700575811 1.50
duckdb / vortex-file-compressed (1.115x ➖, 0↑ 2↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 110680027 82158577 1.35
fineweb_q01/duckdb:vortex-file-compressed 🚨 846088416 569169220 1.49
fineweb_q02/duckdb:vortex-file-compressed 728315337 599749016 1.21
fineweb_q03/duckdb:vortex-file-compressed 1399989004 1287321540 1.09
fineweb_q04/duckdb:vortex-file-compressed 1558961418 1405517654 1.11
fineweb_q05/duckdb:vortex-file-compressed 1267556323 1390391979 0.91
fineweb_q06/duckdb:vortex-file-compressed 1533760258 1470342136 1.04
fineweb_q07/duckdb:vortex-file-compressed 1322610528 1368049810 0.97
fineweb_q08/duckdb:vortex-file-compressed 592367543 599063104 0.99
duckdb / vortex-compact (1.140x ➖, 0↑ 2↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 108022154 80237184 1.35
fineweb_q01/duckdb:vortex-compact 🚨 822223590 569504570 1.44
fineweb_q02/duckdb:vortex-compact 714962037 584174010 1.22
fineweb_q03/duckdb:vortex-compact 1659932471 1729571553 0.96
fineweb_q04/duckdb:vortex-compact 1804913284 1852282475 0.97
fineweb_q05/duckdb:vortex-compact 1653041151 1615213383 1.02
fineweb_q06/duckdb:vortex-compact 1766059488 1599584890 1.10
fineweb_q07/duckdb:vortex-compact 1517918563 1392316063 1.09
fineweb_q08/duckdb:vortex-compact 613958632 518140800 1.18
duckdb / parquet (1.143x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1260253409 1069987287 1.18
fineweb_q01/duckdb:parquet 1448311501 1287776565 1.12
fineweb_q02/duckdb:parquet 1648959346 1313681438 1.26
fineweb_q03/duckdb:parquet 4294428746 3588334794 1.20
fineweb_q04/duckdb:parquet 2034484224 1892643285 1.07
fineweb_q05/duckdb:parquet 2647554474 2163723589 1.22
fineweb_q06/duckdb:parquet 4556157320 4346937825 1.05
fineweb_q07/duckdb:parquet 3276734578 2768725270 1.18
fineweb_q08/duckdb:parquet 1158492538 1126267002 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -11.3% +27.3% -30.3% +208.8% ➖ noise
0 datafusion:vortex-file-compressed +183.4% +27.3% +122.6% +258.3% ➖ noise
0 duckdb:vortex-compact +34.6% +27.3% +5.7% +74.3% ➖ noise
0 duckdb:vortex-file-compressed +34.7% +27.3% +5.8% +54.5% ➖ noise
1 datafusion:vortex-compact +51.5% +15.3% +31.4% +70.2% ➖ noise
1 datafusion:vortex-file-compressed +123.7% +15.3% +94.1% +51.6% 🚨 regression
1 duckdb:vortex-compact +44.4% +15.3% +25.3% +58.3% ➖ noise
1 duckdb:vortex-file-compressed +48.7% +15.3% +29.0% +42.0% ➖ noise
2 datafusion:vortex-compact +38.2% +26.4% +9.3% +32.2% ➖ noise
2 datafusion:vortex-file-compressed +39.2% +26.4% +10.1% +60.1% ➖ noise
2 duckdb:vortex-compact +22.4% +26.4% -3.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +21.4% +26.4% -4.0% +30.0% ➖ noise
3 datafusion:vortex-compact +0.3% +25.8% -20.3% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +20.4% +25.8% -4.3% +30.0% ➖ noise
3 duckdb:vortex-compact -4.0% +25.8% -23.7% +30.0% ✅ faster
3 duckdb:vortex-file-compressed +8.8% +25.8% -13.6% +30.0% ➖ noise
4 datafusion:vortex-compact -0.8% +22.6% -19.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -1.7% +22.6% -19.8% +30.0% ➖ noise
4 duckdb:vortex-compact -2.6% +22.6% -20.5% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +10.9% +22.6% -9.5% +30.0% ➖ noise
5 datafusion:vortex-compact -1.5% +28.5% -23.4% +30.0% ✅ faster
5 datafusion:vortex-file-compressed +15.3% +28.5% -10.2% +30.0% ➖ noise
5 duckdb:vortex-compact +2.3% +28.5% -20.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -8.8% +28.5% -29.0% +30.0% ✅ faster
6 datafusion:vortex-compact +8.2% +13.2% -4.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +21.5% +13.2% +7.4% +30.0% ➖ noise
6 duckdb:vortex-compact +10.4% +13.2% -2.4% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +4.3% +13.2% -7.8% +30.0% ➖ noise
7 datafusion:vortex-compact +5.5% +21.6% -13.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +3.3% +21.6% -15.1% +30.0% ➖ noise
7 duckdb:vortex-compact +9.0% +21.6% -10.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -3.3% +21.6% -20.5% +30.0% ➖ noise
8 datafusion:vortex-compact +26.4% +24.1% +1.9% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +11.4% +24.1% -10.2% +30.0% ➖ noise
8 duckdb:vortex-compact +18.5% +24.1% -4.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -1.1% +24.1% -20.3% +30.0% ➖ noise

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): 1.025x ➖
Parquet (geomean): 1.026x ➖
Shifts: Parquet (control) +2.6% · Median polish +2.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed (1.037x ➖, 0↑ 1↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12517850 11783047 1.06
statpopgen_q01/duckdb:vortex-file-compressed 🚨 31498666 25617444 1.23
statpopgen_q02/duckdb:vortex-file-compressed 550109119 531547269 1.03
statpopgen_q03/duckdb:vortex-file-compressed 1063600534 1052749228 1.01
statpopgen_q04/duckdb:vortex-file-compressed 1083268123 1071431130 1.01
statpopgen_q05/duckdb:vortex-file-compressed 504990345 519181529 0.97
statpopgen_q06/duckdb:vortex-file-compressed 1543610583 1537534260 1.00
statpopgen_q07/duckdb:vortex-file-compressed 205606125 197671841 1.04
statpopgen_q08/duckdb:vortex-file-compressed 240113628 230350456 1.04
statpopgen_q09/duckdb:vortex-file-compressed 851927144 862797801 0.99
statpopgen_q10/duckdb:vortex-file-compressed 2622406682 2544780095 1.03
duckdb / vortex-compact (1.014x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 12127928 11501958 1.05
statpopgen_q01/duckdb:vortex-compact 216775305 217466403 1.00
statpopgen_q02/duckdb:vortex-compact 567248182 552666761 1.03
statpopgen_q03/duckdb:vortex-compact 1161794305 1144901591 1.01
statpopgen_q04/duckdb:vortex-compact 1163250446 1146627287 1.01
statpopgen_q05/duckdb:vortex-compact 569756432 569146572 1.00
statpopgen_q06/duckdb:vortex-compact 1496688231 1495285310 1.00
statpopgen_q07/duckdb:vortex-compact 891267052 888119705 1.00
statpopgen_q08/duckdb:vortex-compact 934247692 931985973 1.00
statpopgen_q09/duckdb:vortex-compact 926271983 905457786 1.02
statpopgen_q10/duckdb:vortex-compact 2626879458 2591539238 1.01
duckdb / parquet (1.026x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 307694935 299886220 1.03
statpopgen_q01/duckdb:parquet 389020470 375649704 1.04
statpopgen_q02/duckdb:parquet 773192365 754473568 1.02
statpopgen_q03/duckdb:parquet 1194722754 1186046166 1.01
statpopgen_q04/duckdb:parquet 1217309214 1191691285 1.02
statpopgen_q05/duckdb:parquet 820420323 808359447 1.01
statpopgen_q06/duckdb:parquet 1442771176 1408593947 1.02
statpopgen_q07/duckdb:parquet 873640709 833940477 1.05
statpopgen_q08/duckdb:parquet 876211837 843689315 1.04
statpopgen_q09/duckdb:parquet 1023821633 1000944211 1.02
statpopgen_q10/duckdb:parquet 2250193057 2192663517 1.03

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB 60.32 KB -0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +5.4% +2.6% +2.8% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +6.2% +2.6% +3.5% +10.0% ➖ noise
1 duckdb:vortex-compact -0.3% +3.6% -3.7% +23.4% ➖ noise
1 duckdb:vortex-file-compressed +23.0% +3.6% +18.7% +213.9% ➖ noise
2 duckdb:vortex-compact +2.6% +2.5% +0.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +3.5% +2.5% +1.0% +10.0% ➖ noise
3 duckdb:vortex-compact +1.5% +0.7% +0.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.0% +0.7% +0.3% +10.0% ➖ noise
4 duckdb:vortex-compact +1.4% +2.1% -0.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.1% +2.1% -1.0% +10.0% ➖ noise
5 duckdb:vortex-compact +0.1% +1.5% -1.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.7% +1.5% -4.2% +10.0% ➖ noise
6 duckdb:vortex-compact +0.1% +2.4% -2.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.4% +2.4% -2.0% +10.0% ➖ noise
7 duckdb:vortex-compact +0.4% +4.8% -4.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.0% +4.8% -0.7% +10.0% ➖ noise
8 duckdb:vortex-compact +0.2% +3.9% -3.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +4.2% +3.9% +0.4% +10.0% ➖ noise
9 duckdb:vortex-compact +2.3% +2.3% +0.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.3% +2.3% -3.5% +10.0% ➖ noise
10 duckdb:vortex-compact +1.4% +2.6% -1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +3.1% +2.6% +0.4% +10.0% ➖ noise

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.907x ➖
Parquet (geomean): 0.952x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (0.980x ➖, 13↑ 2↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1770137 365773 4.84
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1069279 1043606 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk 🚀 8294176258 9465892264 0.88
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8304080258 8479824199 0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk 3443084 3672777 0.94
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 2758891 3072885 0.90
random-access/feature-vectors/uniform/lance-tokio-local-disk 1195566 1169455 1.02
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1868853 1841064 1.02
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8311021960 8298884179 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8226709254 8399886176 0.98
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚨 6125097 4390515 1.40
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 6003360 5940776 1.01
random-access/lance-tokio-local-disk 642390 663356 0.97
random-access/lance-tokio-local-disk-footer 1314124 1388591 0.95
random-access/nested-lists/correlated/lance-tokio-local-disk 245241 240165 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 590299 584449 1.01
random-access/nested-lists/correlated/parquet-tokio-local-disk 128731431 130870086 0.98
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 128856682 130219078 0.99
random-access/nested-lists/correlated/vortex-tokio-local-disk 556704 535669 1.04
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 585880 572911 1.02
random-access/nested-lists/uniform/lance-tokio-local-disk 1002623 986235 1.02
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1360456 1335454 1.02
random-access/nested-lists/uniform/parquet-tokio-local-disk 128944673 130201196 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 128423819 130868488 0.98
random-access/nested-lists/uniform/vortex-tokio-local-disk 2051093 1979933 1.04
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2043944 2033465 1.01
random-access/nested-structs/correlated/lance-tokio-local-disk 371032 363532 1.02
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 553381 543346 1.02
random-access/nested-structs/correlated/parquet-tokio-local-disk 22422025 21592046 1.04
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 22357885 2118520 1.06
random-access/nested-structs/correlated/vortex-tokio-local-disk 708396 698682 1.01
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 714864 713236 1.00
random-access/nested-structs/uniform/lance-tokio-local-disk 2617821 2569878 1.02
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2763075 2699916 1.02
random-access/nested-structs/uniform/parquet-tokio-local-disk 22208259 21928655 1.01
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 22330844 21550241 1.04
random-access/nested-structs/uniform/vortex-tokio-local-disk 1551595 1514433 1.02
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1506639 1542636 0.98
random-access/parquet-tokio-local-disk 165111730 171519432 0.96
random-access/parquet-tokio-local-disk-footer 🚀 165814732 191037815 0.87
random-access/taxi/correlated/lance-tokio-local-disk 946602 975212 0.97
random-access/taxi/correlated/lance-tokio-local-disk-footer 1839201 1981043 0.93
random-access/taxi/correlated/parquet-tokio-local-disk 🚀 248640038 297163859 0.84
random-access/taxi/correlated/parquet-tokio-local-disk-footer 🚀 248597871 289951672 0.86
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1400107 2275568 0.62
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1539024 2371878 0.65
random-access/taxi/uniform/lance-tokio-local-disk 9287791 9488208 0.98
random-access/taxi/uniform/lance-tokio-local-disk-footer 9840209 9977168 0.99
random-access/taxi/uniform/parquet-tokio-local-disk 🚀 263115842 301336089 0.87
random-access/taxi/uniform/parquet-tokio-local-disk-footer 🚀 263366881 305160593 0.86
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4038388 4766842 0.85
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 3999478 5044374 0.79
random-access/vortex-tokio-local-disk 🚀 1052161 1427672 0.74
random-access/vortex-tokio-local-disk-footer 🚀 1067928 1645059 0.65

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.2%
Engines: DataFusion No clear signal (+1.6%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): 1.009x ➖
Parquet (geomean): 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.027x ➖, 0↑ 1↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 401089182 392333159 1.02
tpch_q02/datafusion:vortex-file-compressed 110650836 109941291 1.01
tpch_q03/datafusion:vortex-file-compressed 212763745 210551036 1.01
tpch_q04/datafusion:vortex-file-compressed 116333815 110936910 1.05
tpch_q05/datafusion:vortex-file-compressed 382619297 377268391 1.01
tpch_q06/datafusion:vortex-file-compressed 36772470 37842906 0.97
tpch_q07/datafusion:vortex-file-compressed 506373376 502479913 1.01
tpch_q08/datafusion:vortex-file-compressed 368829207 367964431 1.00
tpch_q09/datafusion:vortex-file-compressed 654667040 648329667 1.01
tpch_q10/datafusion:vortex-file-compressed 229830042 229154899 1.00
tpch_q11/datafusion:vortex-file-compressed 87386065 84135005 1.04
tpch_q12/datafusion:vortex-file-compressed 118045269 112828031 1.05
tpch_q13/datafusion:vortex-file-compressed 220480573 215882807 1.02
tpch_q14/datafusion:vortex-file-compressed 53537584 51439867 1.04
tpch_q15/datafusion:vortex-file-compressed 99867219 99480527 1.00
tpch_q16/datafusion:vortex-file-compressed 77114753 75569295 1.02
tpch_q17/datafusion:vortex-file-compressed 642836241 642105603 1.00
tpch_q18/datafusion:vortex-file-compressed 860084881 868663360 0.99
tpch_q19/datafusion:vortex-file-compressed 🚨 77051923 57473646 1.34
tpch_q20/datafusion:vortex-file-compressed 166749805 165405661 1.01
tpch_q21/datafusion:vortex-file-compressed 674447443 667311633 1.01
tpch_q22/datafusion:vortex-file-compressed 68743015 66708601 1.03
datafusion / vortex-compact (1.010x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 442997318 441216717 1.00
tpch_q02/datafusion:vortex-compact 114050207 115880580 0.98
tpch_q03/datafusion:vortex-compact 215492046 210549477 1.02
tpch_q04/datafusion:vortex-compact 120131685 118148596 1.02
tpch_q05/datafusion:vortex-compact 383230437 379880029 1.01
tpch_q06/datafusion:vortex-compact 59688887 59933674 1.00
tpch_q07/datafusion:vortex-compact 527773827 524713091 1.01
tpch_q08/datafusion:vortex-compact 379928665 376222438 1.01
tpch_q09/datafusion:vortex-compact 647612407 660220180 0.98
tpch_q10/datafusion:vortex-compact 249464363 248079961 1.01
tpch_q11/datafusion:vortex-compact 86256006 86714446 0.99
tpch_q12/datafusion:vortex-compact 160726119 155513219 1.03
tpch_q13/datafusion:vortex-compact 268337845 265165747 1.01
tpch_q14/datafusion:vortex-compact 71003645 69394576 1.02
tpch_q15/datafusion:vortex-compact 157032356 156135373 1.01
tpch_q16/datafusion:vortex-compact 80347127 78545932 1.02
tpch_q17/datafusion:vortex-compact 649514879 652645312 1.00
tpch_q18/datafusion:vortex-compact 873307446 876270430 1.00
tpch_q19/datafusion:vortex-compact 129460481 119640856 1.08
tpch_q20/datafusion:vortex-compact 188126031 186092067 1.01
tpch_q21/datafusion:vortex-compact 686750265 680955868 1.01
tpch_q22/datafusion:vortex-compact 71655606 71909544 1.00
datafusion / parquet (0.996x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 462944641 476981869 0.97
tpch_q02/datafusion:parquet 178426710 177435466 1.01
tpch_q03/datafusion:parquet 285931329 285342156 1.00
tpch_q04/datafusion:parquet 128983408 130304243 0.99
tpch_q05/datafusion:parquet 442037085 444781036 0.99
tpch_q06/datafusion:parquet 127988116 125903665 1.02
tpch_q07/datafusion:parquet 609556676 615718830 0.99
tpch_q08/datafusion:parquet 472277614 473256610 1.00
tpch_q09/datafusion:parquet 753351280 765424145 0.98
tpch_q10/datafusion:parquet 504270511 504946890 1.00
tpch_q11/datafusion:parquet 118265421 118201574 1.00
tpch_q12/datafusion:parquet 192243386 198422157 0.97
tpch_q13/datafusion:parquet 333628506 333849823 1.00
tpch_q14/datafusion:parquet 162130721 169068003 0.96
tpch_q15/datafusion:parquet 249601673 245268172 1.02
tpch_q16/datafusion:parquet 124894386 128511005 0.97
tpch_q17/datafusion:parquet 683693390 694982362 0.98
tpch_q18/datafusion:parquet 911419585 902942766 1.01
tpch_q19/datafusion:parquet 269259208 264633016 1.02
tpch_q20/datafusion:parquet 299788102 288576205 1.04
tpch_q21/datafusion:parquet 712687268 703604149 1.01
tpch_q22/datafusion:parquet 218122971 220143150 0.99
datafusion / arrow (1.000x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 593959608 593223903 1.00
tpch_q02/datafusion:arrow 162944451 166272125 0.98
tpch_q03/datafusion:arrow 456807305 459034531 1.00
tpch_q04/datafusion:arrow 329318391 330639737 1.00
tpch_q05/datafusion:arrow 917080480 924559086 0.99
tpch_q06/datafusion:arrow 278239814 278398690 1.00
tpch_q07/datafusion:arrow 1149016307 1181789428 0.97
tpch_q08/datafusion:arrow 1152220753 1140641021 1.01
tpch_q09/datafusion:arrow 1426882166 1352252081 1.06
tpch_q10/datafusion:arrow 599366394 600662696 1.00
tpch_q11/datafusion:arrow 137465608 139737328 0.98
tpch_q12/datafusion:arrow 686854122 690640491 0.99
tpch_q13/datafusion:arrow 504468969 508886904 0.99
tpch_q14/datafusion:arrow 312170132 329671076 0.95
tpch_q15/datafusion:arrow 742107041 690957564 1.07
tpch_q16/datafusion:arrow 111834113 106613218 1.05
tpch_q17/datafusion:arrow 1384056767 1348271885 1.03
tpch_q18/datafusion:arrow 1916830098 1930015791 0.99
tpch_q19/datafusion:arrow 490001946 495028745 0.99
tpch_q20/datafusion:arrow 490085576 490315025 1.00
tpch_q21/datafusion:arrow 2983285435 3020959015 0.99
tpch_q22/datafusion:arrow 130463765 132934304 0.98
duckdb / vortex-file-compressed (1.005x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 169258230 169932022 1.00
tpch_q02/duckdb:vortex-file-compressed 53288896 52597674 1.01
tpch_q03/duckdb:vortex-file-compressed 123611735 120827751 1.02
tpch_q04/duckdb:vortex-file-compressed 161515108 158612379 1.02
tpch_q05/duckdb:vortex-file-compressed 137466267 136305388 1.01
tpch_q06/duckdb:vortex-file-compressed 35080755 34782216 1.01
tpch_q07/duckdb:vortex-file-compressed 130973453 131776233 0.99
tpch_q08/duckdb:vortex-file-compressed 168353794 171077506 0.98
tpch_q09/duckdb:vortex-file-compressed 391550116 397053540 0.99
tpch_q10/duckdb:vortex-file-compressed 190120626 189317509 1.00
tpch_q11/duckdb:vortex-file-compressed 32080400 32373162 0.99
tpch_q12/duckdb:vortex-file-compressed 102209562 100046236 1.02
tpch_q13/duckdb:vortex-file-compressed 275359035 272296528 1.01
tpch_q14/duckdb:vortex-file-compressed 53664693 53366039 1.01
tpch_q15/duckdb:vortex-file-compressed 88756257 87519762 1.01
tpch_q16/duckdb:vortex-file-compressed 77908935 76116030 1.02
tpch_q17/duckdb:vortex-file-compressed 92538594 92633253 1.00
tpch_q18/duckdb:vortex-file-compressed 283310484 289121950 0.98
tpch_q19/duckdb:vortex-file-compressed 79877554 79747041 1.00
tpch_q20/duckdb:vortex-file-compressed 143513065 141755983 1.01
tpch_q21/duckdb:vortex-file-compressed 490053414 489421633 1.00
tpch_q22/duckdb:vortex-file-compressed 64982342 64148714 1.01
duckdb / vortex-compact (0.996x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229500417 228877581 1.00
tpch_q02/duckdb:vortex-compact 58134530 56466261 1.03
tpch_q03/duckdb:vortex-compact 134688765 135557575 0.99
tpch_q04/duckdb:vortex-compact 169917717 171321101 0.99
tpch_q05/duckdb:vortex-compact 164436265 167375272 0.98
tpch_q06/duckdb:vortex-compact 56994352 54945481 1.04
tpch_q07/duckdb:vortex-compact 172819570 173554493 1.00
tpch_q08/duckdb:vortex-compact 186082901 188999444 0.98
tpch_q09/duckdb:vortex-compact 426481676 425625558 1.00
tpch_q10/duckdb:vortex-compact 217704377 220572131 0.99
tpch_q11/duckdb:vortex-compact 38351230 39072609 0.98
tpch_q12/duckdb:vortex-compact 162981643 162407901 1.00
tpch_q13/duckdb:vortex-compact 324263877 323803693 1.00
tpch_q14/duckdb:vortex-compact 71929384 71721086 1.00
tpch_q15/duckdb:vortex-compact 114879611 114878321 1.00
tpch_q16/duckdb:vortex-compact 79691591 82076582 0.97
tpch_q17/duckdb:vortex-compact 105484374 107763204 0.98
tpch_q18/duckdb:vortex-compact 286694616 289549531 0.99
tpch_q19/duckdb:vortex-compact 96233675 96079695 1.00
tpch_q20/duckdb:vortex-compact 174515972 176938932 0.99
tpch_q21/duckdb:vortex-compact 507097955 510526198 0.99
tpch_q22/duckdb:vortex-compact 71162236 71793175 0.99
duckdb / parquet (0.991x ➖, 1↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 260729410 269853392 0.97
tpch_q02/duckdb:parquet 102274965 102737003 1.00
tpch_q03/duckdb:parquet 215296750 211483198 1.02
tpch_q04/duckdb:parquet 133268453 133962320 0.99
tpch_q05/duckdb:parquet 224454372 223656726 1.00
tpch_q06/duckdb:parquet 74213301 73552273 1.01
tpch_q07/duckdb:parquet 187915416 184876259 1.02
tpch_q08/duckdb:parquet 257860199 264438635 0.98
tpch_q09/duckdb:parquet 483274024 474240282 1.02
tpch_q10/duckdb:parquet 622607185 623120871 1.00
tpch_q11/duckdb:parquet 69195399 69894008 0.99
tpch_q12/duckdb:parquet 133313947 130473285 1.02
tpch_q13/duckdb:parquet 439927625 443768624 0.99
tpch_q14/duckdb:parquet 178966221 182112529 0.98
tpch_q15/duckdb:parquet 104618813 104857978 1.00
tpch_q16/duckdb:parquet 🚀 139641914 164223342 0.85
tpch_q17/duckdb:parquet 181061667 182534140 0.99
tpch_q18/duckdb:parquet 365749878 360134482 1.02
tpch_q19/duckdb:parquet 287707182 288539347 1.00
tpch_q20/duckdb:parquet 222531936 231671904 0.96
tpch_q21/duckdb:parquet 556333970 550282165 1.01
tpch_q22/duckdb:parquet 295859050 295146138 1.00
duckdb / duckdb (0.995x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120051738 120498694 1.00
tpch_q02/duckdb:duckdb 52845629 50213031 1.05
tpch_q03/duckdb:duckdb 103746511 103642663 1.00
tpch_q04/duckdb:duckdb 138071519 140567544 0.98
tpch_q05/duckdb:duckdb 118028444 119418765 0.99
tpch_q06/duckdb:duckdb 44636938 44781411 1.00
tpch_q07/duckdb:duckdb 90569875 92411479 0.98
tpch_q08/duckdb:duckdb 117664168 119285294 0.99
tpch_q09/duckdb:duckdb 282869461 281912487 1.00
tpch_q10/duckdb:duckdb 212085014 214565000 0.99
tpch_q11/duckdb:duckdb 18858976 19100844 0.99
tpch_q12/duckdb:duckdb 91155218 91531958 1.00
tpch_q13/duckdb:duckdb 229243043 233830475 0.98
tpch_q14/duckdb:duckdb 77482820 78734102 0.98
tpch_q15/duckdb:duckdb 81035076 81732325 0.99
tpch_q16/duckdb:duckdb 74886132 76088412 0.98
tpch_q17/duckdb:duckdb 87880055 88127980 1.00
tpch_q18/duckdb:duckdb 234485172 231594299 1.01
tpch_q19/duckdb:duckdb 123879955 123899255 1.00
tpch_q20/duckdb:duckdb 117867214 118479980 0.99
tpch_q21/duckdb:duckdb 297755538 300816185 0.99
tpch_q22/duckdb:duckdb 68951674 69426340 0.99

File Size Changes (26 files changed, +0.0% overall, 13↑ 13↓)
File Scale Format Base HEAD Change %
part_1.vortex 10.0 vortex-file-compressed 24.01 MB 24.82 MB +822.31 KB +3.3%
partsupp_0.vortex 10.0 vortex-compact 104.77 MB 105.82 MB +1.05 MB +1.0%
part_1.vortex 10.0 vortex-compact 17.02 MB 17.17 MB +153.45 KB +0.9%
supplier_0.vortex 10.0 vortex-file-compressed 5.70 MB 5.74 MB +47.52 KB +0.8%
orders_0.vortex 10.0 vortex-file-compressed 144.11 MB 144.39 MB +286.30 KB +0.2%
lineitem_1.vortex 10.0 vortex-file-compressed 133.66 MB 133.83 MB +175.71 KB +0.1%
part_0.vortex 10.0 vortex-file-compressed 24.68 MB 24.71 MB +28.34 KB +0.1%
lineitem_0.vortex 10.0 vortex-file-compressed 134.11 MB 134.25 MB +141.38 KB +0.1%
lineitem_7.vortex 10.0 vortex-file-compressed 133.57 MB 133.70 MB +126.30 KB +0.1%
partsupp_0.vortex 10.0 vortex-file-compressed 120.25 MB 120.31 MB +65.28 KB +0.1%
customer_0.vortex 10.0 vortex-file-compressed 88.53 MB 88.55 MB +20.69 KB +0.0%
lineitem_8.vortex 10.0 vortex-file-compressed 133.56 MB 133.58 MB +24.57 KB +0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.31 MB 134.31 MB +288 B +0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 120.29 MB 120.27 MB 16.84 KB -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.18 MB 134.15 MB 23.62 KB -0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 134.12 MB 134.08 MB 36.90 KB -0.0%
orders_2.vortex 10.0 vortex-file-compressed 146.24 MB 146.19 MB 51.98 KB -0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.28 MB 133.21 MB 74.74 KB -0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 134.04 MB 133.95 MB 96.99 KB -0.1%
lineitem_5.vortex 10.0 vortex-file-compressed 133.58 MB 133.46 MB 120.88 KB -0.1%
lineitem_6.vortex 10.0 vortex-file-compressed 132.85 MB 132.73 MB 122.97 KB -0.1%
lineitem_4.vortex 10.0 vortex-file-compressed 134.12 MB 133.99 MB 130.77 KB -0.1%
part_0.vortex 10.0 vortex-compact 16.87 MB 16.85 MB 18.52 KB -0.1%
lineitem_9.vortex 10.0 vortex-file-compressed 134.26 MB 134.09 MB 172.73 KB -0.1%
partsupp_1.vortex 10.0 vortex-compact 105.21 MB 104.88 MB 340.52 KB -0.3%
orders_1.vortex 10.0 vortex-file-compressed 146.08 MB 145.39 MB 702.67 KB -0.5%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.0%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.1% -3.2% +3.4% +10.0% ➖ noise
1 datafusion:vortex-compact +0.4% -3.2% +3.7% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +2.2% -3.2% +5.6% +10.0% ➖ noise
1 duckdb:duckdb -0.4% -3.2% +2.9% +10.0% ➖ noise
1 duckdb:vortex-compact +0.3% -3.2% +3.5% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.4% -3.2% +2.9% +10.0% ➖ noise
2 datafusion:arrow -2.0% +0.1% -2.1% +10.0% ➖ noise
2 datafusion:vortex-compact -1.6% +0.1% -1.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.6% +0.1% +0.6% +10.0% ➖ noise
2 duckdb:duckdb +5.2% +0.1% +5.2% +10.0% ➖ noise
2 duckdb:vortex-compact +3.0% +0.1% +2.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.3% +0.1% +1.3% +13.5% ➖ noise
3 datafusion:arrow -0.5% +1.0% -1.5% +10.0% ➖ noise
3 datafusion:vortex-compact +2.3% +1.0% +1.3% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +1.1% +1.0% +0.0% +10.0% ➖ noise
3 duckdb:duckdb +0.1% +1.0% -0.9% +10.0% ➖ noise
3 duckdb:vortex-compact -0.6% +1.0% -1.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.3% +1.0% +1.3% +10.0% ➖ noise
4 datafusion:arrow -0.4% -0.8% +0.4% +10.0% ➖ noise
4 datafusion:vortex-compact +1.7% -0.8% +2.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +4.9% -0.8% +5.7% +10.0% ➖ noise
4 duckdb:duckdb -1.8% -0.8% -1.0% +10.0% ➖ noise
4 duckdb:vortex-compact -0.8% -0.8% -0.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.8% -0.8% +2.6% +10.0% ➖ noise
5 datafusion:arrow -0.8% -0.1% -0.7% +10.0% ➖ noise
5 datafusion:vortex-compact +0.9% -0.1% +1.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.4% -0.1% +1.6% +10.0% ➖ noise
5 duckdb:duckdb -1.2% -0.1% -1.0% +10.0% ➖ noise
5 duckdb:vortex-compact -1.8% -0.1% -1.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.9% -0.1% +1.0% +10.0% ➖ noise
6 datafusion:arrow -0.1% +1.3% -1.3% +10.0% ➖ noise
6 datafusion:vortex-compact -0.4% +1.3% -1.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.8% +1.3% -4.1% +10.4% ➖ noise
6 duckdb:duckdb -0.3% +1.3% -1.6% +10.0% ➖ noise
6 duckdb:vortex-compact +3.7% +1.3% +2.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.9% +1.3% -0.4% +11.3% ➖ noise
7 datafusion:arrow -2.8% +0.3% -3.1% +10.0% ➖ noise
7 datafusion:vortex-compact +0.6% +0.3% +0.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.8% +0.3% +0.5% +10.0% ➖ noise
7 duckdb:duckdb -2.0% +0.3% -2.3% +10.0% ➖ noise
7 duckdb:vortex-compact -0.4% +0.3% -0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.6% +0.3% -0.9% +10.0% ➖ noise
8 datafusion:arrow +1.0% -1.4% +2.4% +10.0% ➖ noise
8 datafusion:vortex-compact +1.0% -1.4% +2.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.2% -1.4% +1.6% +10.0% ➖ noise
8 duckdb:duckdb -1.4% -1.4% -0.0% +10.0% ➖ noise
8 duckdb:vortex-compact -1.5% -1.4% -0.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.6% -1.4% -0.2% +10.0% ➖ noise
9 datafusion:arrow +5.5% +0.1% +5.4% +10.0% ➖ noise
9 datafusion:vortex-compact -1.9% +0.1% -2.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.0% +0.1% +0.8% +10.0% ➖ noise
9 duckdb:duckdb +0.3% +0.1% +0.2% +10.0% ➖ noise
9 duckdb:vortex-compact +0.2% +0.1% +0.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.4% +0.1% -1.5% +10.0% ➖ noise
10 datafusion:arrow -0.2% -0.1% -0.1% +10.0% ➖ noise
10 datafusion:vortex-compact +0.6% -0.1% +0.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.3% -0.1% +0.4% +10.0% ➖ noise
10 duckdb:duckdb -1.2% -0.1% -1.0% +10.0% ➖ noise
10 duckdb:vortex-compact -1.3% -0.1% -1.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.4% -0.1% +0.5% +10.0% ➖ noise
11 datafusion:arrow -1.6% -0.5% -1.2% +13.8% ➖ noise
11 datafusion:vortex-compact -0.5% -0.5% -0.1% +10.6% ➖ noise
11 datafusion:vortex-file-compressed +3.9% -0.5% +4.4% +10.7% ➖ noise
11 duckdb:duckdb -1.3% -0.5% -0.8% +10.0% ➖ noise
11 duckdb:vortex-compact -1.8% -0.5% -1.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.9% -0.5% -0.4% +16.1% ➖ noise
12 datafusion:arrow -0.5% -0.5% -0.0% +40.6% ➖ noise
12 datafusion:vortex-compact +3.4% -0.5% +3.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +4.6% -0.5% +5.2% +10.0% ➖ noise
12 duckdb:duckdb -0.4% -0.5% +0.1% +10.0% ➖ noise
12 duckdb:vortex-compact +0.4% -0.5% +0.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +2.2% -0.5% +2.7% +10.0% ➖ noise
13 datafusion:arrow -0.9% -0.5% -0.4% +10.0% ➖ noise
13 datafusion:vortex-compact +1.2% -0.5% +1.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.1% -0.5% +2.6% +10.0% ➖ noise
13 duckdb:duckdb -2.0% -0.5% -1.5% +10.0% ➖ noise
13 duckdb:vortex-compact +0.1% -0.5% +0.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.1% -0.5% +1.6% +10.0% ➖ noise
14 datafusion:arrow -5.3% -2.9% -2.5% +10.0% ➖ noise
14 datafusion:vortex-compact +2.3% -2.9% +5.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +4.1% -2.9% +7.2% +10.0% ➖ noise
14 duckdb:duckdb -1.6% -2.9% +1.4% +10.0% ➖ noise
14 duckdb:vortex-compact +0.3% -2.9% +3.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.6% -2.9% +3.6% +10.0% ➖ noise
15 datafusion:arrow +7.4% +0.8% +6.6% +10.0% ➖ noise
15 datafusion:vortex-compact +0.6% +0.8% -0.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.4% +0.8% -0.4% +10.0% ➖ noise
15 duckdb:duckdb -0.9% +0.8% -1.6% +10.0% ➖ noise
15 duckdb:vortex-compact +0.0% +0.8% -0.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +1.4% +0.8% +0.6% +10.0% ➖ noise
16 datafusion:arrow +4.9% -9.1% +15.4% +10.0% 🚨 regression
16 datafusion:vortex-compact +2.3% -9.1% +12.5% +10.0% 🚨 regression
16 datafusion:vortex-file-compressed +2.0% -9.1% +12.3% +10.0% 🚨 regression
16 duckdb:duckdb -1.6% -9.1% +8.3% +10.0% ➖ noise
16 duckdb:vortex-compact -2.9% -9.1% +6.8% +10.1% ➖ noise
16 duckdb:vortex-file-compressed +2.4% -9.1% +12.6% +10.0% 🚨 regression
17 datafusion:arrow +2.7% -1.2% +3.9% +10.0% ➖ noise
17 datafusion:vortex-compact -0.5% -1.2% +0.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.1% -1.2% +1.3% +10.0% ➖ noise
17 duckdb:duckdb -0.3% -1.2% +0.9% +10.0% ➖ noise
17 duckdb:vortex-compact -2.1% -1.2% -0.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.1% -1.2% +1.1% +10.0% ➖ noise
18 datafusion:arrow -0.7% +1.2% -1.9% +10.0% ➖ noise
18 datafusion:vortex-compact -0.3% +1.2% -1.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -1.0% +1.2% -2.2% +10.0% ➖ noise
18 duckdb:duckdb +1.2% +1.2% -0.0% +10.0% ➖ noise
18 duckdb:vortex-compact -1.0% +1.2% -2.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -2.0% +1.2% -3.2% +10.0% ➖ noise
19 datafusion:arrow -1.0% +0.7% -1.7% +10.0% ➖ noise
19 datafusion:vortex-compact +8.2% +0.7% +7.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +34.1% +0.7% +33.1% +10.0% 🚨 regression
19 duckdb:duckdb -0.0% +0.7% -0.7% +10.0% ➖ noise
19 duckdb:vortex-compact +0.2% +0.7% -0.6% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.2% +0.7% -0.6% +10.0% ➖ noise
20 datafusion:arrow -0.0% -0.1% +0.1% +10.0% ➖ noise
20 datafusion:vortex-compact +1.1% -0.1% +1.2% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +0.8% -0.1% +0.9% +10.0% ➖ noise
20 duckdb:duckdb -0.5% -0.1% -0.4% +10.0% ➖ noise
20 duckdb:vortex-compact -1.4% -0.1% -1.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.2% -0.1% +1.3% +10.0% ➖ noise
21 datafusion:arrow -1.2% +1.2% -2.4% +10.0% ➖ noise
21 datafusion:vortex-compact +0.9% +1.2% -0.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +1.1% +1.2% -0.1% +10.0% ➖ noise
21 duckdb:duckdb -1.0% +1.2% -2.2% +10.0% ➖ noise
21 duckdb:vortex-compact -0.7% +1.2% -1.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.1% +1.2% -1.1% +10.0% ➖ noise
22 datafusion:arrow -1.9% -0.3% -1.5% +10.0% ➖ noise
22 datafusion:vortex-compact -0.4% -0.3% -0.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +3.0% -0.3% +3.4% +10.0% ➖ noise
22 duckdb:duckdb -0.7% -0.3% -0.3% +10.0% ➖ noise
22 duckdb:vortex-compact -0.9% -0.3% -0.5% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +1.3% -0.3% +1.6% +10.0% ➖ noise

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.0%
Engines: DataFusion No clear signal (+2.5%, low confidence) · DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): 1.028x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.028x ➖, 0↑ 4↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1715128 1627635 1.05
clickbench_q01/datafusion:vortex-file-compressed 🚨 16699216 15112957 1.10
clickbench_q02/datafusion:vortex-file-compressed 34357868 33472466 1.03
clickbench_q03/datafusion:vortex-file-compressed 42515692 42822211 0.99
clickbench_q04/datafusion:vortex-file-compressed 281983183 282246505 1.00
clickbench_q05/datafusion:vortex-file-compressed 321407095 325317347 0.99
clickbench_q06/datafusion:vortex-file-compressed 1955847 2141015 0.91
clickbench_q07/datafusion:vortex-file-compressed 🚨 20209109 17747289 1.14
clickbench_q08/datafusion:vortex-file-compressed 347348330 348126486 1.00
clickbench_q09/datafusion:vortex-file-compressed 559606541 548792313 1.02
clickbench_q10/datafusion:vortex-file-compressed 74585435 71106085 1.05
clickbench_q11/datafusion:vortex-file-compressed 86743279 82926478 1.05
clickbench_q12/datafusion:vortex-file-compressed 294337820 286012581 1.03
clickbench_q13/datafusion:vortex-file-compressed 431955166 427389932 1.01
clickbench_q14/datafusion:vortex-file-compressed 275635131 270236049 1.02
clickbench_q15/datafusion:vortex-file-compressed 331521775 318410420 1.04
clickbench_q16/datafusion:vortex-file-compressed 678618533 683559758 0.99
clickbench_q17/datafusion:vortex-file-compressed 665932860 663926284 1.00
clickbench_q18/datafusion:vortex-file-compressed 1369322304 1360491681 1.01
clickbench_q19/datafusion:vortex-file-compressed 29426448 27279779 1.08
clickbench_q20/datafusion:vortex-file-compressed 330684864 318925166 1.04
clickbench_q21/datafusion:vortex-file-compressed 419911895 411185674 1.02
clickbench_q22/datafusion:vortex-file-compressed 520623217 496326724 1.05
clickbench_q23/datafusion:vortex-file-compressed 558591620 516683714 1.08
clickbench_q24/datafusion:vortex-file-compressed 48108321 48822830 0.99
clickbench_q25/datafusion:vortex-file-compressed 78433408 76358980 1.03
clickbench_q26/datafusion:vortex-file-compressed 46840287 47513097 0.99
clickbench_q27/datafusion:vortex-file-compressed 793879642 791414794 1.00
clickbench_q28/datafusion:vortex-file-compressed 5925781919 5903112403 1.00
clickbench_q29/datafusion:vortex-file-compressed 216753853 226315667 0.96
clickbench_q30/datafusion:vortex-file-compressed 261568062 251998190 1.04
clickbench_q31/datafusion:vortex-file-compressed 296792976 287428779 1.03
clickbench_q32/datafusion:vortex-file-compressed 1164630687 1124693517 1.04
clickbench_q33/datafusion:vortex-file-compressed 1387594288 1418500906 0.98
clickbench_q34/datafusion:vortex-file-compressed 1408089411 1389662173 1.01
clickbench_q35/datafusion:vortex-file-compressed 462858989 468289206 0.99
clickbench_q36/datafusion:vortex-file-compressed 77073605 71779563 1.07
clickbench_q37/datafusion:vortex-file-compressed 35324583 35693995 0.99
clickbench_q38/datafusion:vortex-file-compressed 🚨 22946463 19576590 1.17
clickbench_q39/datafusion:vortex-file-compressed 143914454 144324920 1.00
clickbench_q40/datafusion:vortex-file-compressed 17438996 15983423 1.09
clickbench_q41/datafusion:vortex-file-compressed 🚨 16662714 14903241 1.12
clickbench_q42/datafusion:vortex-file-compressed 17631434 16546609 1.07
datafusion / parquet (1.003x ➖, 0↑ 1↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 1709259 1551644 1.10
clickbench_q01/datafusion:parquet 19132361 19537913 0.98
clickbench_q02/datafusion:parquet 46623009 46778245 1.00
clickbench_q03/datafusion:parquet 37371637 37850504 0.99
clickbench_q04/datafusion:parquet 305255051 303110114 1.01
clickbench_q05/datafusion:parquet 352578410 347924795 1.01
clickbench_q06/datafusion:parquet 1549108 1581541 0.98
clickbench_q07/datafusion:parquet 22739561 22094670 1.03
clickbench_q08/datafusion:parquet 386161821 380558079 1.01
clickbench_q09/datafusion:parquet 628528180 620789714 1.01
clickbench_q10/datafusion:parquet 106754126 106808030 1.00
clickbench_q11/datafusion:parquet 130082294 129327799 1.01
clickbench_q12/datafusion:parquet 349034431 342632969 1.02
clickbench_q13/datafusion:parquet 502067335 502436609 1.00
clickbench_q14/datafusion:parquet 348407519 334827065 1.04
clickbench_q15/datafusion:parquet 350953174 343368094 1.02
clickbench_q16/datafusion:parquet 667724327 686602972 0.97
clickbench_q17/datafusion:parquet 672455213 648411341 1.04
clickbench_q18/datafusion:parquet 1373628818 1380506881 1.00
clickbench_q19/datafusion:parquet 29884602 31328146 0.95
clickbench_q20/datafusion:parquet 619649966 604357124 1.03
clickbench_q21/datafusion:parquet 668245108 657842903 1.02
clickbench_q22/datafusion:parquet 979272504 980473170 1.00
clickbench_q23/datafusion:parquet 3709870743 3737415227 0.99
clickbench_q24/datafusion:parquet 80767895 82322556 0.98
clickbench_q25/datafusion:parquet 133534989 132430476 1.01
clickbench_q26/datafusion:parquet 81110167 81809975 0.99
clickbench_q27/datafusion:parquet 1055803130 1064164487 0.99
clickbench_q28/datafusion:parquet 6707371839 6603062827 1.02
clickbench_q29/datafusion:parquet 237134938 242319333 0.98
clickbench_q30/datafusion:parquet 330176365 334976006 0.99
clickbench_q31/datafusion:parquet 384114912 370603708 1.04
clickbench_q32/datafusion:parquet 1272675702 1183480833 1.08
clickbench_q33/datafusion:parquet 1502961027 1515403951 0.99
clickbench_q34/datafusion:parquet 1537102805 1547024629 0.99
clickbench_q35/datafusion:parquet 471076897 482324094 0.98
clickbench_q36/datafusion:parquet 146469249 147329889 0.99
clickbench_q37/datafusion:parquet 57697169 60414568 0.96
clickbench_q38/datafusion:parquet 88310071 87825417 1.01
clickbench_q39/datafusion:parquet 267283685 269739263 0.99
clickbench_q40/datafusion:parquet 31086144 31377735 0.99
clickbench_q41/datafusion:parquet 27287693 28205415 0.97
clickbench_q42/datafusion:parquet 31799279 31080353 1.02
duckdb / vortex-file-compressed (1.028x ➖, 2↑ 6↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 6358758 7089602 0.90
clickbench_q01/duckdb:vortex-file-compressed 🚨 11623929 10139417 1.15
clickbench_q02/duckdb:vortex-file-compressed 25478178 24469375 1.04
clickbench_q03/duckdb:vortex-file-compressed 29857997 29691104 1.01
clickbench_q04/duckdb:vortex-file-compressed 188633141 186423889 1.01
clickbench_q05/duckdb:vortex-file-compressed 179712999 179584679 1.00
clickbench_q06/duckdb:vortex-file-compressed 20331911 18587116 1.09
clickbench_q07/duckdb:vortex-file-compressed 13788491 13587125 1.01
clickbench_q08/duckdb:vortex-file-compressed 264042043 258775030 1.02
clickbench_q09/duckdb:vortex-file-compressed 341239343 341519840 1.00
clickbench_q10/duckdb:vortex-file-compressed 67883825 67681360 1.00
clickbench_q11/duckdb:vortex-file-compressed 78734038 76588379 1.03
clickbench_q12/duckdb:vortex-file-compressed 206140350 198370643 1.04
clickbench_q13/duckdb:vortex-file-compressed 412464675 408417164 1.01
clickbench_q14/duckdb:vortex-file-compressed 236917237 232905240 1.02
clickbench_q15/duckdb:vortex-file-compressed 239205712 248176578 0.96
clickbench_q16/duckdb:vortex-file-compressed 534083056 527859774 1.01
clickbench_q17/duckdb:vortex-file-compressed 430620165 431182059 1.00
clickbench_q18/duckdb:vortex-file-compressed 957871473 953848520 1.00
clickbench_q19/duckdb:vortex-file-compressed 21387202 20268658 1.06
clickbench_q20/duckdb:vortex-file-compressed 306249442 304567786 1.01
clickbench_q21/duckdb:vortex-file-compressed 394713550 397604746 0.99
clickbench_q22/duckdb:vortex-file-compressed 🚨 680082691 539367182 1.26
clickbench_q23/duckdb:vortex-file-compressed 🚨 197641622 154260906 1.28
clickbench_q24/duckdb:vortex-file-compressed 🚨 44628099 39383995 1.13
clickbench_q25/duckdb:vortex-file-compressed 76625005 78572987 0.98
clickbench_q26/duckdb:vortex-file-compressed 🚨 49677666 43297801 1.15
clickbench_q27/duckdb:vortex-file-compressed 513728615 519604209 0.99
clickbench_q28/duckdb:vortex-file-compressed 3083588068 3033490495 1.02
clickbench_q29/duckdb:vortex-file-compressed 29560904 27996681 1.06
clickbench_q30/duckdb:vortex-file-compressed 215220481 210159138 1.02
clickbench_q31/duckdb:vortex-file-compressed 310150849 306779140 1.01
clickbench_q32/duckdb:vortex-file-compressed 1133292957 1112485180 1.02
clickbench_q33/duckdb:vortex-file-compressed 1112604481 1142198249 0.97
clickbench_q34/duckdb:vortex-file-compressed 1217288263 1190670525 1.02
clickbench_q35/duckdb:vortex-file-compressed 377616236 369454023 1.02
clickbench_q36/duckdb:vortex-file-compressed 27428562 28014512 0.98
clickbench_q37/duckdb:vortex-file-compressed 18845420 18155956 1.04
clickbench_q38/duckdb:vortex-file-compressed 20469535 20406870 1.00
clickbench_q39/duckdb:vortex-file-compressed 42552323 43272547 0.98
clickbench_q40/duckdb:vortex-file-compressed 🚀 16185186 18894110 0.86
clickbench_q41/duckdb:vortex-file-compressed 17570685 18523651 0.95
clickbench_q42/duckdb:vortex-file-compressed 🚨 22021873 18108778 1.22
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 21940422 23829218 0.92
clickbench_q01/duckdb:parquet 28269716 30127567 0.94
clickbench_q02/duckdb:parquet 50251412 50804687 0.99
clickbench_q03/duckdb:parquet 40865226 40630162 1.01
clickbench_q04/duckdb:parquet 207634715 200843876 1.03
clickbench_q05/duckdb:parquet 259107080 256784117 1.01
clickbench_q06/duckdb:parquet 47679093 47601446 1.00
clickbench_q07/duckdb:parquet 31149917 30697706 1.01
clickbench_q08/duckdb:parquet 267187407 270155401 0.99
clickbench_q09/duckdb:parquet 402197763 396973110 1.01
clickbench_q10/duckdb:parquet 83399072 83510811 1.00
clickbench_q11/duckdb:parquet 100999477 99381296 1.02
clickbench_q12/duckdb:parquet 279977431 282921756 0.99
clickbench_q13/duckdb:parquet 473256826 474827694 1.00
clickbench_q14/duckdb:parquet 317191777 313221062 1.01
clickbench_q15/duckdb:parquet 255860655 254314967 1.01
clickbench_q16/duckdb:parquet 599117952 596808887 1.00
clickbench_q17/duckdb:parquet 496285315 495685143 1.00
clickbench_q18/duckdb:parquet 1043095677 1034302855 1.01
clickbench_q19/duckdb:parquet 27701418 27969737 0.99
clickbench_q20/duckdb:parquet 420233420 416597341 1.01
clickbench_q21/duckdb:parquet 530487759 531354536 1.00
clickbench_q22/duckdb:parquet 918041746 916250547 1.00
clickbench_q23/duckdb:parquet 264356023 262025327 1.01
clickbench_q24/duckdb:parquet 70219584 68487687 1.03
clickbench_q25/duckdb:parquet 161085562 162100906 0.99
clickbench_q26/duckdb:parquet 52381601 56480906 0.93
clickbench_q27/duckdb:parquet 641557940 645072712 0.99
clickbench_q28/duckdb:parquet 4897671262 4879828214 1.00
clickbench_q29/duckdb:parquet 43617400 42558959 1.02
clickbench_q30/duckdb:parquet 315815004 311069874 1.02
clickbench_q31/duckdb:parquet 377714305 376364219 1.00
clickbench_q32/duckdb:parquet 1106338544 1098963006 1.01
clickbench_q33/duckdb:parquet 1105054540 1098823704 1.01
clickbench_q34/duckdb:parquet 1151346969 1145726189 1.00
clickbench_q35/duckdb:parquet 371627425 372379810 1.00
clickbench_q36/duckdb:parquet 50752461 50069338 1.01
clickbench_q37/duckdb:parquet 34293449 34322690 1.00
clickbench_q38/duckdb:parquet 35213636 35144869 1.00
clickbench_q39/duckdb:parquet 90045941 91907116 0.98
clickbench_q40/duckdb:parquet 20276529 20793976 0.98
clickbench_q41/duckdb:parquet 21102850 20500229 1.03
clickbench_q42/duckdb:parquet 22687461 22138782 1.02
duckdb / duckdb (1.009x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17129328 17028108 1.01
clickbench_q01/duckdb:duckdb 34087143 34325921 0.99
clickbench_q02/duckdb:duckdb 50935485 51591621 0.99
clickbench_q03/duckdb:duckdb 55502994 55277845 1.00
clickbench_q04/duckdb:duckdb 209028817 210210556 0.99
clickbench_q05/duckdb:duckdb 285431608 280617010 1.02
clickbench_q06/duckdb:duckdb 35181184 32971203 1.07
clickbench_q07/duckdb:duckdb 35149349 35497415 0.99
clickbench_q08/duckdb:duckdb 276075790 274288851 1.01
clickbench_q09/duckdb:duckdb 392237643 388150244 1.01
clickbench_q10/duckdb:duckdb 115601431 116309554 0.99
clickbench_q11/duckdb:duckdb 126241708 124681940 1.01
clickbench_q12/duckdb:duckdb 260622919 257225828 1.01
clickbench_q13/duckdb:duckdb 449788642 439358130 1.02
clickbench_q14/duckdb:duckdb 287938672 283596773 1.02
clickbench_q15/duckdb:duckdb 243430262 242551783 1.00
clickbench_q16/duckdb:duckdb 559854312 557427964 1.00
clickbench_q17/duckdb:duckdb 471865912 463086005 1.02
clickbench_q18/duckdb:duckdb 1025816684 997871756 1.03
clickbench_q19/duckdb:duckdb 35589604 35904324 0.99
clickbench_q20/duckdb:duckdb 466687862 480491919 0.97
clickbench_q21/duckdb:duckdb 474216678 473640475 1.00
clickbench_q22/duckdb:duckdb 553228800 531960024 1.04
clickbench_q23/duckdb:duckdb 257057174 250423591 1.03
clickbench_q24/duckdb:duckdb 62254916 61890516 1.01
clickbench_q25/duckdb:duckdb 149367817 148538833 1.01
clickbench_q26/duckdb:duckdb 61567603 61357996 1.00
clickbench_q27/duckdb:duckdb 551056430 545994366 1.01
clickbench_q28/duckdb:duckdb 4480089938 4536597222 0.99
clickbench_q29/duckdb:duckdb 50681129 50946700 0.99
clickbench_q30/duckdb:duckdb 275630401 277623562 0.99
clickbench_q31/duckdb:duckdb 363767984 360482016 1.01
clickbench_q32/duckdb:duckdb 1128018504 1110108699 1.02
clickbench_q33/duckdb:duckdb 1117425486 1110366263 1.01
clickbench_q34/duckdb:duckdb 1190225194 1181075297 1.01
clickbench_q35/duckdb:duckdb 304758758 296368067 1.03
clickbench_q36/duckdb:duckdb 48989887 49775652 0.98
clickbench_q37/duckdb:duckdb 28999617 28720681 1.01
clickbench_q38/duckdb:duckdb 33758093 33000848 1.02
clickbench_q39/duckdb:duckdb 81736532 79333885 1.03
clickbench_q40/duckdb:duckdb 27907825 28021950 1.00
clickbench_q41/duckdb:duckdb 27622348 26998329 1.02
clickbench_q42/duckdb:duckdb 29712758 29157971 1.02

File Size Changes (104 files changed, -0.0% overall, 50↑ 54↓)
File Scale Format Base HEAD Change %
hits_55.vortex 1.0 vortex-compact 94.94 MB 96.04 MB +1.09 MB +1.2%
hits_79.vortex 1.0 vortex-file-compressed 145.11 MB 145.43 MB +325.73 KB +0.2%
hits_26.vortex 1.0 vortex-file-compressed 110.01 MB 110.19 MB +186.12 KB +0.2%
hits_0.vortex 1.0 vortex-file-compressed 89.54 MB 89.69 MB +149.04 KB +0.2%
hits_49.vortex 1.0 vortex-file-compressed 75.88 MB 76.00 MB +120.04 KB +0.2%
hits_46.vortex 1.0 vortex-file-compressed 69.44 MB 69.54 MB +99.47 KB +0.1%
hits_67.vortex 1.0 vortex-file-compressed 184.12 MB 184.34 MB +227.73 KB +0.1%
hits_11.vortex 1.0 vortex-file-compressed 79.98 MB 80.08 MB +98.18 KB +0.1%
hits_36.vortex 1.0 vortex-file-compressed 68.48 MB 68.56 MB +79.38 KB +0.1%
hits_12.vortex 1.0 vortex-file-compressed 101.11 MB 101.22 MB +114.34 KB +0.1%
hits_71.vortex 1.0 vortex-file-compressed 102.06 MB 102.17 MB +106.24 KB +0.1%
hits_5.vortex 1.0 vortex-file-compressed 92.91 MB 93.00 MB +95.95 KB +0.1%
hits_63.vortex 1.0 vortex-file-compressed 69.27 MB 69.34 MB +70.05 KB +0.1%
hits_15.vortex 1.0 vortex-file-compressed 89.23 MB 89.31 MB +82.02 KB +0.1%
hits_91.vortex 1.0 vortex-file-compressed 97.18 MB 97.26 MB +80.55 KB +0.1%
hits_76.vortex 1.0 vortex-file-compressed 114.43 MB 114.52 MB +93.14 KB +0.1%
hits_32.vortex 1.0 vortex-file-compressed 66.81 MB 66.86 MB +51.50 KB +0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.69 MB 168.81 MB +129.67 KB +0.1%
hits_70.vortex 1.0 vortex-file-compressed 93.64 MB 93.71 MB +71.70 KB +0.1%
hits_69.vortex 1.0 vortex-file-compressed 122.85 MB 122.94 MB +93.65 KB +0.1%
hits_19.vortex 1.0 vortex-file-compressed 73.54 MB 73.59 MB +54.68 KB +0.1%
hits_31.vortex 1.0 vortex-file-compressed 90.05 MB 90.11 MB +63.98 KB +0.1%
hits_30.vortex 1.0 vortex-file-compressed 87.20 MB 87.26 MB +54.32 KB +0.1%
hits_22.vortex 1.0 vortex-file-compressed 78.61 MB 78.66 MB +47.43 KB +0.1%
hits_16.vortex 1.0 vortex-file-compressed 80.00 MB 80.04 MB +40.50 KB +0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.84 MB 146.91 MB +74.00 KB +0.0%
hits_80.vortex 1.0 vortex-file-compressed 105.05 MB 105.09 MB +39.21 KB +0.0%
hits_4.vortex 1.0 vortex-file-compressed 108.75 MB 108.79 MB +40.27 KB +0.0%
hits_58.vortex 1.0 vortex-file-compressed 90.38 MB 90.41 MB +29.30 KB +0.0%
hits_85.vortex 1.0 vortex-file-compressed 91.86 MB 91.89 MB +28.19 KB +0.0%
hits_74.vortex 1.0 vortex-file-compressed 119.99 MB 120.03 MB +33.19 KB +0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.27 MB 90.29 MB +24.13 KB +0.0%
hits_37.vortex 1.0 vortex-file-compressed 85.82 MB 85.84 MB +22.75 KB +0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.31 MB 101.33 MB +26.57 KB +0.0%
hits_2.vortex 1.0 vortex-file-compressed 186.48 MB 186.53 MB +48.37 KB +0.0%
hits_59.vortex 1.0 vortex-file-compressed 101.87 MB 101.89 MB +24.81 KB +0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.83 MB 89.85 MB +20.70 KB +0.0%
hits_73.vortex 1.0 vortex-file-compressed 110.52 MB 110.54 MB +24.70 KB +0.0%
hits_21.vortex 1.0 vortex-file-compressed 94.29 MB 94.31 MB +20.60 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.57 MB 277.63 MB +58.11 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.31 MB 41.32 MB +8.15 KB +0.0%
hits_90.vortex 1.0 vortex-file-compressed 142.15 MB 142.17 MB +25.90 KB +0.0%
hits_1.vortex 1.0 vortex-file-compressed 138.51 MB 138.53 MB +23.52 KB +0.0%
hits_38.vortex 1.0 vortex-file-compressed 99.32 MB 99.32 MB +8.05 KB +0.0%
hits_42.vortex 1.0 vortex-file-compressed 223.15 MB 223.16 MB +12.06 KB +0.0%
hits_93.vortex 1.0 vortex-file-compressed 90.58 MB 90.58 MB +3.03 KB +0.0%
hits_17.vortex 1.0 vortex-file-compressed 87.50 MB 87.50 MB +2.53 KB +0.0%
hits_87.vortex 1.0 vortex-file-compressed 172.66 MB 172.67 MB +3.99 KB +0.0%
hits_84.vortex 1.0 vortex-file-compressed 117.33 MB 117.33 MB +1.85 KB +0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.93 MB 77.93 MB +616 B +0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.04 MB 28.04 MB 664 B -0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.40 MB 221.39 MB 6.94 KB -0.0%
hits_65.vortex 1.0 vortex-file-compressed 183.81 MB 183.81 MB 5.89 KB -0.0%
hits_99.vortex 1.0 vortex-file-compressed 123.19 MB 123.18 MB 4.98 KB -0.0%
hits_68.vortex 1.0 vortex-file-compressed 123.28 MB 123.27 MB 8.16 KB -0.0%
hits_94.vortex 1.0 vortex-file-compressed 138.77 MB 138.76 MB 12.97 KB -0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.43 MB 179.41 MB 17.43 KB -0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.31 MB 164.29 MB 16.97 KB -0.0%
hits_13.vortex 1.0 vortex-file-compressed 99.29 MB 99.28 MB 10.88 KB -0.0%
hits_72.vortex 1.0 vortex-file-compressed 84.86 MB 84.84 MB 14.55 KB -0.0%
hits_89.vortex 1.0 vortex-file-compressed 184.53 MB 184.49 MB 34.45 KB -0.0%
hits_55.vortex 1.0 vortex-file-compressed 169.29 MB 169.25 MB 46.41 KB -0.0%
hits_18.vortex 1.0 vortex-file-compressed 104.83 MB 104.80 MB 30.14 KB -0.0%
hits_88.vortex 1.0 vortex-file-compressed 111.47 MB 111.43 MB 35.47 KB -0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.37 MB 122.33 MB 43.06 KB -0.0%
hits_60.vortex 1.0 vortex-file-compressed 103.43 MB 103.39 MB 36.45 KB -0.0%
hits_24.vortex 1.0 vortex-file-compressed 77.49 MB 77.46 MB 29.48 KB -0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.91 MB 119.86 MB 51.29 KB -0.0%
hits_41.vortex 1.0 vortex-file-compressed 224.25 MB 224.14 MB 104.35 KB -0.0%
hits_35.vortex 1.0 vortex-file-compressed 115.22 MB 115.17 MB 54.09 KB -0.0%
hits_81.vortex 1.0 vortex-file-compressed 100.82 MB 100.78 MB 47.57 KB -0.0%
hits_33.vortex 1.0 vortex-file-compressed 57.26 MB 57.23 MB 30.91 KB -0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.40 MB 80.36 MB 45.71 KB -0.1%
hits_44.vortex 1.0 vortex-file-compressed 186.93 MB 186.81 MB 119.68 KB -0.1%
hits_75.vortex 1.0 vortex-file-compressed 63.34 MB 63.30 MB 43.43 KB -0.1%
hits_95.vortex 1.0 vortex-file-compressed 96.61 MB 96.55 MB 68.54 KB -0.1%
hits_25.vortex 1.0 vortex-file-compressed 114.16 MB 114.08 MB 81.30 KB -0.1%
hits_43.vortex 1.0 vortex-file-compressed 227.44 MB 227.28 MB 168.23 KB -0.1%
hits_97.vortex 1.0 vortex-file-compressed 107.31 MB 107.22 MB 87.06 KB -0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.46 MB 111.37 MB 91.17 KB -0.1%
hits_7.vortex 1.0 vortex-file-compressed 94.05 MB 93.97 MB 83.69 KB -0.1%
hits_64.vortex 1.0 vortex-file-compressed 81.34 MB 81.26 MB 74.35 KB -0.1%
hits_57.vortex 1.0 vortex-file-compressed 128.35 MB 128.23 MB 119.15 KB -0.1%
hits_53.vortex 1.0 vortex-file-compressed 87.25 MB 87.16 MB 83.95 KB -0.1%
hits_98.vortex 1.0 vortex-file-compressed 118.54 MB 118.42 MB 122.35 KB -0.1%
hits_86.vortex 1.0 vortex-file-compressed 69.42 MB 69.35 MB 72.43 KB -0.1%
hits_3.vortex 1.0 vortex-file-compressed 142.33 MB 142.19 MB 148.60 KB -0.1%
hits_8.vortex 1.0 vortex-file-compressed 93.32 MB 93.22 MB 98.35 KB -0.1%
hits_96.vortex 1.0 vortex-file-compressed 135.86 MB 135.71 MB 145.67 KB -0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.68 MB 69.60 MB 77.37 KB -0.1%
hits_6.vortex 1.0 vortex-file-compressed 93.42 MB 93.32 MB 105.42 KB -0.1%
hits_40.vortex 1.0 vortex-file-compressed 117.95 MB 117.82 MB 136.43 KB -0.1%
hits_56.vortex 1.0 vortex-file-compressed 123.72 MB 123.58 MB 146.26 KB -0.1%
hits_45.vortex 1.0 vortex-file-compressed 122.24 MB 122.09 MB 150.70 KB -0.1%
hits_29.vortex 1.0 vortex-file-compressed 59.86 MB 59.78 MB 78.44 KB -0.1%
hits_34.vortex 1.0 vortex-file-compressed 97.89 MB 97.77 MB 128.59 KB -0.1%
hits_9.vortex 1.0 vortex-file-compressed 99.30 MB 99.17 MB 131.52 KB -0.1%
hits_52.vortex 1.0 vortex-file-compressed 105.30 MB 105.16 MB 152.18 KB -0.1%
hits_62.vortex 1.0 vortex-file-compressed 117.55 MB 117.27 MB 287.49 KB -0.2%
hits_20.vortex 1.0 vortex-file-compressed 63.17 MB 63.02 MB 157.21 KB -0.2%
hits_21.vortex 1.0 vortex-compact 51.53 MB 51.39 MB 144.64 KB -0.3%
hits_82.vortex 1.0 vortex-file-compressed 100.10 MB 99.82 MB 287.05 KB -0.3%
hits_82.vortex 1.0 vortex-compact 67.00 MB 66.79 MB 219.58 KB -0.3%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.05 GB → 7.05 GB (+0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +5.4% +0.7% +4.6% +836.1% ➖ noise
0 duckdb:duckdb +0.6% +0.7% -0.1% +273.1% ➖ noise
0 duckdb:vortex-file-compressed -10.3% +0.7% -10.9% +443.4% ➖ noise
1 datafusion:vortex-file-compressed +10.5% -4.1% +15.3% +27.3% ➖ noise
1 duckdb:duckdb -0.7% -4.1% +3.6% +49.7% ➖ noise
1 duckdb:vortex-file-compressed +14.6% -4.1% +19.6% +25.0% ➖ noise
2 datafusion:vortex-file-compressed +2.6% -0.7% +3.4% +24.4% ➖ noise
2 duckdb:duckdb -1.3% -0.7% -0.6% +25.6% ➖ noise
2 duckdb:vortex-file-compressed +4.1% -0.7% +4.9% +10.6% ➖ noise
3 datafusion:vortex-file-compressed -0.7% -0.3% -0.4% +157.5% ➖ noise
3 duckdb:duckdb +0.4% -0.3% +0.8% +64.1% ➖ noise
3 duckdb:vortex-file-compressed +0.6% -0.3% +0.9% +68.2% ➖ noise
4 datafusion:vortex-file-compressed -0.1% +2.0% -2.1% +10.0% ➖ noise
4 duckdb:duckdb -0.6% +2.0% -2.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.2% +2.0% -0.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.2% +1.1% -2.3% +10.0% ➖ noise
5 duckdb:duckdb +1.7% +1.1% +0.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.1% +1.1% -1.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -8.6% -0.9% -7.8% +95.1% ➖ noise
6 duckdb:duckdb +6.7% -0.9% +7.7% +17.3% ➖ noise
6 duckdb:vortex-file-compressed +9.4% -0.9% +10.4% +23.4% ➖ noise
7 datafusion:vortex-file-compressed +13.9% +2.2% +11.4% +19.4% ➖ noise
7 duckdb:duckdb -1.0% +2.2% -3.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.5% +2.2% -0.7% +19.3% ➖ noise
8 datafusion:vortex-file-compressed -0.2% +0.2% -0.4% +10.0% ➖ noise
8 duckdb:duckdb +0.7% +0.2% +0.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.0% +0.2% +1.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.0% +1.3% +0.7% +10.0% ➖ noise
9 duckdb:duckdb +1.1% +1.3% -0.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.1% +1.3% -1.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +4.9% -0.1% +5.0% +10.1% ➖ noise
10 duckdb:duckdb -0.6% -0.1% -0.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.3% -0.1% +0.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +4.6% +1.1% +3.5% +11.9% ➖ noise
11 duckdb:duckdb +1.3% +1.1% +0.1% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +2.8% +1.1% +1.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +2.9% +0.4% +2.5% +10.0% ➖ noise
12 duckdb:duckdb +1.3% +0.4% +0.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +3.9% +0.4% +3.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.1% -0.2% +1.3% +10.0% ➖ noise
13 duckdb:duckdb +2.4% -0.2% +2.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.0% -0.2% +1.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +2.0% +2.7% -0.6% +10.0% ➖ noise
14 duckdb:duckdb +1.5% +2.7% -1.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +1.7% +2.7% -0.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +4.1% +1.4% +2.7% +10.0% ➖ noise
15 duckdb:duckdb +0.4% +1.4% -1.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -3.6% +1.4% -5.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.7% -1.2% +0.5% +10.0% ➖ noise
16 duckdb:duckdb +0.4% -1.2% +1.6% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.2% -1.2% +2.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.3% +1.9% -1.6% +10.0% ➖ noise
17 duckdb:duckdb +1.9% +1.9% -0.0% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.1% +1.9% -2.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.6% +0.2% +0.5% +10.0% ➖ noise
18 duckdb:duckdb +2.8% +0.2% +2.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.4% +0.2% +0.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +7.9% -2.8% +11.0% +41.7% ➖ noise
19 duckdb:duckdb -0.9% -2.8% +2.0% +33.3% ➖ noise
19 duckdb:vortex-file-compressed +5.5% -2.8% +8.6% +26.7% ➖ noise
20 datafusion:vortex-file-compressed +3.7% +1.7% +2.0% +113.2% ➖ noise
20 duckdb:duckdb -2.9% +1.7% -4.5% +77.5% ➖ noise
20 duckdb:vortex-file-compressed +0.6% +1.7% -1.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +2.1% +0.7% +1.4% +10.0% ➖ noise
21 duckdb:duckdb +0.1% +0.7% -0.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -0.7% +0.7% -1.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +4.9% +0.0% +4.9% +10.0% ➖ noise
22 duckdb:duckdb +4.0% +0.0% +4.0% +38.1% ➖ noise
22 duckdb:vortex-file-compressed +26.1% +0.0% +26.0% +12.9% 🚨 regression
23 datafusion:vortex-file-compressed +8.1% +0.1% +8.0% +35.5% ➖ noise
23 duckdb:duckdb +2.6% +0.1% +2.6% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +28.1% +0.1% +28.0% +27.8% 🚨 regression
24 datafusion:vortex-file-compressed -1.5% +0.3% -1.8% +12.7% ➖ noise
24 duckdb:duckdb +0.6% +0.3% +0.3% +29.9% ➖ noise
24 duckdb:vortex-file-compressed +13.3% +0.3% +13.0% +14.6% ➖ noise
25 datafusion:vortex-file-compressed +2.7% +0.1% +2.6% +12.4% ➖ noise
25 duckdb:duckdb +0.6% +0.1% +0.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -2.5% +0.1% -2.6% +12.9% ➖ noise
26 datafusion:vortex-file-compressed -1.4% -4.1% +2.8% +13.5% ➖ noise
26 duckdb:duckdb +0.3% -4.1% +4.6% +10.0% ➖ noise
26 duckdb:vortex-file-compressed +14.7% -4.1% +19.7% +14.7% 🚨 regression
27 datafusion:vortex-file-compressed +0.3% -0.7% +1.0% +10.0% ➖ noise
27 duckdb:duckdb +0.9% -0.7% +1.6% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -1.1% -0.7% -0.5% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.4% +1.0% -0.6% +10.0% ➖ noise
28 duckdb:duckdb -1.2% +1.0% -2.2% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +1.7% +1.0% +0.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -4.2% +0.1% -4.4% +14.8% ➖ noise
29 duckdb:duckdb -0.5% +0.1% -0.7% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +5.6% +0.1% +5.4% +73.9% ➖ noise
30 datafusion:vortex-file-compressed +3.8% +0.0% +3.8% +10.0% ➖ noise
30 duckdb:duckdb -0.7% +0.0% -0.8% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +2.4% +0.0% +2.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +3.3% +2.0% +1.2% +10.0% ➖ noise
31 duckdb:duckdb +0.9% +2.0% -1.1% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +1.1% +2.0% -0.9% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +3.6% +4.0% -0.5% +13.4% ➖ noise
32 duckdb:duckdb +1.6% +4.0% -2.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +1.9% +4.0% -2.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -2.2% -0.1% -2.1% +10.0% ➖ noise
33 duckdb:duckdb +0.6% -0.1% +0.8% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -2.6% -0.1% -2.5% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +1.3% -0.1% +1.4% +10.0% ➖ noise
34 duckdb:duckdb +0.8% -0.1% +0.9% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +2.2% -0.1% +2.3% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -1.2% -1.3% +0.1% +10.0% ➖ noise
35 duckdb:duckdb +2.8% -1.3% +4.2% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +2.2% -1.3% +3.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +7.4% +0.4% +7.0% +10.3% ➖ noise
36 duckdb:duckdb -1.6% +0.4% -2.0% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -2.1% +0.4% -2.5% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -1.0% -2.3% +1.3% +11.4% ➖ noise
37 duckdb:duckdb +1.0% -2.3% +3.4% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +3.8% -2.3% +6.3% +11.7% ➖ noise
38 datafusion:vortex-file-compressed +17.2% +0.4% +16.8% +13.6% 🚨 regression
38 duckdb:duckdb +2.3% +0.4% +1.9% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +0.3% +0.4% -0.1% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -0.3% -1.5% +1.2% +10.3% ➖ noise
39 duckdb:duckdb +3.0% -1.5% +4.6% +20.0% ➖ noise
39 duckdb:vortex-file-compressed -1.7% -1.5% -0.2% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +9.1% -1.7% +11.0% +10.0% 🚨 regression
40 duckdb:duckdb -0.4% -1.7% +1.3% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -14.3% -1.7% -12.8% +10.0% ✅ faster
41 datafusion:vortex-file-compressed +11.8% -0.2% +12.0% +14.6% ➖ noise
41 duckdb:duckdb +2.3% -0.2% +2.5% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -5.1% -0.2% -4.9% +10.9% ➖ noise
42 datafusion:vortex-file-compressed +6.6% +2.4% +4.1% +23.8% ➖ noise
42 duckdb:duckdb +1.9% +2.4% -0.5% +11.4% ➖ noise
42 duckdb:vortex-file-compressed +21.6% +2.4% +18.8% +22.1% ➖ noise

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): 1.015x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish +1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.014x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 128977987 127697377 1.01
appian_q02/datafusion:vortex-file-compressed 650420398 650488766 1.00
appian_q03/datafusion:vortex-file-compressed 365025634 362427536 1.01
appian_q04/datafusion:vortex-file-compressed 27716439868 26412285469 1.05
appian_q05/datafusion:vortex-file-compressed 265911118 261684474 1.02
appian_q06/datafusion:vortex-file-compressed 415978130 410788609 1.01
appian_q07/datafusion:vortex-file-compressed 459847598 453463384 1.01
appian_q08/datafusion:vortex-file-compressed 1849812278 1840922345 1.00
datafusion / parquet (1.010x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 130331532 135076022 0.96
appian_q02/datafusion:parquet 669140938 669478462 1.00
appian_q03/datafusion:parquet 362182985 352013032 1.03
appian_q04/datafusion:parquet 27864393597 26374839594 1.06
appian_q05/datafusion:parquet 286311239 286101669 1.00
appian_q06/datafusion:parquet 432848803 429638419 1.01
appian_q07/datafusion:parquet 457759659 452880531 1.01
appian_q08/datafusion:parquet 1848159038 1816905191 1.02
duckdb / vortex-file-compressed (1.016x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 192763559 189649940 1.02
appian_q02/duckdb:vortex-file-compressed 608068712 608866967 1.00
appian_q03/duckdb:vortex-file-compressed 258536064 257233206 1.01
appian_q04/duckdb:vortex-file-compressed 1329349404 1309203579 1.02
appian_q05/duckdb:vortex-file-compressed 294256126 286798075 1.03
appian_q06/duckdb:vortex-file-compressed 814009300 792028853 1.03
appian_q07/duckdb:vortex-file-compressed 346200681 340462286 1.02
appian_q08/duckdb:vortex-file-compressed 1298466903 1267547498 1.02
duckdb / parquet (1.006x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 202566923 199463825 1.02
appian_q02/duckdb:parquet 600657756 599485783 1.00
appian_q03/duckdb:parquet 284593456 288424064 0.99
appian_q04/duckdb:parquet 1328568564 1311769100 1.01
appian_q05/duckdb:parquet 312083252 308235306 1.01
appian_q06/duckdb:parquet 794878253 785097173 1.01
appian_q07/duckdb:parquet 360781098 358932888 1.01
appian_q08/duckdb:parquet 1271422091 1268608307 1.00
duckdb / duckdb (0.998x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 169928261 171899703 0.99
appian_q02/duckdb:duckdb 546466815 546036550 1.00
appian_q03/duckdb:duckdb 378965812 388617320 0.98
appian_q04/duckdb:duckdb 1300770439 1299601811 1.00
appian_q05/duckdb:duckdb 280676742 281855576 1.00
appian_q06/duckdb:duckdb 794816176 776132316 1.02
appian_q07/duckdb:duckdb 322190920 323611119 1.00
appian_q08/duckdb:duckdb 1219129922 1215842744 1.00

File Size Changes (4 files changed, -0.0% overall, 1↑ 3↓)
File Scale Format Base HEAD Change %
creditcardview.vortex 1.0 vortex-file-compressed 60.97 MB 60.97 MB +384 B +0.0%
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB 24 B -0.0%
orderview.vortex 1.0 vortex-file-compressed 81.13 MB 81.07 MB 55.57 KB -0.1%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.73 MB → 513.68 MB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-file-compressed +1.0% -1.0% +2.0% +12.2% ➖ noise
1 duckdb:duckdb -1.1% -1.0% -0.1% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +1.6% -1.0% +2.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.0% +0.1% -0.1% +10.0% ➖ noise
2 duckdb:duckdb +0.1% +0.1% +0.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.1% +0.1% -0.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.7% +0.8% -0.0% +10.0% ➖ noise
3 duckdb:duckdb -2.5% +0.8% -3.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.5% +0.8% -0.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +4.9% +3.4% +1.4% +10.0% ➖ noise
4 duckdb:duckdb +0.1% +3.4% -3.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.5% +3.4% -1.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.6% +0.7% +0.9% +11.6% ➖ noise
5 duckdb:duckdb -0.4% +0.7% -1.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.6% +0.7% +1.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.3% +1.0% +0.3% +10.0% ➖ noise
6 duckdb:duckdb +2.4% +1.0% +1.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.8% +1.0% +1.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.4% +0.8% +0.6% +10.0% ➖ noise
7 duckdb:duckdb -0.4% +0.8% -1.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.7% +0.8% +0.9% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.5% +1.0% -0.5% +10.0% ➖ noise
8 duckdb:duckdb +0.3% +1.0% -0.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.4% +1.0% +1.5% +10.0% ➖ noise

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.5%
Engines: DataFusion No clear signal (+22.9%, environment too noisy confidence) · DuckDB No clear signal (-0.7%, environment too noisy confidence)
Vortex (geomean): 1.233x ➖
Parquet (geomean): 1.116x ➖
Shifts: Parquet (control) +11.6% · Median polish +17.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.237x ➖, 0↑ 8↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 333252952 269796694 1.24
tpch_q02/datafusion:vortex-file-compressed 🚨 620179407 474678519 1.31
tpch_q03/datafusion:vortex-file-compressed 🚨 670134735 495937126 1.35
tpch_q04/datafusion:vortex-file-compressed 🚨 374482901 245581118 1.52
tpch_q05/datafusion:vortex-file-compressed 521118949 447672582 1.16
tpch_q06/datafusion:vortex-file-compressed 387508411 325485996 1.19
tpch_q07/datafusion:vortex-file-compressed 🚨 550421774 397365428 1.39
tpch_q08/datafusion:vortex-file-compressed 🚨 909660697 611484708 1.49
tpch_q09/datafusion:vortex-file-compressed 562013982 495727701 1.13
tpch_q10/datafusion:vortex-file-compressed 818098824 648789675 1.26
tpch_q11/datafusion:vortex-file-compressed 🚨 450600681 316785147 1.42
tpch_q12/datafusion:vortex-file-compressed 572481313 449339602 1.27
tpch_q13/datafusion:vortex-file-compressed 223594940 232643223 0.96
tpch_q14/datafusion:vortex-file-compressed 🚨 378570162 252906661 1.50
tpch_q15/datafusion:vortex-file-compressed 525217562 452030634 1.16
tpch_q16/datafusion:vortex-file-compressed 242721935 246573318 0.98
tpch_q17/datafusion:vortex-file-compressed 564207555 491910960 1.15
tpch_q18/datafusion:vortex-file-compressed 🚨 637940942 351907897 1.81
tpch_q19/datafusion:vortex-file-compressed 665374689 535385957 1.24
tpch_q20/datafusion:vortex-file-compressed 464302200 435103325 1.07
tpch_q21/datafusion:vortex-file-compressed 679353725 619992232 1.10
tpch_q22/datafusion:vortex-file-compressed 149968031 171141471 0.88
datafusion / vortex-compact (1.365x ❌, 0↑ 12↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 419896065 284650217 1.48
tpch_q02/datafusion:vortex-compact 🚨 786687407 469198726 1.68
tpch_q03/datafusion:vortex-compact 548198453 443612966 1.24
tpch_q04/datafusion:vortex-compact 264600237 241012271 1.10
tpch_q05/datafusion:vortex-compact 451940305 464963056 0.97
tpch_q06/datafusion:vortex-compact 🚨 417284066 307131320 1.36
tpch_q07/datafusion:vortex-compact 576065220 482692212 1.19
tpch_q08/datafusion:vortex-compact 735836824 629614272 1.17
tpch_q09/datafusion:vortex-compact 640854532 504615969 1.27
tpch_q10/datafusion:vortex-compact 🚨 678520863 516439558 1.31
tpch_q11/datafusion:vortex-compact 🚨 473038448 316562515 1.49
tpch_q12/datafusion:vortex-compact 480959556 372102157 1.29
tpch_q13/datafusion:vortex-compact 176360150 197750525 0.89
tpch_q14/datafusion:vortex-compact 🚨 402850040 293134427 1.37
tpch_q15/datafusion:vortex-compact 🚨 591798191 431561498 1.37
tpch_q16/datafusion:vortex-compact 255280366 210952960 1.21
tpch_q17/datafusion:vortex-compact 🚨 735428601 349593007 2.10
tpch_q18/datafusion:vortex-compact 🚨 635063586 382236125 1.66
tpch_q19/datafusion:vortex-compact 🚨 1023830251 453394020 2.26
tpch_q20/datafusion:vortex-compact 551183842 476345213 1.16
tpch_q21/datafusion:vortex-compact 🚨 926807402 611967820 1.51
tpch_q22/datafusion:vortex-compact 🚨 210166520 124787334 1.68
datafusion / parquet (1.057x ➖, 1↑ 3↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 234803068 272501826 0.86
tpch_q02/datafusion:parquet 452532717 399405004 1.13
tpch_q03/datafusion:parquet 499574502 387517855 1.29
tpch_q04/datafusion:parquet 217840919 195574627 1.11
tpch_q05/datafusion:parquet 482753034 527005855 0.92
tpch_q06/datafusion:parquet 🚀 160073295 252534031 0.63
tpch_q07/datafusion:parquet 524186366 587797955 0.89
tpch_q08/datafusion:parquet 646099036 624649550 1.03
tpch_q09/datafusion:parquet 496989553 458480508 1.08
tpch_q10/datafusion:parquet 519342635 500418546 1.04
tpch_q11/datafusion:parquet 412240333 317615074 1.30
tpch_q12/datafusion:parquet 220053582 236588305 0.93
tpch_q13/datafusion:parquet 439949501 430401278 1.02
tpch_q14/datafusion:parquet 174270576 213604441 0.82
tpch_q15/datafusion:parquet 304581624 310471542 0.98
tpch_q16/datafusion:parquet 171733728 195219082 0.88
tpch_q17/datafusion:parquet 383644974 396994638 0.97
tpch_q18/datafusion:parquet 599553141 478065776 1.25
tpch_q19/datafusion:parquet 🚨 487638368 315737981 1.54
tpch_q20/datafusion:parquet 🚨 469074934 333274851 1.41
tpch_q21/datafusion:parquet 718300613 572817683 1.25
tpch_q22/datafusion:parquet 🚨 186596975 133593297 1.40
duckdb / vortex-file-compressed (1.166x ➖, 0↑ 5↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 284761802 307174584 0.93
tpch_q02/duckdb:vortex-file-compressed 994577861 923176202 1.08
tpch_q03/duckdb:vortex-file-compressed 765337716 692894490 1.10
tpch_q04/duckdb:vortex-file-compressed 512656347 540595500 0.95
tpch_q05/duckdb:vortex-file-compressed 🚨 1102874386 843088698 1.31
tpch_q06/duckdb:vortex-file-compressed 418842841 369523841 1.13
tpch_q07/duckdb:vortex-file-compressed 1158630406 964975526 1.20
tpch_q08/duckdb:vortex-file-compressed 1175332532 1049443749 1.12
tpch_q09/duckdb:vortex-file-compressed 972553584 914531378 1.06
tpch_q10/duckdb:vortex-file-compressed 722333666 808364215 0.89
tpch_q11/duckdb:vortex-file-compressed 574203640 485053977 1.18
tpch_q12/duckdb:vortex-file-compressed 🚨 863513334 609146150 1.42
tpch_q13/duckdb:vortex-file-compressed 🚨 542156782 403649451 1.34
tpch_q14/duckdb:vortex-file-compressed 488322972 409058916 1.19
tpch_q15/duckdb:vortex-file-compressed 357939596 296209999 1.21
tpch_q16/duckdb:vortex-file-compressed 417623782 341907371 1.22
tpch_q17/duckdb:vortex-file-compressed 🚨 828645846 618322925 1.34
tpch_q18/duckdb:vortex-file-compressed 🚨 905988773 509749956 1.78
tpch_q19/duckdb:vortex-file-compressed 553392784 489462640 1.13
tpch_q20/duckdb:vortex-file-compressed 880189524 854752340 1.03
tpch_q21/duckdb:vortex-file-compressed 1363719689 1139979070 1.20
tpch_q22/duckdb:vortex-file-compressed 332798867 295589271 1.13
duckdb / vortex-compact (1.176x ➖, 0↑ 5↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 369207545 273514682 1.35
tpch_q02/duckdb:vortex-compact 1044504613 940839042 1.11
tpch_q03/duckdb:vortex-compact 708430991 576086567 1.23
tpch_q04/duckdb:vortex-compact 455748159 375926420 1.21
tpch_q05/duckdb:vortex-compact 909474657 820033261 1.11
tpch_q06/duckdb:vortex-compact 434450564 374417956 1.16
tpch_q07/duckdb:vortex-compact 963146420 948540524 1.02
tpch_q08/duckdb:vortex-compact 1174424657 964101753 1.22
tpch_q09/duckdb:vortex-compact 994196413 996422809 1.00
tpch_q10/duckdb:vortex-compact 694250607 706343483 0.98
tpch_q11/duckdb:vortex-compact 526542661 521463512 1.01
tpch_q12/duckdb:vortex-compact 🚨 808145540 617038852 1.31
tpch_q13/duckdb:vortex-compact 524768321 410406988 1.28
tpch_q14/duckdb:vortex-compact 🚨 510395258 389026546 1.31
tpch_q15/duckdb:vortex-compact 318444767 272575155 1.17
tpch_q16/duckdb:vortex-compact 358064995 322967664 1.11
tpch_q17/duckdb:vortex-compact 786619904 626375594 1.26
tpch_q18/duckdb:vortex-compact 🚨 743326842 502604078 1.48
tpch_q19/duckdb:vortex-compact 🚨 571152989 423280880 1.35
tpch_q20/duckdb:vortex-compact 837931533 749665556 1.12
tpch_q21/duckdb:vortex-compact 1139585706 1005341284 1.13
tpch_q22/duckdb:vortex-compact 301214274 272382764 1.11
duckdb / parquet (1.179x ➖, 0↑ 1↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 495249018 450117051 1.10
tpch_q02/duckdb:parquet 1343805758 1187238185 1.13
tpch_q03/duckdb:parquet 1449144955 1143276352 1.27
tpch_q04/duckdb:parquet 808448949 687429920 1.18
tpch_q05/duckdb:parquet 1400322701 1318455390 1.06
tpch_q06/duckdb:parquet 567700101 475183419 1.19
tpch_q07/duckdb:parquet 1389083995 1213630286 1.14
tpch_q08/duckdb:parquet 1805254931 1491572974 1.21
tpch_q09/duckdb:parquet 1737415951 1342787577 1.29
tpch_q10/duckdb:parquet 1516664107 1313870532 1.15
tpch_q11/duckdb:parquet 🚨 933849254 706861639 1.32
tpch_q12/duckdb:parquet 910639528 723891651 1.26
tpch_q13/duckdb:parquet 997311848 892256764 1.12
tpch_q14/duckdb:parquet 870227158 691377143 1.26
tpch_q15/duckdb:parquet 678273576 531325628 1.28
tpch_q16/duckdb:parquet 791588774 676398335 1.17
tpch_q17/duckdb:parquet 890591019 816593679 1.09
tpch_q18/duckdb:parquet 1136200434 927463516 1.23
tpch_q19/duckdb:parquet 1015117006 789585159 1.29
tpch_q20/duckdb:parquet 1259999992 1149596741 1.10
tpch_q21/duckdb:parquet 1261190874 1094291913 1.15
tpch_q22/duckdb:parquet 632070298 623041391 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +47.5% -2.6% +51.5% +89.8% ➖ noise
1 datafusion:vortex-file-compressed +23.5% -2.6% +26.9% +83.6% ➖ noise
1 duckdb:vortex-compact +35.0% -2.6% +38.6% +44.8% ➖ noise
1 duckdb:vortex-file-compressed -7.3% -2.6% -4.8% +54.3% ➖ noise
2 datafusion:vortex-compact +67.7% +13.2% +48.1% +41.8% 🚨 regression
2 datafusion:vortex-file-compressed +30.7% +13.2% +15.4% +33.9% ➖ noise
2 duckdb:vortex-compact +11.0% +13.2% -2.0% +33.9% ➖ noise
2 duckdb:vortex-file-compressed +7.7% +13.2% -4.9% +33.9% ➖ noise
3 datafusion:vortex-compact +23.6% +27.8% -3.3% +47.2% ➖ noise
3 datafusion:vortex-file-compressed +35.1% +27.8% +5.7% +47.1% ➖ noise
3 duckdb:vortex-compact +23.0% +27.8% -3.8% +33.9% ➖ noise
3 duckdb:vortex-file-compressed +10.5% +27.8% -13.6% +33.9% ➖ noise
4 datafusion:vortex-compact +9.8% +14.5% -4.1% +40.2% ➖ noise
4 datafusion:vortex-file-compressed +52.5% +14.5% +33.2% +33.9% ➖ noise
4 duckdb:vortex-compact +21.2% +14.5% +5.9% +33.9% ➖ noise
4 duckdb:vortex-file-compressed -5.2% +14.5% -17.1% +33.9% ➖ noise
5 datafusion:vortex-compact -2.8% -1.4% -1.5% +33.9% ➖ noise
5 datafusion:vortex-file-compressed +16.4% -1.4% +18.0% +33.9% ➖ noise
5 duckdb:vortex-compact +10.9% -1.4% +12.4% +127.9% ➖ noise
5 duckdb:vortex-file-compressed +30.8% -1.4% +32.6% +33.9% ➖ noise
6 datafusion:vortex-compact +35.9% -13.0% +56.1% +33.9% 🚨 regression
6 datafusion:vortex-file-compressed +19.1% -13.0% +36.8% +33.9% 🚨 regression
6 duckdb:vortex-compact +16.0% -13.0% +33.3% +33.9% ➖ noise
6 duckdb:vortex-file-compressed +13.3% -13.0% +30.3% +33.9% ➖ noise
7 datafusion:vortex-compact +19.3% +1.0% +18.1% +34.5% ➖ noise
7 datafusion:vortex-file-compressed +38.5% +1.0% +37.1% +33.9% 🚨 regression
7 duckdb:vortex-compact +1.5% +1.0% +0.5% +33.9% ➖ noise
7 duckdb:vortex-file-compressed +20.1% +1.0% +18.8% +34.2% ➖ noise
8 datafusion:vortex-compact +16.9% +11.9% +4.5% +33.9% ➖ noise
8 datafusion:vortex-file-compressed +48.8% +11.9% +33.0% +33.9% ➖ noise
8 duckdb:vortex-compact +21.8% +11.9% +8.9% +33.9% ➖ noise
8 duckdb:vortex-file-compressed +12.0% +11.9% +0.1% +33.9% ➖ noise
9 datafusion:vortex-compact +27.0% +18.4% +7.2% +33.9% ➖ noise
9 datafusion:vortex-file-compressed +13.4% +18.4% -4.3% +33.9% ➖ noise
9 duckdb:vortex-compact -0.2% +18.4% -15.8% +33.9% ➖ noise
9 duckdb:vortex-file-compressed +6.3% +18.4% -10.2% +33.9% ➖ noise
10 datafusion:vortex-compact +31.4% +9.5% +20.0% +46.6% ➖ noise
10 datafusion:vortex-file-compressed +26.1% +9.5% +15.2% +41.3% ➖ noise
10 duckdb:vortex-compact -1.7% +9.5% -10.2% +33.9% ➖ noise
10 duckdb:vortex-file-compressed -10.6% +9.5% -18.4% +33.9% ➖ noise
11 datafusion:vortex-compact +49.4% +30.9% +14.1% +33.9% ➖ noise
11 datafusion:vortex-file-compressed +42.2% +30.9% +8.6% +33.9% ➖ noise
11 duckdb:vortex-compact +1.0% +30.9% -22.9% +33.9% ➖ noise
11 duckdb:vortex-file-compressed +18.4% +30.9% -9.6% +35.4% ➖ noise
12 datafusion:vortex-compact +29.3% +8.2% +19.5% +33.9% ➖ noise
12 datafusion:vortex-file-compressed +27.4% +8.2% +17.8% +33.9% ➖ noise
12 duckdb:vortex-compact +31.0% +8.2% +21.1% +33.9% ➖ noise
12 duckdb:vortex-file-compressed +41.8% +8.2% +31.1% +33.9% ➖ noise
13 datafusion:vortex-compact -10.8% +6.9% -16.6% +46.4% ➖ noise
13 datafusion:vortex-file-compressed -3.9% +6.9% -10.1% +57.0% ➖ noise
13 duckdb:vortex-compact +27.9% +6.9% +19.6% +33.9% ➖ noise
13 duckdb:vortex-file-compressed +34.3% +6.9% +25.7% +33.9% ➖ noise
14 datafusion:vortex-compact +37.4% +1.3% +35.6% +33.9% 🚨 regression
14 datafusion:vortex-file-compressed +49.7% +1.3% +47.7% +43.1% 🚨 regression
14 duckdb:vortex-compact +31.2% +1.3% +29.5% +33.9% ➖ noise
14 duckdb:vortex-file-compressed +19.4% +1.3% +17.8% +33.9% ➖ noise
15 datafusion:vortex-compact +37.1% +11.9% +22.5% +33.9% ➖ noise
15 datafusion:vortex-file-compressed +16.2% +11.9% +3.8% +33.9% ➖ noise
15 duckdb:vortex-compact +16.8% +11.9% +4.4% +33.9% ➖ noise
15 duckdb:vortex-file-compressed +20.8% +11.9% +8.0% +33.9% ➖ noise
16 datafusion:vortex-compact +21.0% +1.5% +19.3% +33.9% ➖ noise
16 datafusion:vortex-file-compressed -1.6% +1.5% -3.0% +37.1% ➖ noise
16 duckdb:vortex-compact +10.9% +1.5% +9.3% +33.9% ➖ noise
16 duckdb:vortex-file-compressed +22.1% +1.5% +20.4% +33.9% ➖ noise
17 datafusion:vortex-compact +110.4% +2.7% +104.9% +44.9% 🚨 regression
17 datafusion:vortex-file-compressed +14.7% +2.7% +11.7% +33.9% ➖ noise
17 duckdb:vortex-compact +25.6% +2.7% +22.3% +33.9% ➖ noise
17 duckdb:vortex-file-compressed +34.0% +2.7% +30.5% +33.9% ➖ noise
18 datafusion:vortex-compact +66.1% +24.0% +34.0% +33.9% 🚨 regression
18 datafusion:vortex-file-compressed +81.3% +24.0% +46.3% +44.1% 🚨 regression
18 duckdb:vortex-compact +47.9% +24.0% +19.3% +33.9% ➖ noise
18 duckdb:vortex-file-compressed +77.7% +24.0% +43.4% +33.9% 🚨 regression
19 datafusion:vortex-compact +125.8% +40.9% +60.3% +36.7% 🚨 regression
19 datafusion:vortex-file-compressed +24.3% +40.9% -11.8% +33.9% ➖ noise
19 duckdb:vortex-compact +34.9% +40.9% -4.2% +33.9% ➖ noise
19 duckdb:vortex-file-compressed +13.1% +40.9% -19.8% +33.9% ➖ noise
20 datafusion:vortex-compact +15.7% +24.2% -6.8% +33.9% ➖ noise
20 datafusion:vortex-file-compressed +6.7% +24.2% -14.1% +33.9% ➖ noise
20 duckdb:vortex-compact +11.8% +24.2% -10.0% +33.9% ➖ noise
20 duckdb:vortex-file-compressed +3.0% +24.2% -17.1% +33.9% ➖ noise
21 datafusion:vortex-compact +51.4% +20.2% +26.0% +33.9% ➖ noise
21 datafusion:vortex-file-compressed +9.6% +20.2% -8.9% +33.9% ➖ noise
21 duckdb:vortex-compact +13.4% +20.2% -5.7% +33.9% ➖ noise
21 duckdb:vortex-file-compressed +19.6% +20.2% -0.5% +33.9% ➖ noise
22 datafusion:vortex-compact +68.4% +19.0% +41.5% +38.5% 🚨 regression
22 datafusion:vortex-file-compressed -12.4% +19.0% -26.4% +36.5% ➖ noise
22 duckdb:vortex-compact +10.6% +19.0% -7.1% +33.9% ➖ noise
22 duckdb:vortex-file-compressed +12.6% +19.0% -5.4% +33.9% ➖ noise

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.009x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (1.012x ➖, 0↑ 7↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
compress time/Arade 1114502487 1118990790 1.00
compress time/Bimbo 5642627717 5594849269 1.01
compress time/CMSprovider 2754835452 2726391075 1.01
compress time/Euro2016 472717808 460588858 1.03
compress time/Food 380029336 349791406 1.09
compress time/HashTags 847879485 861497315 0.98
compress time/TPC-H l_comment canonical 1235280529 1222609195 1.01
compress time/TPC-H l_comment chunked 1244246436 1210633975 1.03
compress time/taxi 676401972 664550735 1.02
compress time/wide table cols=100 chunks=1 rows=1000 11360043 11237256 1.01
compress time/wide table cols=100 chunks=50 rows=1000 11121908 11249159 0.99
compress time/wide table cols=1000 chunks=1 rows=1000 122059809 123661238 0.99
compress time/wide table cols=1000 chunks=50 rows=1000 124803350 126900763 0.98
compress time/wide table cols=10000 chunks=1 rows=1000 1481265661 1458239776 1.02
compress time/wide table cols=10000 chunks=50 rows=1000 1465045592 1470558231 1.00
decompress time/Arade 25772972 26992465 0.95
decompress time/Bimbo 78238667 77514260 1.01
decompress time/CMSprovider 77618569 80491441 0.96
decompress time/Euro2016 19946551 19426419 1.03
decompress time/Food 7985940 8265648 0.97
decompress time/HashTags 90437014 88223853 1.03
decompress time/TPC-H l_comment canonical 39505183 39610654 1.00
decompress time/TPC-H l_comment chunked 41135158 39578544 1.04
decompress time/taxi 🚨 15910421 14351647 1.11
decompress time/wide table cols=100 chunks=1 rows=1000 2530805 2361372 1.07
decompress time/wide table cols=100 chunks=50 rows=1000 2632405 2493397 1.06
decompress time/wide table cols=1000 chunks=1 rows=1000 23122503 21355690 1.08
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 24629552 21898771 1.12
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 251233439 220743988 1.14
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 267092405 233937369 1.14
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2643871405 2594445454 1.02
parquet_rs-zstd compress time/Bimbo 12797861732 12613597110 1.01
parquet_rs-zstd compress time/CMSprovider 7048221630 6919718062 1.02
parquet_rs-zstd compress time/Euro2016 1311641255 1313493851 1.00
parquet_rs-zstd compress time/Food 823904432 795468644 1.04
parquet_rs-zstd compress time/HashTags 2179232039 2166494383 1.01
parquet_rs-zstd compress time/TPC-H l_comment canonical 3244411051 3186099842 1.02
parquet_rs-zstd compress time/TPC-H l_comment chunked 3206608549 3205289326 1.00
parquet_rs-zstd compress time/taxi 1198904845 1180767233 1.02
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6127877 6018148 1.02
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6307315 6006325 1.05
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 74643666 73865291 1.01
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 74093412 73528258 1.01
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 768728731 779934982 0.99
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 787898223 767644500 1.03
parquet_rs-zstd decompress time/Arade 620518266 626341262 0.99
parquet_rs-zstd decompress time/Bimbo 1693946243 1692940027 1.00
parquet_rs-zstd decompress time/CMSprovider 1696559239 1719592642 0.99
parquet_rs-zstd decompress time/Euro2016 371868549 374453868 0.99
parquet_rs-zstd decompress time/Food 198534340 196514866 1.01
parquet_rs-zstd decompress time/HashTags 634264040 625107418 1.01
parquet_rs-zstd decompress time/TPC-H l_comment canonical 593772450 585688922 1.01
parquet_rs-zstd decompress time/TPC-H l_comment chunked 590453944 590336845 1.00
parquet_rs-zstd decompress time/taxi 246344887 242708699 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2819013 2773861 1.02
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2836997 2740605 1.04
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32472954 31436220 1.03
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32751330 32171135 1.02
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 351266443 343601329 1.02
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 350690684 344652397 1.02
vortex-file-compressed size/Arade 145363860 145363860 1.00
vortex-file-compressed size/Bimbo 468763396 468763396 1.00
vortex-file-compressed size/CMSprovider 417905916 417863292 1.00
vortex-file-compressed size/Euro2016 158943092 158528148 1.00
vortex-file-compressed size/Food 41927000 41927000 1.00
vortex-file-compressed size/HashTags 184805612 185799252 0.99
vortex-file-compressed size/TPC-H l_comment canonical 178433400 178289792 1.00
vortex-file-compressed size/TPC-H l_comment chunked 178458400 178380576 1.00
vortex-file-compressed size/taxi 52364012 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.98
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.99
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.03
vortex:parquet-zstd ratio compress time/Food 0 0 1.05
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.98
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.94
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.97
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.96
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.98
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.03
vortex:parquet-zstd ratio decompress time/Food 0 0 0.96
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.09
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 0 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 0 0 1.12
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 0.99
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions

github-actions Bot commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.3%
Engines: DataFusion No clear signal (+4.8%, environment too noisy confidence) · DuckDB No clear signal (-2.1%, environment too noisy confidence)
Vortex (geomean): 1.165x ➖
Parquet (geomean): 1.150x ➖
Shifts: Parquet (control) +15.0% · Median polish +11.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.203x ➖, 0↑ 4↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 846132911 691947327 1.22
tpch_q02/datafusion:vortex-file-compressed 🚨 1259861804 690665012 1.82
tpch_q03/datafusion:vortex-file-compressed 1099871768 950415550 1.16
tpch_q04/datafusion:vortex-file-compressed 674239276 574369847 1.17
tpch_q05/datafusion:vortex-file-compressed 1014913635 962918083 1.05
tpch_q06/datafusion:vortex-file-compressed 664010522 598246897 1.11
tpch_q07/datafusion:vortex-file-compressed 🚨 1527503365 1084489667 1.41
tpch_q08/datafusion:vortex-file-compressed 1452538109 1228077193 1.18
tpch_q09/datafusion:vortex-file-compressed 1557586433 1742645851 0.89
tpch_q10/datafusion:vortex-file-compressed 1172314988 1189134692 0.99
tpch_q11/datafusion:vortex-file-compressed 739845277 674299713 1.10
tpch_q12/datafusion:vortex-file-compressed 1081627917 895251169 1.21
tpch_q13/datafusion:vortex-file-compressed 459456708 418008678 1.10
tpch_q14/datafusion:vortex-file-compressed 659483132 517029694 1.28
tpch_q15/datafusion:vortex-file-compressed 1165330507 900219906 1.29
tpch_q16/datafusion:vortex-file-compressed 🚨 757851969 418364096 1.81
tpch_q17/datafusion:vortex-file-compressed 1443773662 1196866720 1.21
tpch_q18/datafusion:vortex-file-compressed 1411715297 1285125306 1.10
tpch_q19/datafusion:vortex-file-compressed 1013647887 858945479 1.18
tpch_q20/datafusion:vortex-file-compressed 🚨 1140193004 790450700 1.44
tpch_q21/datafusion:vortex-file-compressed 2020905947 1897249826 1.07
tpch_q22/datafusion:vortex-file-compressed 710156457 667258991 1.06
datafusion / vortex-compact (1.231x ➖, 0↑ 6↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 733950671 684344295 1.07
tpch_q02/datafusion:vortex-compact 🚨 1017868576 655977157 1.55
tpch_q03/datafusion:vortex-compact 823492448 782312833 1.05
tpch_q04/datafusion:vortex-compact 565239222 513376964 1.10
tpch_q05/datafusion:vortex-compact 🚨 1190140339 849430502 1.40
tpch_q06/datafusion:vortex-compact 571621666 526814094 1.09
tpch_q07/datafusion:vortex-compact 🚨 1323700116 972310177 1.36
tpch_q08/datafusion:vortex-compact 🚨 1825332402 1184743540 1.54
tpch_q09/datafusion:vortex-compact 1513837034 1318610139 1.15
tpch_q10/datafusion:vortex-compact 1168106927 973088735 1.20
tpch_q11/datafusion:vortex-compact 628481499 596297254 1.05
tpch_q12/datafusion:vortex-compact 🚨 1258283075 814069702 1.55
tpch_q13/datafusion:vortex-compact 483973405 439002337 1.10
tpch_q14/datafusion:vortex-compact 635683054 556774466 1.14
tpch_q15/datafusion:vortex-compact 1158092422 931164270 1.24
tpch_q16/datafusion:vortex-compact 421638199 364682587 1.16
tpch_q17/datafusion:vortex-compact 1420170106 1164480749 1.22
tpch_q18/datafusion:vortex-compact 1358636354 1157665619 1.17
tpch_q19/datafusion:vortex-compact 895185199 834936643 1.07
tpch_q20/datafusion:vortex-compact 1069942329 859925600 1.24
tpch_q21/datafusion:vortex-compact 1783275974 1494490404 1.19
tpch_q22/datafusion:vortex-compact 🚨 1115525016 658700579 1.69
datafusion / parquet (1.160x ➖, 0↑ 5↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 919053791 866098514 1.06
tpch_q02/datafusion:parquet 🚨 1506368719 1094179107 1.38
tpch_q03/datafusion:parquet 1110550028 1045811441 1.06
tpch_q04/datafusion:parquet 492019462 496923809 0.99
tpch_q05/datafusion:parquet 1176290048 1161054412 1.01
tpch_q06/datafusion:parquet 541692775 561839708 0.96
tpch_q07/datafusion:parquet 1342764635 1428821332 0.94
tpch_q08/datafusion:parquet 1790635135 2007205765 0.89
tpch_q09/datafusion:parquet 2202614881 2194398705 1.00
tpch_q10/datafusion:parquet 🚨 3069541728 2219195277 1.38
tpch_q11/datafusion:parquet 804197492 626655087 1.28
tpch_q12/datafusion:parquet 803046132 755584063 1.06
tpch_q13/datafusion:parquet 776814931 691710575 1.12
tpch_q14/datafusion:parquet 900043853 814885844 1.10
tpch_q15/datafusion:parquet 1627323665 1309003973 1.24
tpch_q16/datafusion:parquet 🚨 815649435 379797562 2.15
tpch_q17/datafusion:parquet 1552628651 1302136311 1.19
tpch_q18/datafusion:parquet 🚨 2109411032 1532837919 1.38
tpch_q19/datafusion:parquet 1077891408 946573304 1.14
tpch_q20/datafusion:parquet 🚨 1676100830 1201366259 1.40
tpch_q21/datafusion:parquet 2120425908 1895500413 1.12
tpch_q22/datafusion:parquet 859348496 747810854 1.15
duckdb / vortex-file-compressed (1.098x ➖, 0↑ 1↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 688068684 625765355 1.10
tpch_q02/duckdb:vortex-file-compressed 1352803235 1177542954 1.15
tpch_q03/duckdb:vortex-file-compressed 1000859003 977820622 1.02
tpch_q04/duckdb:vortex-file-compressed 813658632 762362788 1.07
tpch_q05/duckdb:vortex-file-compressed 1264285680 1157180198 1.09
tpch_q06/duckdb:vortex-file-compressed 570009838 607569146 0.94
tpch_q07/duckdb:vortex-file-compressed 1398577260 1122378925 1.25
tpch_q08/duckdb:vortex-file-compressed 1587547786 1469130533 1.08
tpch_q09/duckdb:vortex-file-compressed 1809172912 1739812677 1.04
tpch_q10/duckdb:vortex-file-compressed 1266570049 1176480214 1.08
tpch_q11/duckdb:vortex-file-compressed 🚨 765458081 574024852 1.33
tpch_q12/duckdb:vortex-file-compressed 1436992556 1236720637 1.16
tpch_q13/duckdb:vortex-file-compressed 962720154 900291277 1.07
tpch_q14/duckdb:vortex-file-compressed 737310572 686537173 1.07
tpch_q15/duckdb:vortex-file-compressed 625340323 556445366 1.12
tpch_q16/duckdb:vortex-file-compressed 578170407 544384646 1.06
tpch_q17/duckdb:vortex-file-compressed 1077103745 929274522 1.16
tpch_q18/duckdb:vortex-file-compressed 1032362014 901510586 1.15
tpch_q19/duckdb:vortex-file-compressed 866150791 769351839 1.13
tpch_q20/duckdb:vortex-file-compressed 1370349211 1274069494 1.08
tpch_q21/duckdb:vortex-file-compressed 2186393828 1970675763 1.11
tpch_q22/duckdb:vortex-file-compressed 422829488 439833561 0.96
duckdb / vortex-compact (1.133x ➖, 0↑ 2↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 654622847 613569850 1.07
tpch_q02/duckdb:vortex-compact 1159122347 1170588038 0.99
tpch_q03/duckdb:vortex-compact 1042054233 831633893 1.25
tpch_q04/duckdb:vortex-compact 647395794 581947838 1.11
tpch_q05/duckdb:vortex-compact 1224816381 1139619683 1.07
tpch_q06/duckdb:vortex-compact 633938220 521057396 1.22
tpch_q07/duckdb:vortex-compact 1300338906 1070690254 1.21
tpch_q08/duckdb:vortex-compact 1494979932 1390409345 1.08
tpch_q09/duckdb:vortex-compact 1671319046 1591382374 1.05
tpch_q10/duckdb:vortex-compact 🚨 1415926485 987690660 1.43
tpch_q11/duckdb:vortex-compact 🚨 735274816 532379383 1.38
tpch_q12/duckdb:vortex-compact 1245248909 1106560992 1.13
tpch_q13/duckdb:vortex-compact 848895990 787081646 1.08
tpch_q14/duckdb:vortex-compact 656681775 640060180 1.03
tpch_q15/duckdb:vortex-compact 580241230 524605932 1.11
tpch_q16/duckdb:vortex-compact 433034840 390631608 1.11
tpch_q17/duckdb:vortex-compact 1034644296 880147205 1.18
tpch_q18/duckdb:vortex-compact 852440413 787260317 1.08
tpch_q19/duckdb:vortex-compact 779996627 709824951 1.10
tpch_q20/duckdb:vortex-compact 1339587248 1162100460 1.15
tpch_q21/duckdb:vortex-compact 1855759677 1663906241 1.12
tpch_q22/duckdb:vortex-compact 428911699 396319892 1.08
duckdb / parquet (1.139x ➖, 0↑ 0↓)
name PR e40b94f (ns) base bfe88b8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 846146852 841151311 1.01
tpch_q02/duckdb:parquet 1764637754 1486694715 1.19
tpch_q03/duckdb:parquet 1885997899 1712624026 1.10
tpch_q04/duckdb:parquet 1192142915 1082628726 1.10
tpch_q05/duckdb:parquet 2370632781 1933153695 1.23
tpch_q06/duckdb:parquet 939984276 799552536 1.18
tpch_q07/duckdb:parquet 2144465383 1752645234 1.22
tpch_q08/duckdb:parquet 2898613703 2381335737 1.22
tpch_q09/duckdb:parquet 3147278827 2485497360 1.27
tpch_q10/duckdb:parquet 3542920413 2959784372 1.20
tpch_q11/duckdb:parquet 1049481874 1013299423 1.04
tpch_q12/duckdb:parquet 1458105594 1347930564 1.08
tpch_q13/duckdb:parquet 1526621290 1330612171 1.15
tpch_q14/duckdb:parquet 1499146169 1396290892 1.07
tpch_q15/duckdb:parquet 1154508530 955558574 1.21
tpch_q16/duckdb:parquet 1095801618 860079256 1.27
tpch_q17/duckdb:parquet 1482646164 1353443951 1.10
tpch_q18/duckdb:parquet 1673140856 1482579484 1.13
tpch_q19/duckdb:parquet 1634276414 1495400838 1.09
tpch_q20/duckdb:parquet 2087836433 1892393505 1.10
tpch_q21/duckdb:parquet 2026993337 1844229144 1.10
tpch_q22/duckdb:parquet 1206790985 1129668633 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +7.2% +3.3% +3.8% +45.7% ➖ noise
1 datafusion:vortex-file-compressed +22.3% +3.3% +18.4% +50.4% ➖ noise
1 duckdb:vortex-compact +6.7% +3.3% +3.3% +33.1% ➖ noise
1 duckdb:vortex-file-compressed +10.0% +3.3% +6.4% +34.6% ➖ noise
2 datafusion:vortex-compact +55.2% +27.8% +21.4% +40.1% ➖ noise
2 datafusion:vortex-file-compressed +82.4% +27.8% +42.7% +43.0% ➖ noise
2 duckdb:vortex-compact -1.0% +27.8% -22.5% +31.0% ➖ noise
2 duckdb:vortex-file-compressed +14.9% +27.8% -10.1% +31.0% ➖ noise
3 datafusion:vortex-compact +5.3% +8.1% -2.7% +46.7% ➖ noise
3 datafusion:vortex-file-compressed +15.7% +8.1% +7.0% +56.1% ➖ noise
3 duckdb:vortex-compact +25.3% +8.1% +15.9% +34.9% ➖ noise
3 duckdb:vortex-file-compressed +2.4% +8.1% -5.3% +48.0% ➖ noise
4 datafusion:vortex-compact +10.1% +4.4% +5.4% +44.0% ➖ noise
4 datafusion:vortex-file-compressed +17.4% +4.4% +12.4% +31.0% ➖ noise
4 duckdb:vortex-compact +11.2% +4.4% +6.5% +31.0% ➖ noise
4 duckdb:vortex-file-compressed +6.7% +4.4% +2.2% +31.0% ➖ noise
5 datafusion:vortex-compact +40.1% +11.5% +25.7% +31.0% ➖ noise
5 datafusion:vortex-file-compressed +5.4% +11.5% -5.4% +31.0% ➖ noise
5 duckdb:vortex-compact +7.5% +11.5% -3.6% +31.0% ➖ noise
5 duckdb:vortex-file-compressed +9.3% +11.5% -2.0% +31.0% ➖ noise
6 datafusion:vortex-compact +8.5% +6.5% +1.9% +31.0% ➖ noise
6 datafusion:vortex-file-compressed +11.0% +6.5% +4.3% +31.0% ➖ noise
6 duckdb:vortex-compact +21.7% +6.5% +14.3% +31.0% ➖ noise
6 duckdb:vortex-file-compressed -6.2% +6.5% -11.9% +31.0% ➖ noise
7 datafusion:vortex-compact +36.1% +7.2% +27.0% +31.0% ➖ noise
7 datafusion:vortex-file-compressed +40.8% +7.2% +31.4% +31.0% 🚨 regression
7 duckdb:vortex-compact +21.4% +7.2% +13.3% +31.0% ➖ noise
7 duckdb:vortex-file-compressed +24.6% +7.2% +16.2% +31.0% ➖ noise
8 datafusion:vortex-compact +54.1% +4.2% +47.9% +31.0% 🚨 regression
8 datafusion:vortex-file-compressed +18.3% +4.2% +13.5% +31.0% ➖ noise
8 duckdb:vortex-compact +7.5% +4.2% +3.2% +31.0% ➖ noise
8 duckdb:vortex-file-compressed +8.1% +4.2% +3.7% +31.0% ➖ noise
9 datafusion:vortex-compact +14.8% +12.7% +1.8% +31.0% ➖ noise
9 datafusion:vortex-file-compressed -10.6% +12.7% -20.7% +31.0% ➖ noise
9 duckdb:vortex-compact +5.0% +12.7% -6.8% +31.0% ➖ noise
9 duckdb:vortex-file-compressed +4.0% +12.7% -7.8% +31.0% ➖ noise
10 datafusion:vortex-compact +20.0% +28.7% -6.7% +31.0% ➖ noise
10 datafusion:vortex-file-compressed -1.4% +28.7% -23.4% +31.0% ➖ noise
10 duckdb:vortex-compact +43.4% +28.7% +11.4% +31.0% ➖ noise
10 duckdb:vortex-file-compressed +7.7% +28.7% -16.3% +31.0% ➖ noise
11 datafusion:vortex-compact +5.4% +15.3% -8.6% +35.5% ➖ noise
11 datafusion:vortex-file-compressed +9.7% +15.3% -4.8% +32.5% ➖ noise
11 duckdb:vortex-compact +38.1% +15.3% +19.8% +31.0% ➖ noise
11 duckdb:vortex-file-compressed +33.3% +15.3% +15.7% +31.0% ➖ noise
12 datafusion:vortex-compact +54.6% +7.2% +44.2% +31.0% 🚨 regression
12 datafusion:vortex-file-compressed +20.8% +7.2% +12.7% +31.0% ➖ noise
12 duckdb:vortex-compact +12.5% +7.2% +5.0% +31.0% ➖ noise
12 duckdb:vortex-file-compressed +16.2% +7.2% +8.4% +31.0% ➖ noise
13 datafusion:vortex-compact +10.2% +13.5% -2.9% +32.3% ➖ noise
13 datafusion:vortex-file-compressed +9.9% +13.5% -3.2% +31.0% ➖ noise
13 duckdb:vortex-compact +7.9% +13.5% -5.0% +31.0% ➖ noise
13 duckdb:vortex-file-compressed +6.9% +13.5% -5.8% +31.0% ➖ noise
14 datafusion:vortex-compact +14.2% +8.9% +4.8% +31.0% ➖ noise
14 datafusion:vortex-file-compressed +27.6% +8.9% +17.1% +31.0% ➖ noise
14 duckdb:vortex-compact +2.6% +8.9% -5.8% +31.0% ➖ noise
14 duckdb:vortex-file-compressed +7.4% +8.9% -1.4% +31.0% ➖ noise
15 datafusion:vortex-compact +24.4% +22.6% +1.5% +31.0% ➖ noise
15 datafusion:vortex-file-compressed +29.4% +22.6% +5.6% +31.0% ➖ noise
15 duckdb:vortex-compact +10.6% +22.6% -9.8% +109.0% ➖ noise
15 duckdb:vortex-file-compressed +12.4% +22.6% -8.3% +31.0% ➖ noise
16 datafusion:vortex-compact +15.6% +65.4% -30.1% +31.0% ✅ faster
16 datafusion:vortex-file-compressed +81.1% +65.4% +9.5% +34.0% ➖ noise
16 duckdb:vortex-compact +10.9% +65.4% -33.0% +31.0% ✅ faster
16 duckdb:vortex-file-compressed +6.2% +65.4% -35.8% +31.0% ✅ faster
17 datafusion:vortex-compact +22.0% +14.3% +6.7% +31.0% ➖ noise
17 datafusion:vortex-file-compressed +20.6% +14.3% +5.5% +31.0% ➖ noise
17 duckdb:vortex-compact +17.6% +14.3% +2.9% +31.0% ➖ noise
17 duckdb:vortex-file-compressed +15.9% +14.3% +1.4% +31.0% ➖ noise
18 datafusion:vortex-compact +17.4% +24.6% -5.8% +31.0% ➖ noise
18 datafusion:vortex-file-compressed +9.9% +24.6% -11.9% +31.0% ➖ noise
18 duckdb:vortex-compact +8.3% +24.6% -13.1% +31.0% ➖ noise
18 duckdb:vortex-file-compressed +14.5% +24.6% -8.1% +31.0% ➖ noise
19 datafusion:vortex-compact +7.2% +11.6% -3.9% +31.0% ➖ noise
19 datafusion:vortex-file-compressed +18.0% +11.6% +5.8% +31.0% ➖ noise
19 duckdb:vortex-compact +9.9% +11.6% -1.5% +31.0% ➖ noise
19 duckdb:vortex-file-compressed +12.6% +11.6% +0.9% +32.4% ➖ noise
20 datafusion:vortex-compact +24.4% +24.1% +0.3% +31.0% ➖ noise
20 datafusion:vortex-file-compressed +44.2% +24.1% +16.3% +31.0% ➖ noise
20 duckdb:vortex-compact +15.3% +24.1% -7.1% +31.0% ➖ noise
20 duckdb:vortex-file-compressed +7.6% +24.1% -13.3% +31.0% ➖ noise
21 datafusion:vortex-compact +19.3% +10.9% +7.6% +31.0% ➖ noise
21 datafusion:vortex-file-compressed +6.5% +10.9% -3.9% +31.0% ➖ noise
21 duckdb:vortex-compact +11.5% +10.9% +0.6% +31.0% ➖ noise
21 duckdb:vortex-file-compressed +10.9% +10.9% +0.1% +31.0% ➖ noise
22 datafusion:vortex-compact +69.4% +10.8% +52.8% +32.1% 🚨 regression
22 datafusion:vortex-file-compressed +6.4% +10.8% -3.9% +44.0% ➖ noise
22 duckdb:vortex-compact +8.2% +10.8% -2.3% +31.0% ➖ noise
22 duckdb:vortex-file-compressed -3.9% +10.8% -13.2% +31.0% ➖ noise

@onursatici
onursatici force-pushed the os/array-serialise-columnar branch from e40b94f to 5739636 Compare June 15, 2026 15:41
@onursatici
onursatici requested a review from a team June 15, 2026 15:41
Signed-off-by: Onur Satici <onur@spiraldb.com>
@onursatici
onursatici force-pushed the os/array-serialise-columnar branch from 5739636 to eb11f18 Compare June 16, 2026 10:41
@github-actions

github-actions Bot commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Jul 1, 2026
@robert3005 robert3005 removed the stale This PR is stale and will be auto-closed soon label Jul 2, 2026
@github-actions

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Jul 17, 2026
@joseph-isaacs joseph-isaacs removed the stale This PR is stale and will be auto-closed soon label Jul 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants