Skip to content

fix(bench): warmup + median for queryTimeMs to remove cold-start noise #3847

fix(bench): warmup + median for queryTimeMs to remove cold-start noise

fix(bench): warmup + median for queryTimeMs to remove cold-start noise #3847

Triggered via pull request May 15, 2026 16:11
Status Success
Total duration 20m 50s
Artifacts 4

ci.yml

on: pull_request
Matrix: native-host-build
Lint
7m 31s
Lint
TypeScript type check
6m 22s
TypeScript type check
Security audit
6m 40s
Security audit
Verify dynamic imports
7s
Verify dynamic imports
Rust compile check
1m 5s
Rust compile check
Matrix: parity
Matrix: test
Pre-publish benchmark gate
11m 18s
Pre-publish benchmark gate
CI Testing Pipeline
2s
CI Testing Pipeline
Fit to window
Zoom out
Zoom in

Annotations

17 warnings and 3 notices
Benchmark Regression
[resolve] JS fallback: 6.5 → 8.4 (+29%, threshold 15%)
Benchmark Regression
[wasm] 1-file rebuild: 51 → 62 (+22%, threshold 15%)
Benchmark Regression
[wasm] No-op rebuild: 13 → 17 (+31%, threshold 15%)
Benchmark Regression
[native] 1-file rebuild: 66 → 80 (+21%, threshold 15%)
Benchmark Regression
[wasm] fnImpact d1: 4.2 → 5.1 (+21%, threshold 15%)
Benchmark Regression
[wasm] fnDeps d5: 33 → 39.9 (+21%, threshold 15%)
Benchmark Regression
[wasm] fnDeps d3: 33 → 40 (+21%, threshold 15%)
Benchmark Regression
[wasm] fnDeps d1: 32.8 → 39.5 (+20%, threshold 15%)
Benchmark Regression
[native] fnImpact d5: 4.4 → 5.5 (+25%, threshold 15%)
Benchmark Regression
[native] fnImpact d3: 4.4 → 5.5 (+25%, threshold 15%)
Benchmark Regression
[native] fnImpact d1: 4.3 → 5.4 (+26%, threshold 15%)
Benchmark Regression
[native] fnDeps d5: 24.7 → 30.1 (+22%, threshold 15%)
Benchmark Regression
[native] fnDeps d3: 24.3 → 30 (+23%, threshold 15%)
Benchmark Regression
[native] fnDeps d1: 24.7 → 29.9 (+21%, threshold 15%)
Benchmark Regression
[wasm] 1-file rebuild: 51 → 62 (+22%, threshold 15%)
Benchmark Regression
[wasm] No-op rebuild: 15 → 21 (+40%, threshold 15%)
Benchmark Regression
[native] 1-file rebuild: 67 → 83 (+24%, threshold 15%)
Native host build (windows-latest)
NOTICE: windows-latest requests are being redirected to windows-2025-vs2026 by June 15, 2026
Engine parity (windows-latest)
NOTICE: windows-latest requests are being redirected to windows-2025-vs2026 by June 15, 2026
Test Node 22 (windows-latest)
NOTICE: windows-latest requests are being redirected to windows-2025-vs2026 by June 15, 2026

Artifacts

Produced during runtime
Name Size Digest
benchmark-results-json
2.97 KB
sha256:5384d069d29e3e826d0cd897fe8916aa4236368a8028e97e2bb9e45145bf95d6
native-host-macos-latest
11 MB
sha256:246faa6af85f9638d3ebdc8f321f6264a4ffc0a9654c094a1924a9aded5212f8
native-host-ubuntu-latest
10.8 MB
sha256:75ae206c51324647f663a6ce7b612438eec82d8e89bff3b9514099758e3d48c0
native-host-windows-latest
10.3 MB
sha256:df7fdee1928114329a97797b7566cf4a4dd58026a9a2ad72bb6f59e54fa98814