-
Notifications
You must be signed in to change notification settings - Fork 44
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
make benches/libfuncs.rs also run AOT benches #868
Conversation
✅ Code is now correctly formatted. |
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #868 +/- ##
=======================================
Coverage 82.82% 82.82%
=======================================
Files 120 120
Lines 34941 34941
=======================================
Hits 28941 28941
Misses 6000 6000 ☔ View full report in Codecov by Sentry. |
Benchmarking resultsBenchmark for program
|
Command | Mean [s] | Min [s] | Max [s] | Relative |
---|---|---|---|---|
Cairo-vm (Rust, Cairo 1) |
11.104 ± 0.362 | 10.748 | 11.674 | 24.77 ± 0.81 |
cairo-native (embedded AOT) |
3.102 ± 0.024 | 3.066 | 3.140 | 6.92 ± 0.06 |
cairo-native (embedded JIT using LLVM's ORC Engine) |
3.194 ± 0.038 | 3.121 | 3.235 | 7.13 ± 0.09 |
cairo-native (standalone AOT) |
0.674 ± 0.001 | 0.672 | 0.676 | 1.50 ± 0.01 |
cairo-native (standalone AOT with -march=native) |
0.448 ± 0.002 | 0.445 | 0.451 | 1.00 |
Benchmark for program fib_2M
Open benchmarks
Command | Mean [s] | Min [s] | Max [s] | Relative |
---|---|---|---|---|
Cairo-vm (Rust, Cairo 1) |
11.215 ± 0.280 | 10.789 | 11.547 | 1401.74 ± 40.57 |
cairo-native (embedded AOT) |
2.692 ± 0.036 | 2.645 | 2.774 | 336.51 ± 6.71 |
cairo-native (embedded JIT using LLVM's ORC Engine) |
2.690 ± 0.021 | 2.663 | 2.725 | 336.17 ± 5.60 |
cairo-native (standalone AOT) |
0.008 ± 0.000 | 0.008 | 0.009 | 1.04 ± 0.02 |
cairo-native (standalone AOT with -march=native) |
0.008 ± 0.000 | 0.007 | 0.009 | 1.00 |
Benchmark for program logistic_map
Open benchmarks
Command | Mean [s] | Min [s] | Max [s] | Relative |
---|---|---|---|---|
Cairo-vm (Rust, Cairo 1) |
4.270 ± 0.020 | 4.227 | 4.306 | 61.25 ± 0.92 |
cairo-native (embedded AOT) |
2.873 ± 0.035 | 2.818 | 2.914 | 41.21 ± 0.77 |
cairo-native (embedded JIT using LLVM's ORC Engine) |
2.999 ± 0.019 | 2.974 | 3.042 | 43.02 ± 0.67 |
cairo-native (standalone AOT) |
0.114 ± 0.001 | 0.110 | 0.115 | 1.63 ± 0.03 |
cairo-native (standalone AOT with -march=native) |
0.070 ± 0.001 | 0.067 | 0.072 | 1.00 |
Benchmark results Main vs HEAD.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me, but why was programs/compile_benches
changed?
apparently they werent run on ci, so they were outdated cairo code that doesnt compile with the modern version |
Fixes #867