[DNM] Starkware Development

[JulianGCalderon]

A draft PR to track progress on the starkware-development branch.

[github-actions]

**Hyper Thereading Benchmark results**




hyperfine -r 2 -n "hyper_threading_main threads: 1" 'RAYON_NUM_THREADS=1 ./hyper_threading_main' -n "hyper_threading_pr threads: 1" 'RAYON_NUM_THREADS=1 ./hyper_threading_pr'
Benchmark 1: hyper_threading_main threads: 1
  Time (mean ± σ):     26.501 s ±  0.016 s    [User: 25.656 s, System: 0.840 s]
  Range (min … max):   26.489 s … 26.512 s    2 runs
 
Benchmark 2: hyper_threading_pr threads: 1
  Time (mean ± σ):     26.891 s ±  0.023 s    [User: 26.013 s, System: 0.874 s]
  Range (min … max):   26.874 s … 26.907 s    2 runs
 
Summary
  hyper_threading_main threads: 1 ran
    1.01 ± 0.00 times faster than hyper_threading_pr threads: 1




hyperfine -r 2 -n "hyper_threading_main threads: 2" 'RAYON_NUM_THREADS=2 ./hyper_threading_main' -n "hyper_threading_pr threads: 2" 'RAYON_NUM_THREADS=2 ./hyper_threading_pr'
Benchmark 1: hyper_threading_main threads: 2
  Time (mean ± σ):     14.758 s ±  0.045 s    [User: 25.778 s, System: 0.871 s]
  Range (min … max):   14.726 s … 14.790 s    2 runs
 
Benchmark 2: hyper_threading_pr threads: 2
  Time (mean ± σ):     14.968 s ±  0.008 s    [User: 26.137 s, System: 0.915 s]
  Range (min … max):   14.962 s … 14.974 s    2 runs
 
Summary
  hyper_threading_main threads: 2 ran
    1.01 ± 0.00 times faster than hyper_threading_pr threads: 2




hyperfine -r 2 -n "hyper_threading_main threads: 4" 'RAYON_NUM_THREADS=4 ./hyper_threading_main' -n "hyper_threading_pr threads: 4" 'RAYON_NUM_THREADS=4 ./hyper_threading_pr'
Benchmark 1: hyper_threading_main threads: 4
  Time (mean ± σ):     10.705 s ±  0.184 s    [User: 37.625 s, System: 1.036 s]
  Range (min … max):   10.575 s … 10.835 s    2 runs
 
Benchmark 2: hyper_threading_pr threads: 4
  Time (mean ± σ):     10.545 s ±  0.224 s    [User: 38.938 s, System: 1.100 s]
  Range (min … max):   10.387 s … 10.704 s    2 runs
 
Summary
  hyper_threading_pr threads: 4 ran
    1.02 ± 0.03 times faster than hyper_threading_main threads: 4




hyperfine -r 2 -n "hyper_threading_main threads: 6" 'RAYON_NUM_THREADS=6 ./hyper_threading_main' -n "hyper_threading_pr threads: 6" 'RAYON_NUM_THREADS=6 ./hyper_threading_pr'
Benchmark 1: hyper_threading_main threads: 6
  Time (mean ± σ):     10.589 s ±  0.317 s    [User: 37.915 s, System: 1.043 s]
  Range (min … max):   10.365 s … 10.813 s    2 runs
 
Benchmark 2: hyper_threading_pr threads: 6
  Time (mean ± σ):     10.821 s ±  0.091 s    [User: 38.861 s, System: 1.123 s]
  Range (min … max):   10.757 s … 10.885 s    2 runs
 
Summary
  hyper_threading_main threads: 6 ran
    1.02 ± 0.03 times faster than hyper_threading_pr threads: 6




hyperfine -r 2 -n "hyper_threading_main threads: 8" 'RAYON_NUM_THREADS=8 ./hyper_threading_main' -n "hyper_threading_pr threads: 8" 'RAYON_NUM_THREADS=8 ./hyper_threading_pr'
Benchmark 1: hyper_threading_main threads: 8
  Time (mean ± σ):     10.227 s ±  0.057 s    [User: 38.186 s, System: 1.090 s]
  Range (min … max):   10.187 s … 10.267 s    2 runs
 
Benchmark 2: hyper_threading_pr threads: 8
  Time (mean ± σ):     10.604 s ±  0.050 s    [User: 39.154 s, System: 1.147 s]
  Range (min … max):   10.568 s … 10.640 s    2 runs
 
Summary
  hyper_threading_main threads: 8 ran
    1.04 ± 0.01 times faster than hyper_threading_pr threads: 8




hyperfine -r 2 -n "hyper_threading_main threads: 16" 'RAYON_NUM_THREADS=16 ./hyper_threading_main' -n "hyper_threading_pr threads: 16" 'RAYON_NUM_THREADS=16 ./hyper_threading_pr'
Benchmark 1: hyper_threading_main threads: 16
  Time (mean ± σ):     10.440 s ±  0.023 s    [User: 38.316 s, System: 1.168 s]
  Range (min … max):   10.424 s … 10.456 s    2 runs
 
Benchmark 2: hyper_threading_pr threads: 16
  Time (mean ± σ):     10.848 s ±  0.202 s    [User: 39.518 s, System: 1.210 s]
  Range (min … max):   10.705 s … 10.991 s    2 runs
 
Summary
  hyper_threading_main threads: 16 ran
    1.04 ± 0.02 times faster than hyper_threading_pr threads: 16

[github-actions]

Benchmark Results for unmodified programs 🚀

Command	Mean [s]	Min [s]	Max [s]	Relative
base big_factorial	2.159 ± 0.014	2.143	2.181	1.00
head big_factorial	2.179 ± 0.013	2.158	2.198	1.01 ± 0.01

Command	Mean [s]	Min [s]	Max [s]	Relative
base big_fibonacci	2.073 ± 0.018	2.054	2.104	1.00
head big_fibonacci	2.092 ± 0.020	2.070	2.131	1.01 ± 0.01

Command	Mean [s]	Min [s]	Max [s]	Relative
base blake2s_integration_benchmark	7.594 ± 0.040	7.530	7.651	1.00
head blake2s_integration_benchmark	7.913 ± 0.083	7.818	8.085	1.04 ± 0.01

Command	Mean [s]	Min [s]	Max [s]	Relative
base compare_arrays_200000	2.210 ± 0.023	2.187	2.263	1.00
head compare_arrays_200000	2.223 ± 0.009	2.213	2.238	1.01 ± 0.01

Command	Mean [s]	Min [s]	Max [s]	Relative
base dict_integration_benchmark	1.456 ± 0.006	1.450	1.469	1.01 ± 0.01
head dict_integration_benchmark	1.443 ± 0.014	1.428	1.478	1.00

Command	Mean [s]	Min [s]	Max [s]	Relative
base field_arithmetic_get_square_benchmark	1.218 ± 0.011	1.207	1.244	1.00
head field_arithmetic_get_square_benchmark	1.233 ± 0.005	1.226	1.240	1.01 ± 0.01

Command	Mean [s]	Min [s]	Max [s]	Relative
base integration_builtins	7.642 ± 0.067	7.584	7.821	1.00
head integration_builtins	7.943 ± 0.048	7.849	8.028	1.04 ± 0.01

Command	Mean [s]	Min [s]	Max [s]	Relative
base keccak_integration_benchmark	7.880 ± 0.113	7.811	8.194	1.00
head keccak_integration_benchmark	8.217 ± 0.088	8.100	8.338	1.04 ± 0.02

Command	Mean [s]	Min [s]	Max [s]	Relative
base linear_search	2.181 ± 0.015	2.161	2.204	1.00
head linear_search	2.214 ± 0.010	2.202	2.230	1.02 ± 0.01

Command	Mean [s]	Min [s]	Max [s]	Relative
base math_cmp_and_pow_integration_benchmark	1.545 ± 0.018	1.532	1.590	1.00
head math_cmp_and_pow_integration_benchmark	1.552 ± 0.016	1.536	1.592	1.00 ± 0.02

Command	Mean [s]	Min [s]	Max [s]	Relative
base math_integration_benchmark	1.478 ± 0.006	1.472	1.488	1.00 ± 0.01
head math_integration_benchmark	1.476 ± 0.005	1.467	1.483	1.00

Command	Mean [s]	Min [s]	Max [s]	Relative
base memory_integration_benchmark	1.231 ± 0.010	1.224	1.256	1.01 ± 0.01
head memory_integration_benchmark	1.224 ± 0.006	1.215	1.234	1.00

Command	Mean [s]	Min [s]	Max [s]	Relative
base operations_with_data_structures_benchmarks	1.585 ± 0.005	1.576	1.591	1.00
head operations_with_data_structures_benchmarks	1.587 ± 0.005	1.579	1.593	1.00 ± 0.00

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
base pedersen	535.4 ± 1.5	533.4	537.9	1.00
head pedersen	538.9 ± 2.9	534.2	545.2	1.01 ± 0.01

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
base poseidon_integration_benchmark	642.2 ± 4.2	637.8	651.1	1.00
head poseidon_integration_benchmark	644.9 ± 2.5	640.2	649.0	1.00 ± 0.01

Command	Mean [s]	Min [s]	Max [s]	Relative
base secp_integration_benchmark	1.868 ± 0.005	1.863	1.878	1.00
head secp_integration_benchmark	1.884 ± 0.007	1.876	1.901	1.01 ± 0.00

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
base set_integration_benchmark	632.3 ± 4.2	628.8	642.8	1.00
head set_integration_benchmark	634.9 ± 3.3	630.4	640.5	1.00 ± 0.01

Command	Mean [s]	Min [s]	Max [s]	Relative
base uint256_integration_benchmark	4.195 ± 0.020	4.175	4.239	1.00
head uint256_integration_benchmark	4.329 ± 0.032	4.276	4.385	1.03 ± 0.01