Skip to content

[Evaluation] Inline everything on the evaluation path #7000

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

[Evaluation] Inline everything on the evaluation path #7000

wants to merge 1 commit into from
+20 −4

Conversation

effectfully
Copy link
Contributor

Couldn't make it a proper performance improvement, but let's see if it helps.

@effectfully effectfully self-assigned this Apr 1, 2025
@effectfully effectfully added the EXPERIMENT Experiments that we probably don't want to merge label Apr 1, 2025
@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully
Copy link
Contributor Author

/benchmark nofib

@effectfully
Copy link
Contributor Author

/benchmark lists

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2025

Comparing benchmark results of 'validation' on '89b1ad0477' (base) and '9be4680c92' (PR)

Results table
Script 89b1ad0 9be4680 Change
auction_1-1 163.1 μs 213.2 μs +30.7%
auction_1-2 522.3 μs 794.2 μs +52.1%
auction_1-3 526.9 μs 784.2 μs +48.8%
auction_1-4 212.6 μs 274.2 μs +29.0%
auction_2-1 162.8 μs 213.1 μs +30.9%
auction_2-2 526.0 μs 792.4 μs +50.6%
auction_2-3 676.5 μs 1.037 ms +53.3%
auction_2-4 516.5 μs 781.6 μs +51.3%
auction_2-5 210.8 μs 272.8 μs +29.4%
crowdfunding-success-1 191.9 μs 245.9 μs +28.1%
crowdfunding-success-2 191.3 μs 246.0 μs +28.6%
crowdfunding-success-3 190.9 μs 245.3 μs +28.5%
currency-1 209.7 μs 300.9 μs +43.5%
escrow-redeem_1-1 295.4 μs 422.2 μs +42.9%
escrow-redeem_1-2 295.2 μs 422.2 μs +43.0%
escrow-redeem_2-1 345.5 μs 492.4 μs +42.5%
escrow-redeem_2-2 345.5 μs 492.5 μs +42.5%
escrow-redeem_2-3 346.5 μs 491.7 μs +41.9%
escrow-refund-1 144.5 μs 181.2 μs +25.4%
future-increase-margin-1 210.6 μs 299.7 μs +42.3%
future-increase-margin-2 446.2 μs 653.9 μs +46.5%
future-increase-margin-3 454.6 μs 648.0 μs +42.5%
future-increase-margin-4 401.1 μs 590.4 μs +47.2%
future-increase-margin-5 679.3 μs 966.9 μs +42.3%
future-pay-out-1 209.3 μs 299.4 μs +43.0%
future-pay-out-2 445.7 μs 649.9 μs +45.8%
future-pay-out-3 446.6 μs 648.9 μs +45.3%
future-pay-out-4 676.1 μs 979.8 μs +44.9%
future-settle-early-1 208.7 μs 301.2 μs +44.3%
future-settle-early-2 446.2 μs 650.5 μs +45.8%
future-settle-early-3 447.5 μs 649.9 μs +45.2%
future-settle-early-4 520.3 μs 729.7 μs +40.2%
game-sm-success_1-1 333.2 μs 465.5 μs +39.7%
game-sm-success_1-2 181.8 μs 234.1 μs +28.8%
game-sm-success_1-3 530.5 μs 772.5 μs +45.6%
game-sm-success_1-4 218.2 μs 269.2 μs +23.4%
game-sm-success_2-1 333.2 μs 466.2 μs +39.9%
game-sm-success_2-2 182.1 μs 233.5 μs +28.2%
game-sm-success_2-3 529.7 μs 770.0 μs +45.4%
game-sm-success_2-4 210.9 μs 269.2 μs +27.6%
game-sm-success_2-5 531.9 μs 772.6 μs +45.3%
game-sm-success_2-6 211.6 μs 269.2 μs +27.2%
multisig-sm-1 332.8 μs 473.4 μs +42.2%
multisig-sm-2 322.0 μs 462.5 μs +43.6%
multisig-sm-3 329.3 μs 468.9 μs +42.4%
multisig-sm-4 328.2 μs 475.3 μs +44.8%
multisig-sm-5 454.5 μs 673.5 μs +48.2%
multisig-sm-6 331.8 μs 470.6 μs +41.8%
multisig-sm-7 320.5 μs 463.1 μs +44.5%
multisig-sm-8 323.1 μs 468.4 μs +45.0%
multisig-sm-9 327.6 μs 474.2 μs +44.7%
multisig-sm-10 460.6 μs 675.8 μs +46.7%
ping-pong-1 273.2 μs 391.0 μs +43.1%
ping-pong-2 273.2 μs 392.4 μs +43.6%
ping-pong_2-1 174.3 μs 238.2 μs +36.7%
prism-1 152.5 μs 195.4 μs +28.1%
prism-2 347.7 μs 492.1 μs +41.5%
prism-3 314.5 μs 484.9 μs +54.2%
pubkey-1 130.3 μs 164.7 μs +26.4%
stablecoin_1-1 790.4 μs 1.082 ms +36.9%
stablecoin_1-2 177.0 μs 228.5 μs +29.1%
stablecoin_1-3 902.8 μs 1.254 ms +38.9%
stablecoin_1-4 187.0 μs 240.5 μs +28.6%
stablecoin_1-5 1.163 ms 1.619 ms +39.2%
stablecoin_1-6 231.0 μs 299.5 μs +29.7%
stablecoin_2-1 788.1 μs 1.087 ms +37.9%
stablecoin_2-2 176.9 μs 230.3 μs +30.2%
stablecoin_2-3 902.0 μs 1.265 ms +40.2%
stablecoin_2-4 186.8 μs 242.1 μs +29.6%
token-account-1 162.3 μs 221.6 μs +36.5%
token-account-2 285.2 μs 412.2 μs +44.5%
uniswap-1 333.4 μs 506.9 μs +52.0%
uniswap-2 192.6 μs 268.7 μs +39.5%
uniswap-3 1.443 ms 2.134 ms +47.9%
uniswap-4 300.9 μs 395.6 μs +31.5%
uniswap-5 957.0 μs 1.400 ms +46.3%
uniswap-6 286.3 μs 380.6 μs +32.9%
vesting-1 288.4 μs 418.7 μs +45.2%
89b1ad0 9be4680 Change
TOTAL 29.88 ms 42.44 ms +42.1%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2025

Comparing benchmark results of 'nofib' on '89b1ad0477' (base) and '9be4680c92' (PR)

Results table
Script 89b1ad0 9be4680 Change
clausify/formula1 2.388 ms 3.678 ms +54.0%
clausify/formula2 3.197 ms 4.878 ms +52.6%
clausify/formula3 8.835 ms 13.36 ms +51.2%
clausify/formula4 20.51 ms 29.92 ms +45.9%
clausify/formula5 43.02 ms 64.86 ms +50.8%
knights/4x4 14.86 ms 19.84 ms +33.5%
knights/6x6 36.30 ms 50.85 ms +40.1%
knights/8x8 62.99 ms 89.60 ms +42.2%
primetest/05digits 9.203 ms 11.22 ms +21.9%
primetest/10digits 17.78 ms 22.22 ms +25.0%
primetest/30digits 54.02 ms 68.53 ms +26.9%
primetest/50digits 89.79 ms 113.0 ms +25.8%
queens4x4/bt 4.137 ms 5.684 ms +37.4%
queens4x4/bm 5.091 ms 7.190 ms +41.2%
queens4x4/bjbt1 4.949 ms 6.882 ms +39.1%
queens4x4/bjbt2 4.704 ms 6.470 ms +37.5%
queens4x4/fc 10.29 ms 14.63 ms +42.2%
queens5x5/bt 58.15 ms 77.77 ms +33.7%
queens5x5/bm 58.81 ms 80.71 ms +37.2%
queens5x5/bjbt1 67.10 ms 90.59 ms +35.0%
queens5x5/bjbt2 65.37 ms 88.13 ms +34.8%
queens5x5/fc 130.2 ms 186.0 ms +42.9%
89b1ad0 9be4680 Change
TOTAL 771.7 ms 1.056 s +36.8%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2025

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

what the fuck lololol

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 1, 2025

Comparing benchmark results of 'lists' on '89b1ad0477' (base) and '9be4680c92' (PR)

Results table
Script 89b1ad0 9be4680 Change
sort/ghcSort/50 185.6 μs 272.9 μs +47.0%
sort/ghcSort/100 431.9 μs 631.5 μs +46.2%
sort/ghcSort/150 742.1 μs 1.091 ms +47.0%
sort/ghcSort/200 1.013 ms 1.471 ms +45.2%
sort/ghcSort/250 1.306 ms 1.891 ms +44.8%
sort/ghcSort/300 1.722 ms 2.480 ms +44.0%
sort/insertionSort/50 602.0 μs 822.7 μs +36.7%
sort/insertionSort/100 2.413 ms 3.251 ms +34.7%
sort/insertionSort/150 5.427 ms 7.347 ms +35.4%
sort/insertionSort/200 9.694 ms 13.11 ms +35.2%
sort/insertionSort/250 15.11 ms 20.55 ms +36.0%
sort/insertionSort/300 21.97 ms 29.67 ms +35.0%
sort/mergeSort/50 552.0 μs 732.6 μs +32.7%
sort/mergeSort/100 1.264 ms 1.684 ms +33.2%
sort/mergeSort/150 2.036 ms 2.712 ms +33.2%
sort/mergeSort/200 2.859 ms 3.816 ms +33.5%
sort/mergeSort/250 3.757 ms 5.005 ms +33.2%
sort/mergeSort/300 4.563 ms 6.104 ms +33.8%
sort/quickSort/50 1.522 ms 2.201 ms +44.6%
sort/quickSort/100 6.269 ms 8.796 ms +40.3%
sort/quickSort/150 14.11 ms 19.64 ms +39.2%
sort/quickSort/200 24.95 ms 34.70 ms +39.1%
sort/quickSort/250 39.37 ms 54.59 ms +38.7%
sort/quickSort/300 56.98 ms 78.76 ms +38.2%
sum/compiled-from-Haskell/sum-right-builtin/100 76.65 μs 109.9 μs +43.4%
sum/compiled-from-Haskell/sum-right-builtin/500 401.3 μs 570.3 μs +42.1%
sum/compiled-from-Haskell/sum-right-builtin/1000 851.8 μs 1.224 ms +43.7%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.625 ms 3.575 ms +36.2%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.691 ms 7.482 ms +31.5%
sum/compiled-from-Haskell/sum-right-Scott/100 42.53 μs 65.15 μs +53.2%
sum/compiled-from-Haskell/sum-right-Scott/500 227.2 μs 349.6 μs +53.9%
sum/compiled-from-Haskell/sum-right-Scott/1000 483.4 μs 754.7 μs +56.1%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.689 ms 2.472 ms +46.4%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.095 ms 5.317 ms +29.8%
sum/compiled-from-Haskell/sum-right-data/100 255.6 μs 331.9 μs +29.9%
sum/compiled-from-Haskell/sum-right-data/500 1.404 ms 1.825 ms +30.0%
sum/compiled-from-Haskell/sum-right-data/1000 3.153 ms 3.964 ms +25.7%
sum/compiled-from-Haskell/sum-right-data/2500 8.475 ms 10.33 ms +21.9%
sum/compiled-from-Haskell/sum-right-data/5000 18.08 ms 21.68 ms +19.9%
sum/compiled-from-Haskell/sum-left-builtin/100 75.60 μs 105.8 μs +39.9%
sum/compiled-from-Haskell/sum-left-builtin/500 392.5 μs 552.1 μs +40.7%
sum/compiled-from-Haskell/sum-left-builtin/1000 844.5 μs 1.182 ms +40.0%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.584 ms 3.453 ms +33.6%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.713 ms 7.272 ms +27.3%
sum/compiled-from-Haskell/sum-left-Scott/100 42.59 μs 62.04 μs +45.7%
sum/compiled-from-Haskell/sum-left-Scott/500 223.8 μs 330.6 μs +47.7%
sum/compiled-from-Haskell/sum-left-Scott/1000 493.9 μs 714.8 μs +44.7%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.619 ms 2.340 ms +44.5%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.043 ms 5.088 ms +25.8%
sum/compiled-from-Haskell/sum-left-data/100 256.9 μs 342.3 μs +33.2%
sum/compiled-from-Haskell/sum-left-data/500 1.424 ms 1.896 ms +33.1%
sum/compiled-from-Haskell/sum-left-data/1000 3.208 ms 4.149 ms +29.3%
sum/compiled-from-Haskell/sum-left-data/2500 8.546 ms 10.87 ms +27.2%
sum/compiled-from-Haskell/sum-left-data/5000 18.21 ms 22.42 ms +23.1%
sum/hand-written-PLC/sum-right-builtin/100 52.07 μs 77.76 μs +49.3%
sum/hand-written-PLC/sum-right-builtin/500 258.8 μs 382.2 μs +47.7%
sum/hand-written-PLC/sum-right-builtin/1000 534.2 μs 794.8 μs +48.8%
sum/hand-written-PLC/sum-right-builtin/2500 1.550 ms 2.252 ms +45.3%
sum/hand-written-PLC/sum-right-builtin/5000 3.448 ms 4.730 ms +37.2%
sum/hand-written-PLC/sum-right-Scott/100 35.58 μs 63.76 μs +79.2%
sum/hand-written-PLC/sum-right-Scott/500 183.7 μs 325.4 μs +77.1%
sum/hand-written-PLC/sum-right-Scott/1000 388.9 μs 679.0 μs +74.6%
sum/hand-written-PLC/sum-right-Scott/2500 1.180 ms 2.061 ms +74.7%
sum/hand-written-PLC/sum-right-Scott/5000 3.026 ms 4.489 ms +48.3%
sum/hand-written-PLC/sum-left-builtin/100 54.10 μs 82.54 μs +52.6%
sum/hand-written-PLC/sum-left-builtin/500 268.0 μs 411.4 μs +53.5%
sum/hand-written-PLC/sum-left-builtin/1000 532.8 μs 817.2 μs +53.4%
sum/hand-written-PLC/sum-left-builtin/2500 1.334 ms 2.030 ms +52.2%
sum/hand-written-PLC/sum-left-builtin/5000 2.645 ms 4.046 ms +53.0%
sum/hand-written-PLC/sum-left-Scott/100 38.11 μs 67.64 μs +77.5%
sum/hand-written-PLC/sum-left-Scott/500 192.4 μs 337.0 μs +75.2%
sum/hand-written-PLC/sum-left-Scott/1000 394.5 μs 678.0 μs +71.9%
sum/hand-written-PLC/sum-left-Scott/2500 1.109 ms 1.930 ms +74.0%
sum/hand-written-PLC/sum-left-Scott/5000 2.564 ms 4.022 ms +56.9%
89b1ad0 9be4680 Change
TOTAL 333.9 ms 452.4 ms +35.5%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@effectfully effectfully

Labels
Evaluation EXPERIMENT Experiments that we probably don't want to merge Performance
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@effectfully