Skip to content

Clean up cherry-pick tags from generated changelog #8733

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
May 2, 2025
Merged

Clean up cherry-pick tags from generated changelog #8733

merged 1 commit into from
May 2, 2025
+6 −1

Conversation

PerfectSlayer
Copy link
Contributor

@PerfectSlayer PerfectSlayer commented Apr 25, 2025 •
edited by jira bot
Loading

What Does This Do

Improve changelog generation to cleanup generated cherry pick prefix

Motivation

Feedback from releaser

Additional Notes

Contributor Checklist

Jira ticket: LANGPLAT-462

@PerfectSlayer PerfectSlayer added type: enhancement tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Apr 25, 2025
@PerfectSlayer PerfectSlayer requested a review from a team as a code owner April 25, 2025 09:01
@pr-commenter
Copy link

pr-commenter bot commented Apr 25, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1745992139 1745571386
git_commit_sha 856a0d8 2508221
release_version 1.49.0-SNAPSHOT~856a0d88ec 1.49.0-SNAPSHOT~25082217d6
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1745995497 1745995497
ci_job_id 918179394 918179394
ci_pipeline_id 63699766 63699766
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vwqh7yyx-project-304-concurrent-1-lc2z3qi9 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vwqh7yyx-project-304-concurrent-1-lc2z3qi9 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 18 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start worse
[+33.834ms; +64.384ms] or [+2.964%; +5.640%]		 1.191s 1.142s
scenario:startup:insecure-bank:iast:BytebuddyAgent worse
[+37.202ms; +60.196ms] or [+4.682%; +7.576%]		 843.218ms 794.519ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agent.start worse
[+31.979ms; +58.980ms] or [+2.800%; +5.165%]		 1.187s 1.142s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:BytebuddyAgent worse
[+33.671ms; +57.860ms] or [+4.236%; +7.278%]		 840.719ms 794.954ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agent.start worse
[+45.399ms; +55.587ms] or [+4.015%; +4.916%]		 1.181s 1.131s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:BytebuddyAgent worse
[+48.248ms; +55.034ms] or [+6.147%; +7.011%]		 836.603ms 784.962ms
scenario:startup:insecure-bank:tracing:Agent.start worse
[+43.468ms; +73.059ms] or [+4.325%; +7.269%]		 1.063s 1.005s
scenario:startup:insecure-bank:tracing:BytebuddyAgent worse
[+45.810ms; +64.718ms] or [+6.826%; +9.644%]		 726.367ms 671.103ms
scenario:startup:petclinic:appsec:Agent.start worse
[+30.925ms; +64.144ms] or [+2.664%; +5.525%]		 1.208s 1.161s
scenario:startup:petclinic:appsec:BytebuddyAgent worse
[+38.488ms; +60.505ms] or [+5.524%; +8.684%]		 746.224ms 696.728ms
scenario:startup:petclinic:iast:Agent.start worse
[+47.820ms; +83.772ms] or [+4.199%; +7.356%]		 1.205s 1.139s
scenario:startup:petclinic:iast:BytebuddyAgent worse
[+48.349ms; +81.740ms] or [+6.114%; +10.337%]		 855.828ms 790.783ms
scenario:startup:petclinic:profiling:Agent.start worse
[+53.375ms; +64.691ms] or [+4.251%; +5.152%]		 1.315s 1.256s
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+6.504ms; +8.629ms] or [+6.702%; +8.892%]		 104.607ms 97.041ms
scenario:startup:petclinic:profiling:BytebuddyAgent worse
[+48.814ms; +55.317ms] or [+7.364%; +8.345%]		 714.967ms 662.901ms
scenario:startup:petclinic:profiling:Profiling worse
[+6.505ms; +8.631ms] or [+6.702%; +8.892%]		 104.633ms 97.065ms
scenario:startup:petclinic:tracing:Agent.start worse
[+35.734ms; +74.412ms] or [+3.536%; +7.363%]		 1.066s 1.011s
scenario:startup:petclinic:tracing:BytebuddyAgent worse
[+40.706ms; +67.337ms] or [+6.036%; +9.985%]		 728.413ms 674.392ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.49.0-SNAPSHOT~25082217d6, baseline=1.49.0-SNAPSHOT~856a0d88ec

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.005 s) : 0, 1005055
Total [baseline] (8.666 s) : 0, 8665941
Agent [candidate] (1.063 s) : 0, 1063318
Total [candidate] (8.715 s) : 0, 8714515
section iast
Agent [baseline] (1.142 s) : 0, 1141603
Total [baseline] (9.196 s) : 0, 9196463
Agent [candidate] (1.191 s) : 0, 1190712
Total [candidate] (9.247 s) : 0, 9247114
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.142 s) : 0, 1141962
Total [baseline] (9.176 s) : 0, 9175557
Agent [candidate] (1.187 s) : 0, 1187441
Total [candidate] (9.229 s) : 0, 9228686
section iast_TELEMETRY_OFF
Agent [baseline] (1.131 s) : 0, 1130626
Total [baseline] (9.198 s) : 0, 9198012
Agent [candidate] (1.181 s) : 0, 1181119
Total [candidate] (9.205 s) : 0, 9205377
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.005 s -
Agent iast 1.142 s 136.549 ms (13.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.142 s 136.907 ms (13.6%)
Agent iast_TELEMETRY_OFF 1.131 s 125.571 ms (12.5%)
Total tracing 8.666 s -
Total iast 9.196 s 530.521 ms (6.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.176 s 509.616 ms (5.9%)
Total iast_TELEMETRY_OFF 9.198 s 532.07 ms (6.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.191 s 127.394 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.187 s 124.123 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.181 s 117.801 ms (11.1%)
Total tracing 8.715 s -
Total iast 9.247 s 532.598 ms (6.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.229 s 514.17 ms (5.9%)
Total iast_TELEMETRY_OFF 9.205 s 490.861 ms (5.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.49.0-SNAPSHOT~25082217d6, baseline=1.49.0-SNAPSHOT~856a0d88ec

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (671.103 ms) : 0, 671103
BytebuddyAgent [candidate] (726.367 ms) : 0, 726367
GlobalTracer [baseline] (240.272 ms) : 0, 240272
GlobalTracer [candidate] (240.93 ms) : 0, 240930
AppSec [baseline] (54.892 ms) : 0, 54892
AppSec [candidate] (55.661 ms) : 0, 55661
Debugger [baseline] (6.137 ms) : 0, 6137
Debugger [candidate] (6.982 ms) : 0, 6982
Remote Config [baseline] (690.216 µs) : 0, 690
Remote Config [candidate] (701.013 µs) : 0, 701
Telemetry [baseline] (8.466 ms) : 0, 8466
Telemetry [candidate] (9.117 ms) : 0, 9117
section iast
BytebuddyAgent [baseline] (794.519 ms) : 0, 794519
BytebuddyAgent [candidate] (843.218 ms) : 0, 843218
GlobalTracer [baseline] (230.55 ms) : 0, 230550
GlobalTracer [candidate] (230.058 ms) : 0, 230058
IAST [baseline] (22.789 ms) : 0, 22789
IAST [candidate] (23.762 ms) : 0, 23762
AppSec [baseline] (55.999 ms) : 0, 55999
AppSec [candidate] (54.224 ms) : 0, 54224
Debugger [baseline] (5.796 ms) : 0, 5796
Debugger [candidate] (5.897 ms) : 0, 5897
Remote Config [baseline] (600.72 µs) : 0, 601
Remote Config [candidate] (598.33 µs) : 0, 598
Telemetry [baseline] (7.861 ms) : 0, 7861
Telemetry [candidate] (7.849 ms) : 0, 7849
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (794.954 ms) : 0, 794954
BytebuddyAgent [candidate] (840.719 ms) : 0, 840719
GlobalTracer [baseline] (230.064 ms) : 0, 230064
GlobalTracer [candidate] (229.722 ms) : 0, 229722
IAST [baseline] (22.906 ms) : 0, 22906
IAST [candidate] (25.45 ms) : 0, 25450
AppSec [baseline] (56.013 ms) : 0, 56013
AppSec [candidate] (51.515 ms) : 0, 51515
Debugger [baseline] (5.892 ms) : 0, 5892
Debugger [candidate] (5.863 ms) : 0, 5863
Remote Config [baseline] (587.779 µs) : 0, 588
Remote Config [candidate] (598.622 µs) : 0, 599
Telemetry [baseline] (7.903 ms) : 0, 7903
Telemetry [candidate] (7.865 ms) : 0, 7865
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (784.962 ms) : 0, 784962
BytebuddyAgent [candidate] (836.603 ms) : 0, 836603
GlobalTracer [baseline] (229.412 ms) : 0, 229412
GlobalTracer [candidate] (229.029 ms) : 0, 229029
IAST [baseline] (22.159 ms) : 0, 22159
IAST [candidate] (22.286 ms) : 0, 22286
AppSec [baseline] (56.56 ms) : 0, 56560
AppSec [candidate] (55.732 ms) : 0, 55732
Debugger [baseline] (5.862 ms) : 0, 5862
Debugger [candidate] (5.849 ms) : 0, 5849
Remote Config [baseline] (597.494 µs) : 0, 597
Remote Config [candidate] (587.632 µs) : 0, 588
Telemetry [baseline] (7.738 ms) : 0, 7738
Telemetry [candidate] (7.756 ms) : 0, 7756
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.49.0-SNAPSHOT~25082217d6, baseline=1.49.0-SNAPSHOT~856a0d88ec

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.011 s) : 0, 1010666
Total [baseline] (10.512 s) : 0, 10511901
Agent [candidate] (1.066 s) : 0, 1065740
Total [candidate] (10.613 s) : 0, 10612704
section appsec
Agent [baseline] (1.161 s) : 0, 1160922
Total [baseline] (10.771 s) : 0, 10770528
Agent [candidate] (1.208 s) : 0, 1208456
Total [candidate] (10.767 s) : 0, 10766919
section iast
Agent [baseline] (1.139 s) : 0, 1138754
Total [baseline] (10.824 s) : 0, 10824280
Agent [candidate] (1.205 s) : 0, 1204550
Total [candidate] (10.986 s) : 0, 10985878
section profiling
Agent [baseline] (1.256 s) : 0, 1255730
Total [baseline] (10.793 s) : 0, 10792866
Agent [candidate] (1.315 s) : 0, 1314763
Total [candidate] (10.843 s) : 0, 10842849
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.011 s -
Agent appsec 1.161 s 150.255 ms (14.9%)
Agent iast 1.139 s 128.088 ms (12.7%)
Agent profiling 1.256 s 245.063 ms (24.2%)
Total tracing 10.512 s -
Total appsec 10.771 s 258.627 ms (2.5%)
Total iast 10.824 s 312.379 ms (3.0%)
Total profiling 10.793 s 280.965 ms (2.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.208 s 142.717 ms (13.4%)
Agent iast 1.205 s 138.81 ms (13.0%)
Agent profiling 1.315 s 249.023 ms (23.4%)
Total tracing 10.613 s -
Total appsec 10.767 s 154.215 ms (1.5%)
Total iast 10.986 s 373.174 ms (3.5%)
Total profiling 10.843 s 230.145 ms (2.2%) 
gantt
    title petclinic - break down per module: candidate=1.49.0-SNAPSHOT~25082217d6, baseline=1.49.0-SNAPSHOT~856a0d88ec

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (674.392 ms) : 0, 674392
BytebuddyAgent [candidate] (728.413 ms) : 0, 728413
GlobalTracer [baseline] (240.988 ms) : 0, 240988
GlobalTracer [candidate] (241.348 ms) : 0, 241348
AppSec [baseline] (54.953 ms) : 0, 54953
AppSec [candidate] (55.549 ms) : 0, 55549
Debugger [baseline] (6.163 ms) : 0, 6163
Debugger [candidate] (6.896 ms) : 0, 6896
Remote Config [baseline] (707.348 µs) : 0, 707
Remote Config [candidate] (691.57 µs) : 0, 692
Telemetry [baseline] (9.892 ms) : 0, 9892
Telemetry [candidate] (9.151 ms) : 0, 9151
section appsec
BytebuddyAgent [baseline] (696.728 ms) : 0, 696728
BytebuddyAgent [candidate] (746.224 ms) : 0, 746224
GlobalTracer [baseline] (238.891 ms) : 0, 238891
GlobalTracer [candidate] (237.766 ms) : 0, 237766
IAST [baseline] (22.016 ms) : 0, 22016
IAST [candidate] (21.677 ms) : 0, 21677
AppSec [baseline] (175.29 ms) : 0, 175290
AppSec [candidate] (175.102 ms) : 0, 175102
Debugger [baseline] (5.916 ms) : 0, 5916
Debugger [candidate] (6.342 ms) : 0, 6342
Remote Config [baseline] (649.409 µs) : 0, 649
Remote Config [candidate] (628.225 µs) : 0, 628
Telemetry [baseline] (8.928 ms) : 0, 8928
Telemetry [candidate] (7.825 ms) : 0, 7825
section iast
BytebuddyAgent [baseline] (790.783 ms) : 0, 790783
BytebuddyAgent [candidate] (855.828 ms) : 0, 855828
GlobalTracer [baseline] (230.526 ms) : 0, 230526
GlobalTracer [candidate] (231.165 ms) : 0, 231165
IAST [baseline] (22.77 ms) : 0, 22770
IAST [candidate] (23.093 ms) : 0, 23093
AppSec [baseline] (56.714 ms) : 0, 56714
AppSec [candidate] (56.316 ms) : 0, 56316
Debugger [baseline] (5.944 ms) : 0, 5944
Debugger [candidate] (5.895 ms) : 0, 5895
Remote Config [baseline] (596.111 µs) : 0, 596
Remote Config [candidate] (594.233 µs) : 0, 594
Telemetry [baseline] (8.009 ms) : 0, 8009
Telemetry [candidate] (7.913 ms) : 0, 7913
section profiling
BytebuddyAgent [baseline] (662.901 ms) : 0, 662901
BytebuddyAgent [candidate] (714.967 ms) : 0, 714967
GlobalTracer [baseline] (376.264 ms) : 0, 376264
GlobalTracer [candidate] (376.418 ms) : 0, 376418
AppSec [baseline] (54.349 ms) : 0, 54349
AppSec [candidate] (53.529 ms) : 0, 53529
Debugger [baseline] (6.118 ms) : 0, 6118
Debugger [candidate] (6.13 ms) : 0, 6130
Remote Config [baseline] (641.28 µs) : 0, 641
Remote Config [candidate] (652.335 µs) : 0, 652
Telemetry [baseline] (8.141 ms) : 0, 8141
Telemetry [candidate] (8.125 ms) : 0, 8125
ProfilingAgent [baseline] (97.041 ms) : 0, 97041
ProfilingAgent [candidate] (104.607 ms) : 0, 104607
Profiling [baseline] (97.065 ms) : 0, 97065
Profiling [candidate] (104.633 ms) : 0, 104633
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-04-30T06:15:14 2025-04-30T06:22:59
git_branch master bbujon/ci
git_commit_date 1745992139 1745571386
git_commit_sha 856a0d8 2508221
release_version 1.49.0-SNAPSHOT~856a0d88ec 1.49.0-SNAPSHOT~25082217d6
start_time 2025-04-30T06:15:00 2025-04-30T06:22:45
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1745994577 1745994577
ci_job_id 918179395 918179395
ci_pipeline_id 63699766 63699766
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vwqh7yyx-project-304-concurrent-2-mfs8w6z5 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vwqh7yyx-project-304-concurrent-2-mfs8w6z5 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~25082217d6, baseline=1.49.0-SNAPSHOT~856a0d88ec
    dateFormat X
    axisFormat %s
section baseline
no_agent (375.518 µs) : 356, 395
.   : milestone, 376,
iast (516.969 µs) : 494, 540
.   : milestone, 517,
iast_FULL (738.282 µs) : 715, 762
.   : milestone, 738,
iast_GLOBAL (577.663 µs) : 552, 603
.   : milestone, 578,
iast_HARDCODED_SECRET_DISABLED (516.521 µs) : 494, 540
.   : milestone, 517,
iast_INACTIVE (471.385 µs) : 449, 494
.   : milestone, 471,
iast_TELEMETRY_OFF (514.418 µs) : 491, 537
.   : milestone, 514,
tracing (464.855 µs) : 444, 486
.   : milestone, 465,
section candidate
no_agent (381.641 µs) : 361, 402
.   : milestone, 382,
iast (528.254 µs) : 506, 550
.   : milestone, 528,
iast_FULL (737.481 µs) : 714, 760
.   : milestone, 737,
iast_GLOBAL (576.287 µs) : 553, 600
.   : milestone, 576,
iast_HARDCODED_SECRET_DISABLED (516.12 µs) : 493, 539
.   : milestone, 516,
iast_INACTIVE (466.337 µs) : 444, 489
.   : milestone, 466,
iast_TELEMETRY_OFF (519.905 µs) : 496, 543
.   : milestone, 520,
tracing (459.946 µs) : 438, 482
.   : milestone, 460,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 375.518 µs [355.886 µs, 395.15 µs] -
iast 516.969 µs [494.295 µs, 539.643 µs] 141.45 µs (37.7%)
iast_FULL 738.282 µs [714.795 µs, 761.769 µs] 362.764 µs (96.6%)
iast_GLOBAL 577.663 µs [552.162 µs, 603.164 µs] 202.144 µs (53.8%)
iast_HARDCODED_SECRET_DISABLED 516.521 µs [493.531 µs, 539.51 µs] 141.002 µs (37.5%)
iast_INACTIVE 471.385 µs [449.063 µs, 493.707 µs] 95.867 µs (25.5%)
iast_TELEMETRY_OFF 514.418 µs [491.394 µs, 537.443 µs] 138.9 µs (37.0%)
tracing 464.855 µs [443.523 µs, 486.187 µs] 89.336 µs (23.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 381.641 µs [361.219 µs, 402.064 µs] -
iast 528.254 µs [506.179 µs, 550.328 µs] 146.612 µs (38.4%)
iast_FULL 737.481 µs [714.475 µs, 760.486 µs] 355.839 µs (93.2%)
iast_GLOBAL 576.287 µs [552.977 µs, 599.598 µs] 194.646 µs (51.0%)
iast_HARDCODED_SECRET_DISABLED 516.12 µs [492.955 µs, 539.285 µs] 134.479 µs (35.2%)
iast_INACTIVE 466.337 µs [443.699 µs, 488.976 µs] 84.696 µs (22.2%)
iast_TELEMETRY_OFF 519.905 µs [496.482 µs, 543.328 µs] 138.264 µs (36.2%)
tracing 459.946 µs [438.293 µs, 481.598 µs] 78.304 µs (20.5%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~25082217d6, baseline=1.49.0-SNAPSHOT~856a0d88ec
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.364 ms) : 1344, 1385
.   : milestone, 1364,
appsec (1.742 ms) : 1718, 1766
.   : milestone, 1742,
appsec_no_iast (1.743 ms) : 1719, 1768
.   : milestone, 1743,
code_origins (1.679 ms) : 1653, 1706
.   : milestone, 1679,
iast (1.525 ms) : 1500, 1551
.   : milestone, 1525,
profiling (1.509 ms) : 1485, 1533
.   : milestone, 1509,
tracing (1.51 ms) : 1486, 1535
.   : milestone, 1510,
section candidate
no_agent (1.369 ms) : 1350, 1389
.   : milestone, 1369,
appsec (1.733 ms) : 1709, 1757
.   : milestone, 1733,
appsec_no_iast (1.749 ms) : 1724, 1773
.   : milestone, 1749,
code_origins (1.68 ms) : 1653, 1707
.   : milestone, 1680,
iast (1.506 ms) : 1483, 1530
.   : milestone, 1506,
profiling (1.521 ms) : 1498, 1544
.   : milestone, 1521,
tracing (1.485 ms) : 1460, 1510
.   : milestone, 1485,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.364 ms [1.344 ms, 1.385 ms] -
appsec 1.742 ms [1.718 ms, 1.766 ms] 377.804 µs (27.7%)
appsec_no_iast 1.743 ms [1.719 ms, 1.768 ms] 378.964 µs (27.8%)
code_origins 1.679 ms [1.653 ms, 1.706 ms] 314.997 µs (23.1%)
iast 1.525 ms [1.5 ms, 1.551 ms] 160.916 µs (11.8%)
profiling 1.509 ms [1.485 ms, 1.533 ms] 144.915 µs (10.6%)
tracing 1.51 ms [1.486 ms, 1.535 ms] 146.182 µs (10.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.369 ms [1.35 ms, 1.389 ms] -
appsec 1.733 ms [1.709 ms, 1.757 ms] 363.732 µs (26.6%)
appsec_no_iast 1.749 ms [1.724 ms, 1.773 ms] 379.301 µs (27.7%)
code_origins 1.68 ms [1.653 ms, 1.707 ms] 310.808 µs (22.7%)
iast 1.506 ms [1.483 ms, 1.53 ms] 136.938 µs (10.0%)
profiling 1.521 ms [1.498 ms, 1.544 ms] 151.719 µs (11.1%)
tracing 1.485 ms [1.46 ms, 1.51 ms] 115.796 µs (8.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1745992139 1745571386
git_commit_sha 856a0d8 2508221
release_version 1.49.0-SNAPSHOT~856a0d88ec 1.49.0-SNAPSHOT~25082217d6
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1745995122 1745995122
ci_job_id 918179396 918179396
ci_pipeline_id 63699766 63699766
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vwqh7yyx-project-304-concurrent-3-v63puvkc 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vwqh7yyx-project-304-concurrent-3-v63puvkc 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~25082217d6, baseline=1.49.0-SNAPSHOT~856a0d88ec
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.385 ms) : 2338, 2433
.   : milestone, 2385,
iast (2.152 ms) : 2093, 2211
.   : milestone, 2152,
iast_GLOBAL (2.198 ms) : 2138, 2257
.   : milestone, 2198,
profiling (2.029 ms) : 1981, 2078
.   : milestone, 2029,
tracing (1.994 ms) : 1948, 2040
.   : milestone, 1994,
section candidate
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.374 ms) : 2327, 2421
.   : milestone, 2374,
iast (2.171 ms) : 2111, 2231
.   : milestone, 2171,
iast_GLOBAL (2.207 ms) : 2147, 2267
.   : milestone, 2207,
profiling (2.016 ms) : 1968, 2064
.   : milestone, 2016,
tracing (1.986 ms) : 1940, 2032
.   : milestone, 1986,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.385 ms [2.338 ms, 2.433 ms] 913.257 µs (62.0%)
iast 2.152 ms [2.093 ms, 2.211 ms] 679.921 µs (46.2%)
iast_GLOBAL 2.198 ms [2.138 ms, 2.257 ms] 725.432 µs (49.3%)
profiling 2.029 ms [1.981 ms, 2.078 ms] 557.154 µs (37.8%)
tracing 1.994 ms [1.948 ms, 2.04 ms] 522.062 µs (35.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 2.374 ms [2.327 ms, 2.421 ms] 897.999 µs (60.9%)
iast 2.171 ms [2.111 ms, 2.231 ms] 695.433 µs (47.1%)
iast_GLOBAL 2.207 ms [2.147 ms, 2.267 ms] 731.648 µs (49.6%)
profiling 2.016 ms [1.968 ms, 2.064 ms] 540.624 µs (36.6%)
tracing 1.986 ms [1.94 ms, 2.032 ms] 510.181 µs (34.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~25082217d6, baseline=1.49.0-SNAPSHOT~856a0d88ec
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.154 s) : 15154000, 15154000
.   : milestone, 15154000,
appsec (15.125 s) : 15125000, 15125000
.   : milestone, 15125000,
iast (18.606 s) : 18606000, 18606000
.   : milestone, 18606000,
iast_GLOBAL (17.972 s) : 17972000, 17972000
.   : milestone, 17972000,
profiling (15.051 s) : 15051000, 15051000
.   : milestone, 15051000,
tracing (15.099 s) : 15099000, 15099000
.   : milestone, 15099000,
section candidate
no_agent (15.482 s) : 15482000, 15482000
.   : milestone, 15482000,
appsec (15.22 s) : 15220000, 15220000
.   : milestone, 15220000,
iast (18.81 s) : 18810000, 18810000
.   : milestone, 18810000,
iast_GLOBAL (18.279 s) : 18279000, 18279000
.   : milestone, 18279000,
profiling (15.66 s) : 15660000, 15660000
.   : milestone, 15660000,
tracing (15.195 s) : 15195000, 15195000
.   : milestone, 15195000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.154 s [15.154 s, 15.154 s] -
appsec 15.125 s [15.125 s, 15.125 s] -29.0 ms (-0.2%)
iast 18.606 s [18.606 s, 18.606 s] 3.452 s (22.8%)
iast_GLOBAL 17.972 s [17.972 s, 17.972 s] 2.818 s (18.6%)
profiling 15.051 s [15.051 s, 15.051 s] -103.0 ms (-0.7%)
tracing 15.099 s [15.099 s, 15.099 s] -55.0 ms (-0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.482 s [15.482 s, 15.482 s] -
appsec 15.22 s [15.22 s, 15.22 s] -262.0 ms (-1.7%)
iast 18.81 s [18.81 s, 18.81 s] 3.328 s (21.5%)
iast_GLOBAL 18.279 s [18.279 s, 18.279 s] 2.797 s (18.1%)
profiling 15.66 s [15.66 s, 15.66 s] 178.0 ms (1.1%)
tracing 15.195 s [15.195 s, 15.195 s] -287.0 ms (-1.9%)

@PerfectSlayer PerfectSlayer force-pushed the bbujon/ci branch 2 times, most recently from 56bf282 to 2508221 Compare April 30, 2025 05:55
@PerfectSlayer PerfectSlayer merged commit 4b2b435 into master May 2, 2025
664 of 667 checks passed
@PerfectSlayer PerfectSlayer deleted the bbujon/ci branch May 2, 2025 08:25
@github-actions github-actions bot added this to the 1.49.0 milestone May 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@amarziali amarziali amarziali approved these changes

@manuel-alvarez-alvarez manuel-alvarez-alvarez Awaiting requested review from manuel-alvarez-alvarez manuel-alvarez-alvarez is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement
Projects
None yet
Milestone
1.49.0
Development

Successfully merging this pull request may close these issues.
2 participants
@PerfectSlayer @amarziali