Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Gradle dependencies #8642

Merged
merged 50 commits into from
Mar 31, 2025
Merged

Conversation

github-actions[bot]
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Mar 30, 2025
@github-actions github-actions bot requested review from a team as code owners March 30, 2025 04:24
@github-actions github-actions bot requested review from robertpi, jandro996, evanchooly, juan-fernandez and manuel-alvarez-alvarez and removed request for a team March 30, 2025 04:24
@pr-commenter
Copy link

pr-commenter bot commented Mar 30, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1743424006 1743424389
end_time 2025-03-31T12:28:04 2025-03-31T12:34:26
git_branch master ci/update-gradle-dependencies-20250330
git_commit_sha b187a03 460a087
start_time 2025-03-31T12:26:47 2025-03-31T12:33:09
See matching parameters
Baseline Candidate
ci_job_id 872216789 872216789
ci_pipeline_id 60498779 60498779
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1743422890 1743422890

Summary

Found 5 performance improvements and 0 performance regressions! Performance is the same for 1 metrics, 9 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop better
[-696.280µs; -632.501µs] or [-6.534%; -5.936%]
better
[-738.036µs; -654.010µs] or [-6.810%; -6.034%]
better
[-710.319µs; -564.603µs] or [-6.510%; -5.175%]
better
[-826.681µs; -462.469µs] or [-7.366%; -4.121%]
better
[+4.563op/s; +6.963op/s] or [+4.997%; +7.625%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-33.793µs; +82.231µs] or [-12.372%; +30.106%]
unstable
[-41.598µs; +94.674µs] or [-13.314%; +30.302%]
unstable
[-48.963µs; +110.090µs] or [-15.013%; +33.755%]
unstable
[-388.999µs; +1072.215µs] or [-65.050%; +179.300%]
unstable
[-132.514op/s; +132.514op/s] or [-5.168%; +5.168%]
scenario:basic same unstable
[-6.123µs; +26.894µs] or [-2.026%; +8.897%]
unstable
[-11.009µs; +42.571µs] or [-3.528%; +13.643%]
unstable
[-209.297µs; +668.298µs] or [-41.157%; +131.416%]
unstable
[-249.265op/s; +121.060op/s] or [-9.721%; +4.721%]
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (312.432 µs) : 280, 344
.   : milestone, 312,
basic (302.286 µs) : 294, 311
.   : milestone, 302,
loop (10.838 ms) : 10801, 10876
.   : milestone, 10838,
section candidate
noprobe (338.97 µs) : 253, 425
.   : milestone, 339,
basic (312.672 µs) : 291, 334
.   : milestone, 313,
loop (10.142 ms) : 10102, 10183
.   : milestone, 10142,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 312.432 µs [280.381 µs, 344.483 µs]
basic 302.286 µs [293.856 µs, 310.716 µs]
loop 10.838 ms [10.801 ms, 10.876 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 338.97 µs [252.928 µs, 425.013 µs]
basic 312.672 µs [291.474 µs, 333.87 µs]
loop 10.142 ms [10.102 ms, 10.183 ms]

@pr-commenter
Copy link

pr-commenter bot commented Mar 30, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250330
git_commit_date 1743177610 1743308660
git_commit_sha 2a848ef b238c6c
release_version 1.48.0-SNAPSHOT~2a848ef2e2 1.48.0-SNAPSHOT~b238c6cec4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743311898 1743311898
ci_job_id 871530130 871530130
ci_pipeline_id 60445573 60445573
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-9xmy4xzs-project-304-concurrent-4-2ss2wijs 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-9xmy4xzs-project-304-concurrent-4-2ss2wijs 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 66 metrics, 5 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~b238c6cec4, baseline=1.48.0-SNAPSHOT~2a848ef2e2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051235
Total [baseline] (10.442 s) : 0, 10441710
Agent [candidate] (1.066 s) : 0, 1065901
Total [candidate] (10.495 s) : 0, 10494548
section appsec
Agent [baseline] (1.193 s) : 0, 1193160
Total [baseline] (10.857 s) : 0, 10857321
Agent [candidate] (1.192 s) : 0, 1192365
Total [candidate] (10.757 s) : 0, 10757441
section iast
Agent [baseline] (1.18 s) : 0, 1179959
Total [baseline] (11.085 s) : 0, 11084686
Agent [candidate] (1.18 s) : 0, 1179812
Total [candidate] (11.06 s) : 0, 11059890
section profiling
Agent [baseline] (1.283 s) : 0, 1282699
Total [baseline] (10.906 s) : 0, 10906380
Agent [candidate] (1.275 s) : 0, 1274579
Total [candidate] (10.884 s) : 0, 10884077
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent appsec 1.193 s 141.925 ms (13.5%)
Agent iast 1.18 s 128.723 ms (12.2%)
Agent profiling 1.283 s 231.463 ms (22.0%)
Total tracing 10.442 s -
Total appsec 10.857 s 415.611 ms (4.0%)
Total iast 11.085 s 642.976 ms (6.2%)
Total profiling 10.906 s 464.669 ms (4.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.192 s 126.464 ms (11.9%)
Agent iast 1.18 s 113.911 ms (10.7%)
Agent profiling 1.275 s 208.678 ms (19.6%)
Total tracing 10.495 s -
Total appsec 10.757 s 262.893 ms (2.5%)
Total iast 11.06 s 565.342 ms (5.4%)
Total profiling 10.884 s 389.529 ms (3.7%)
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~b238c6cec4, baseline=1.48.0-SNAPSHOT~2a848ef2e2

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.961 ms) : 0, 717961
BytebuddyAgent [candidate] (728.341 ms) : 0, 728341
GlobalTracer [baseline] (238.687 ms) : 0, 238687
GlobalTracer [candidate] (242.064 ms) : 0, 242064
AppSec [baseline] (54.475 ms) : 0, 54475
AppSec [candidate] (55.036 ms) : 0, 55036
Debugger [baseline] (5.182 ms) : 0, 5182
Debugger [candidate] (5.202 ms) : 0, 5202
Remote Config [baseline] (694.408 µs) : 0, 694
Remote Config [candidate] (698.06 µs) : 0, 698
Telemetry [baseline] (13.605 ms) : 0, 13605
Telemetry [candidate] (13.664 ms) : 0, 13664
section appsec
BytebuddyAgent [baseline] (736.727 ms) : 0, 736727
BytebuddyAgent [candidate] (735.991 ms) : 0, 735991
GlobalTracer [baseline] (235.135 ms) : 0, 235135
GlobalTracer [candidate] (235.172 ms) : 0, 235172
AppSec [baseline] (176.391 ms) : 0, 176391
AppSec [candidate] (176.676 ms) : 0, 176676
Debugger [baseline] (4.262 ms) : 0, 4262
Debugger [candidate] (4.283 ms) : 0, 4283
Remote Config [baseline] (655.35 µs) : 0, 655
Remote Config [candidate] (654.145 µs) : 0, 654
Telemetry [baseline] (8.509 ms) : 0, 8509
Telemetry [candidate] (8.181 ms) : 0, 8181
IAST [baseline] (21.877 ms) : 0, 21877
IAST [candidate] (21.659 ms) : 0, 21659
section iast
BytebuddyAgent [baseline] (838.426 ms) : 0, 838426
BytebuddyAgent [candidate] (837.629 ms) : 0, 837629
GlobalTracer [baseline] (229.342 ms) : 0, 229342
GlobalTracer [candidate] (229.297 ms) : 0, 229297
AppSec [baseline] (54.824 ms) : 0, 54824
AppSec [candidate] (55.691 ms) : 0, 55691
Debugger [baseline] (4.176 ms) : 0, 4176
Debugger [candidate] (4.215 ms) : 0, 4215
Remote Config [baseline] (601.294 µs) : 0, 601
Remote Config [candidate] (634.545 µs) : 0, 635
Telemetry [baseline] (8.804 ms) : 0, 8804
Telemetry [candidate] (8.904 ms) : 0, 8904
IAST [baseline] (22.648 ms) : 0, 22648
IAST [candidate] (22.891 ms) : 0, 22891
section profiling
BytebuddyAgent [baseline] (714.688 ms) : 0, 714688
BytebuddyAgent [candidate] (709.316 ms) : 0, 709316
GlobalTracer [baseline] (349.912 ms) : 0, 349912
GlobalTracer [candidate] (348.771 ms) : 0, 348771
AppSec [baseline] (54.52 ms) : 0, 54520
AppSec [candidate] (53.614 ms) : 0, 53614
Debugger [baseline] (4.317 ms) : 0, 4317
Debugger [candidate] (4.312 ms) : 0, 4312
Remote Config [baseline] (692.732 µs) : 0, 693
Remote Config [candidate] (702.25 µs) : 0, 702
Telemetry [baseline] (9.013 ms) : 0, 9013
Telemetry [candidate] (9.014 ms) : 0, 9014
ProfilingAgent [baseline] (103.449 ms) : 0, 103449
ProfilingAgent [candidate] (103.126 ms) : 0, 103126
Profiling [baseline] (103.474 ms) : 0, 103474
Profiling [candidate] (103.152 ms) : 0, 103152
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~b238c6cec4, baseline=1.48.0-SNAPSHOT~2a848ef2e2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1048922
Total [baseline] (8.689 s) : 0, 8688577
Agent [candidate] (1.051 s) : 0, 1050908
Total [candidate] (8.652 s) : 0, 8651598
section iast
Agent [baseline] (1.174 s) : 0, 1173792
Total [baseline] (9.212 s) : 0, 9212195
Agent [candidate] (1.186 s) : 0, 1185975
Total [candidate] (9.245 s) : 0, 9244992
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.175 s) : 0, 1175303
Total [baseline] (9.22 s) : 0, 9220005
Agent [candidate] (1.187 s) : 0, 1187101
Total [candidate] (9.235 s) : 0, 9234933
section iast_TELEMETRY_OFF
Agent [baseline] (1.173 s) : 0, 1173002
Total [baseline] (9.232 s) : 0, 9232340
Agent [candidate] (1.183 s) : 0, 1182948
Total [candidate] (9.291 s) : 0, 9290622
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.174 s 124.87 ms (11.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.175 s 126.381 ms (12.0%)
Agent iast_TELEMETRY_OFF 1.173 s 124.08 ms (11.8%)
Total tracing 8.689 s -
Total iast 9.212 s 523.617 ms (6.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.22 s 531.427 ms (6.1%)
Total iast_TELEMETRY_OFF 9.232 s 543.763 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent iast 1.186 s 135.067 ms (12.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.187 s 136.193 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.183 s 132.041 ms (12.6%)
Total tracing 8.652 s -
Total iast 9.245 s 593.394 ms (6.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.235 s 583.336 ms (6.7%)
Total iast_TELEMETRY_OFF 9.291 s 639.024 ms (7.4%)
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~b238c6cec4, baseline=1.48.0-SNAPSHOT~2a848ef2e2

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.727 ms) : 0, 716727
BytebuddyAgent [candidate] (717.568 ms) : 0, 717568
GlobalTracer [baseline] (238.355 ms) : 0, 238355
GlobalTracer [candidate] (238.377 ms) : 0, 238377
AppSec [baseline] (55.239 ms) : 0, 55239
AppSec [candidate] (55.116 ms) : 0, 55116
Debugger [baseline] (4.5 ms) : 0, 4500
Debugger [candidate] (4.482 ms) : 0, 4482
Remote Config [baseline] (687.675 µs) : 0, 688
Remote Config [candidate] (690.549 µs) : 0, 691
Telemetry [baseline] (12.723 ms) : 0, 12723
Telemetry [candidate] (14.072 ms) : 0, 14072
section iast
BytebuddyAgent [baseline] (833.717 ms) : 0, 833717
BytebuddyAgent [candidate] (842.652 ms) : 0, 842652
GlobalTracer [baseline] (227.83 ms) : 0, 227830
GlobalTracer [candidate] (229.68 ms) : 0, 229680
AppSec [baseline] (55.497 ms) : 0, 55497
AppSec [candidate] (55.644 ms) : 0, 55644
Debugger [baseline] (4.161 ms) : 0, 4161
Debugger [candidate] (4.257 ms) : 0, 4257
Remote Config [baseline] (618.26 µs) : 0, 618
Remote Config [candidate] (615.969 µs) : 0, 616
Telemetry [baseline] (8.797 ms) : 0, 8797
Telemetry [candidate] (8.931 ms) : 0, 8931
IAST [baseline] (22.778 ms) : 0, 22778
IAST [candidate] (23.715 ms) : 0, 23715
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (834.025 ms) : 0, 834025
BytebuddyAgent [candidate] (842.753 ms) : 0, 842753
GlobalTracer [baseline] (228.562 ms) : 0, 228562
GlobalTracer [candidate] (230.355 ms) : 0, 230355
AppSec [baseline] (55.81 ms) : 0, 55810
AppSec [candidate] (56.463 ms) : 0, 56463
Debugger [baseline] (4.19 ms) : 0, 4190
Debugger [candidate] (4.235 ms) : 0, 4235
Remote Config [baseline] (613.698 µs) : 0, 614
Remote Config [candidate] (617.394 µs) : 0, 617
Telemetry [baseline] (8.794 ms) : 0, 8794
Telemetry [candidate] (8.968 ms) : 0, 8968
IAST [baseline] (22.946 ms) : 0, 22946
IAST [candidate] (23.163 ms) : 0, 23163
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (832.983 ms) : 0, 832983
BytebuddyAgent [candidate] (840.06 ms) : 0, 840060
GlobalTracer [baseline] (228.425 ms) : 0, 228425
GlobalTracer [candidate] (230.179 ms) : 0, 230179
AppSec [baseline] (55.341 ms) : 0, 55341
AppSec [candidate] (55.915 ms) : 0, 55915
Debugger [baseline] (4.146 ms) : 0, 4146
Debugger [candidate] (4.21 ms) : 0, 4210
Remote Config [baseline] (615.135 µs) : 0, 615
Remote Config [candidate] (617.586 µs) : 0, 618
Telemetry [baseline] (8.684 ms) : 0, 8684
Telemetry [candidate] (8.763 ms) : 0, 8763
IAST [baseline] (22.373 ms) : 0, 22373
IAST [candidate] (22.635 ms) : 0, 22635
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-30T04:47:45 2025-03-30T04:55:29
git_branch master ci/update-gradle-dependencies-20250330
git_commit_date 1743177610 1743308660
git_commit_sha 2a848ef b238c6c
release_version 1.48.0-SNAPSHOT~2a848ef2e2 1.48.0-SNAPSHOT~b238c6cec4
start_time 2025-03-30T04:47:31 2025-03-30T04:55:15
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743310927 1743310927
ci_job_id 871530131 871530131
ci_pipeline_id 60445573 60445573
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vapngg-f-project-304-concurrent-5-jwnmkocy 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vapngg-f-project-304-concurrent-5-jwnmkocy 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~b238c6cec4, baseline=1.48.0-SNAPSHOT~2a848ef2e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.368 ms) : 1349, 1388
.   : milestone, 1368,
appsec (1.727 ms) : 1703, 1751
.   : milestone, 1727,
appsec_no_iast (1.709 ms) : 1684, 1734
.   : milestone, 1709,
code_origins (1.68 ms) : 1653, 1707
.   : milestone, 1680,
iast (1.533 ms) : 1509, 1556
.   : milestone, 1533,
profiling (1.493 ms) : 1470, 1517
.   : milestone, 1493,
tracing (1.517 ms) : 1492, 1543
.   : milestone, 1517,
section candidate
no_agent (1.364 ms) : 1344, 1383
.   : milestone, 1364,
appsec (1.723 ms) : 1700, 1747
.   : milestone, 1723,
appsec_no_iast (1.751 ms) : 1728, 1774
.   : milestone, 1751,
code_origins (1.717 ms) : 1690, 1743
.   : milestone, 1717,
iast (1.535 ms) : 1511, 1559
.   : milestone, 1535,
profiling (1.503 ms) : 1479, 1527
.   : milestone, 1503,
tracing (1.503 ms) : 1477, 1528
.   : milestone, 1503,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.368 ms [1.349 ms, 1.388 ms] -
appsec 1.727 ms [1.703 ms, 1.751 ms] 358.262 µs (26.2%)
appsec_no_iast 1.709 ms [1.684 ms, 1.734 ms] 340.347 µs (24.9%)
code_origins 1.68 ms [1.653 ms, 1.707 ms] 311.889 µs (22.8%)
iast 1.533 ms [1.509 ms, 1.556 ms] 164.485 µs (12.0%)
profiling 1.493 ms [1.47 ms, 1.517 ms] 124.928 µs (9.1%)
tracing 1.517 ms [1.492 ms, 1.543 ms] 148.962 µs (10.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.364 ms [1.344 ms, 1.383 ms] -
appsec 1.723 ms [1.7 ms, 1.747 ms] 359.728 µs (26.4%)
appsec_no_iast 1.751 ms [1.728 ms, 1.774 ms] 387.357 µs (28.4%)
code_origins 1.717 ms [1.69 ms, 1.743 ms] 353.185 µs (25.9%)
iast 1.535 ms [1.511 ms, 1.559 ms] 171.122 µs (12.5%)
profiling 1.503 ms [1.479 ms, 1.527 ms] 139.615 µs (10.2%)
tracing 1.503 ms [1.477 ms, 1.528 ms] 138.917 µs (10.2%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~b238c6cec4, baseline=1.48.0-SNAPSHOT~2a848ef2e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (385.526 µs) : 364, 407
.   : milestone, 386,
iast (511.044 µs) : 489, 533
.   : milestone, 511,
iast_FULL (736.65 µs) : 715, 759
.   : milestone, 737,
iast_GLOBAL (558.928 µs) : 537, 581
.   : milestone, 559,
iast_HARDCODED_SECRET_DISABLED (516.02 µs) : 494, 538
.   : milestone, 516,
iast_INACTIVE (465.945 µs) : 444, 488
.   : milestone, 466,
iast_TELEMETRY_OFF (505.398 µs) : 483, 527
.   : milestone, 505,
tracing (463.999 µs) : 443, 485
.   : milestone, 464,
section candidate
no_agent (382.613 µs) : 363, 403
.   : milestone, 383,
iast (512.721 µs) : 491, 535
.   : milestone, 513,
iast_FULL (732.261 µs) : 710, 754
.   : milestone, 732,
iast_GLOBAL (559.603 µs) : 537, 582
.   : milestone, 560,
iast_HARDCODED_SECRET_DISABLED (510.79 µs) : 489, 533
.   : milestone, 511,
iast_INACTIVE (469.51 µs) : 448, 491
.   : milestone, 470,
iast_TELEMETRY_OFF (496.322 µs) : 475, 518
.   : milestone, 496,
tracing (455.865 µs) : 435, 477
.   : milestone, 456,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 385.526 µs [364.255 µs, 406.796 µs] -
iast 511.044 µs [489.288 µs, 532.799 µs] 125.518 µs (32.6%)
iast_FULL 736.65 µs [714.692 µs, 758.608 µs] 351.124 µs (91.1%)
iast_GLOBAL 558.928 µs [537.099 µs, 580.757 µs] 173.402 µs (45.0%)
iast_HARDCODED_SECRET_DISABLED 516.02 µs [494.0 µs, 538.04 µs] 130.494 µs (33.8%)
iast_INACTIVE 465.945 µs [444.389 µs, 487.501 µs] 80.419 µs (20.9%)
iast_TELEMETRY_OFF 505.398 µs [483.455 µs, 527.341 µs] 119.872 µs (31.1%)
tracing 463.999 µs [442.653 µs, 485.345 µs] 78.473 µs (20.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 382.613 µs [362.585 µs, 402.64 µs] -
iast 512.721 µs [490.843 µs, 534.599 µs] 130.108 µs (34.0%)
iast_FULL 732.261 µs [710.264 µs, 754.258 µs] 349.648 µs (91.4%)
iast_GLOBAL 559.603 µs [537.266 µs, 581.94 µs] 176.99 µs (46.3%)
iast_HARDCODED_SECRET_DISABLED 510.79 µs [488.798 µs, 532.782 µs] 128.177 µs (33.5%)
iast_INACTIVE 469.51 µs [447.944 µs, 491.076 µs] 86.897 µs (22.7%)
iast_TELEMETRY_OFF 496.322 µs [474.746 µs, 517.898 µs] 113.709 µs (29.7%)
tracing 455.865 µs [434.855 µs, 476.875 µs] 73.252 µs (19.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250330
git_commit_date 1743177610 1743308660
git_commit_sha 2a848ef b238c6c
release_version 1.48.0-SNAPSHOT~2a848ef2e2 1.48.0-SNAPSHOT~b238c6cec4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1743311385 1743311385
ci_job_id 871530132 871530132
ci_pipeline_id 60445573 60445573
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vapngg-f-project-304-concurrent-6-ihwqsv36 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vapngg-f-project-304-concurrent-6-ihwqsv36 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~b238c6cec4, baseline=1.48.0-SNAPSHOT~2a848ef2e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.104 s) : 15104000, 15104000
.   : milestone, 15104000,
appsec (15.236 s) : 15236000, 15236000
.   : milestone, 15236000,
iast (18.484 s) : 18484000, 18484000
.   : milestone, 18484000,
iast_GLOBAL (17.858 s) : 17858000, 17858000
.   : milestone, 17858000,
profiling (15.077 s) : 15077000, 15077000
.   : milestone, 15077000,
tracing (15.091 s) : 15091000, 15091000
.   : milestone, 15091000,
section candidate
no_agent (15.289 s) : 15289000, 15289000
.   : milestone, 15289000,
appsec (15.026 s) : 15026000, 15026000
.   : milestone, 15026000,
iast (18.659 s) : 18659000, 18659000
.   : milestone, 18659000,
iast_GLOBAL (17.928 s) : 17928000, 17928000
.   : milestone, 17928000,
profiling (15.078 s) : 15078000, 15078000
.   : milestone, 15078000,
tracing (15.306 s) : 15306000, 15306000
.   : milestone, 15306000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.104 s [15.104 s, 15.104 s] -
appsec 15.236 s [15.236 s, 15.236 s] 132.0 ms (0.9%)
iast 18.484 s [18.484 s, 18.484 s] 3.38 s (22.4%)
iast_GLOBAL 17.858 s [17.858 s, 17.858 s] 2.754 s (18.2%)
profiling 15.077 s [15.077 s, 15.077 s] -27.0 ms (-0.2%)
tracing 15.091 s [15.091 s, 15.091 s] -13.0 ms (-0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.289 s [15.289 s, 15.289 s] -
appsec 15.026 s [15.026 s, 15.026 s] -263.0 ms (-1.7%)
iast 18.659 s [18.659 s, 18.659 s] 3.37 s (22.0%)
iast_GLOBAL 17.928 s [17.928 s, 17.928 s] 2.639 s (17.3%)
profiling 15.078 s [15.078 s, 15.078 s] -211.0 ms (-1.4%)
tracing 15.306 s [15.306 s, 15.306 s] 17.0 ms (0.1%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~b238c6cec4, baseline=1.48.0-SNAPSHOT~2a848ef2e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (2.366 ms) : 2322, 2410
.   : milestone, 2366,
iast (2.128 ms) : 2072, 2184
.   : milestone, 2128,
iast_GLOBAL (2.176 ms) : 2120, 2233
.   : milestone, 2176,
profiling (1.987 ms) : 1942, 2033
.   : milestone, 1987,
tracing (1.967 ms) : 1924, 2010
.   : milestone, 1967,
section candidate
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (2.35 ms) : 2306, 2394
.   : milestone, 2350,
iast (2.141 ms) : 2085, 2198
.   : milestone, 2141,
iast_GLOBAL (2.161 ms) : 2105, 2217
.   : milestone, 2161,
profiling (1.987 ms) : 1943, 2032
.   : milestone, 1987,
tracing (1.963 ms) : 1920, 2006
.   : milestone, 1963,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 2.366 ms [2.322 ms, 2.41 ms] 887.989 µs (60.1%)
iast 2.128 ms [2.072 ms, 2.184 ms] 650.192 µs (44.0%)
iast_GLOBAL 2.176 ms [2.12 ms, 2.233 ms] 698.588 µs (47.3%)
profiling 1.987 ms [1.942 ms, 2.033 ms] 509.568 µs (34.5%)
tracing 1.967 ms [1.924 ms, 2.01 ms] 489.27 µs (33.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.466 ms, 1.489 ms] -
appsec 2.35 ms [2.306 ms, 2.394 ms] 872.645 µs (59.1%)
iast 2.141 ms [2.085 ms, 2.198 ms] 663.813 µs (44.9%)
iast_GLOBAL 2.161 ms [2.105 ms, 2.217 ms] 683.526 µs (46.3%)
profiling 1.987 ms [1.943 ms, 2.032 ms] 509.902 µs (34.5%)
tracing 1.963 ms [1.92 ms, 2.006 ms] 485.695 µs (32.9%)

@pr-commenter
Copy link

pr-commenter bot commented Mar 30, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250330
git_commit_date 1743422783 1743422890
git_commit_sha b187a03 460a087
See matching parameters
Baseline Candidate
ci_job_date 1743424495 1743424495
ci_job_id 872216787 872216787
ci_pipeline_id 60498779 60498779
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Mar 30, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250330
git_commit_date 1743177610 1743308654
git_commit_sha 2a848ef e11ccc3
See matching parameters
Baseline Candidate
ci_job_date 1743310583 1743310583
ci_job_id 871529789 871529789
ci_pipeline_id 60445567 60445567
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@amarziali amarziali merged commit 32ca4c6 into master Mar 31, 2025
242 of 256 checks passed
@amarziali amarziali deleted the ci/update-gradle-dependencies-20250330 branch March 31, 2025 12:53
@github-actions github-actions bot added this to the 1.48.0 milestone Mar 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant