Skip to content

Fix Symbol extraction tests and Jacoco #10485

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
jpbempel merged 1 commit into from
Jan 30, 2026
Merged

Fix Symbol extraction tests and Jacoco #10485

jpbempel merged 1 commit into from
Jan 30, 2026

Conversation

@jpbempel
Copy link
Member

@jpbempel jpbempel commented Jan 30, 2026

What Does This Do

Jacoco can inject synthetic field or methods inside classes for SymDB symbol extraction those injected symbols can make the tests non-consistent (IDE or gradle run)
we are excluding those dynamically compiled classes from Jacoco coverage

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@jpbempel
Fix Symbol extraction tests and Jacoco
749076a 
Jacoco can inject synthetic field or methods inside classes
for SymDB symbol extraction those injected symbols can make the tests
non-consistent (IDE or gradle run)
we are excluding those dynamically compiled classes from Jacoco
coverage
@jpbempel jpbempel requested a review from a team as a code owner January 30, 2026 13:53
@jpbempel jpbempel requested review from evanchooly and removed request for a team January 30, 2026 13:53
@jpbempel jpbempel added the comp: debugger Dynamic Instrumentation label Jan 30, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Jan 30, 2026

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@jpbempel jpbempel added tag: no release notes Changes to exclude from release notes type: bug Bug report and fix comp: testing Testing labels Jan 30, 2026
@pr-commenter
Copy link

pr-commenter bot commented Jan 30, 2026

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1769782494 1769782840
end_time 2026-01-30T14:16:15 2026-01-30T14:22:00
git_branch master jpbempel/fix-jacoco
git_commit_sha 45e7904 749076a
start_time 2026-01-30T14:14:55 2026-01-30T14:20:41
See matching parameters
Baseline Candidate
ci_job_id 1389996534 1389996534
ci_pipeline_id 93817800 93817800
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1769781186 1769781186

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-45.294µs; +23.417µs] or [-15.822%; +8.180%]		 unstable
[-63.602µs; +34.682µs] or [-19.141%; +10.437%]		 unstable
[-76.183µs; +42.828µs] or [-21.879%; +12.300%]		 unstable
[-229.040µs; +174.780µs] or [-23.509%; +17.940%]		 same
scenario:basic same same same unstable
[-45.450µs; +91.910µs] or [-6.372%; +12.886%]		 unstable
[-78.672op/s; +220.920op/s] or [-2.990%; +8.395%]
scenario:loop unsure
[+0.415µs; +7.233µs] or [+0.005%; +0.082%]		 same same same same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (332.283 µs) : 274, 391
.   : milestone, 332,
basic (280.736 µs) : 274, 288
.   : milestone, 281,
loop (8.952 ms) : 8945, 8958
.   : milestone, 8952,
section candidate
noprobe (317.823 µs) : 287, 349
.   : milestone, 318,
basic (276.573 µs) : 270, 283
.   : milestone, 277,
loop (8.952 ms) : 8946, 8958
.   : milestone, 8952,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 332.283 µs [273.756 µs, 390.811 µs]
basic 280.736 µs [273.7 µs, 287.773 µs]
loop 8.952 ms [8.945 ms, 8.958 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 317.823 µs [286.967 µs, 348.68 µs]
basic 276.573 µs [269.853 µs, 283.294 µs]
loop 8.952 ms [8.946 ms, 8.958 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jan 30, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-jacoco
git_commit_date 1769704474 1769781186
git_commit_sha 02cc483 749076a
release_version 1.59.0-SNAPSHOT~02cc48359b 1.59.0-SNAPSHOT~749076a976
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769783764 1769783764
ci_job_id 1389996527 1389996527
ci_pipeline_id 93817800 93817800
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-xlsrjbbh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-xlsrjbbh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~749076a976, baseline=1.59.0-SNAPSHOT~02cc48359b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1061219
Total [baseline] (8.716 s) : 0, 8715670
Agent [candidate] (1.059 s) : 0, 1059136
Total [candidate] (8.706 s) : 0, 8705954
section iast
Agent [baseline] (1.231 s) : 0, 1231355
Total [baseline] (9.401 s) : 0, 9400890
Agent [candidate] (1.225 s) : 0, 1224640
Total [candidate] (9.367 s) : 0, 9367178
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.231 s 170.135 ms (16.0%)
Total tracing 8.716 s -
Total iast 9.401 s 685.219 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.225 s 165.504 ms (15.6%)
Total tracing 8.706 s -
Total iast 9.367 s 661.224 ms (7.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~749076a976, baseline=1.59.0-SNAPSHOT~02cc48359b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (623.409 ms) : 0, 623409
BytebuddyAgent [candidate] (623.084 ms) : 0, 623084
AgentMeter [baseline] (28.979 ms) : 0, 28979
AgentMeter [candidate] (28.752 ms) : 0, 28752
GlobalTracer [baseline] (258.631 ms) : 0, 258631
GlobalTracer [candidate] (257.554 ms) : 0, 257554
AppSec [baseline] (33.018 ms) : 0, 33018
AppSec [candidate] (32.606 ms) : 0, 32606
Debugger [baseline] (59.759 ms) : 0, 59759
Debugger [candidate] (60.852 ms) : 0, 60852
Remote Config [baseline] (620.093 µs) : 0, 620
Remote Config [candidate] (605.062 µs) : 0, 605
Telemetry [baseline] (10.052 ms) : 0, 10052
Telemetry [candidate] (9.797 ms) : 0, 9797
Flare Poller [baseline] (10.057 ms) : 0, 10057
Flare Poller [candidate] (9.162 ms) : 0, 9162
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (794.358 ms) : 0, 794358
BytebuddyAgent [candidate] (789.805 ms) : 0, 789805
AgentMeter [baseline] (11.208 ms) : 0, 11208
AgentMeter [candidate] (11.195 ms) : 0, 11195
GlobalTracer [baseline] (248.379 ms) : 0, 248379
GlobalTracer [candidate] (248.101 ms) : 0, 248101
AppSec [baseline] (33.29 ms) : 0, 33290
AppSec [candidate] (31.234 ms) : 0, 31234
Debugger [baseline] (67.457 ms) : 0, 67457
Debugger [candidate] (68.403 ms) : 0, 68403
Remote Config [baseline] (554.258 µs) : 0, 554
Remote Config [candidate] (539.336 µs) : 0, 539
Telemetry [baseline] (8.822 ms) : 0, 8822
Telemetry [candidate] (8.511 ms) : 0, 8511
Flare Poller [baseline] (3.548 ms) : 0, 3548
Flare Poller [candidate] (3.47 ms) : 0, 3470
IAST [baseline] (26.894 ms) : 0, 26894
IAST [candidate] (26.715 ms) : 0, 26715
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~749076a976, baseline=1.59.0-SNAPSHOT~02cc48359b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1070446
Total [baseline] (11.027 s) : 0, 11026761
Agent [candidate] (1.059 s) : 0, 1059129
Total [candidate] (10.917 s) : 0, 10917063
section appsec
Agent [baseline] (1.232 s) : 0, 1232124
Total [baseline] (11.158 s) : 0, 11157754
Agent [candidate] (1.236 s) : 0, 1236406
Total [candidate] (11.036 s) : 0, 11036237
section iast
Agent [baseline] (1.226 s) : 0, 1226183
Total [baseline] (11.138 s) : 0, 11138359
Agent [candidate] (1.23 s) : 0, 1230378
Total [candidate] (11.236 s) : 0, 11235988
section profiling
Agent [baseline] (1.186 s) : 0, 1186003
Total [baseline] (10.9 s) : 0, 10899509
Agent [candidate] (1.188 s) : 0, 1187883
Total [candidate] (11.008 s) : 0, 11008383
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent appsec 1.232 s 161.678 ms (15.1%)
Agent iast 1.226 s 155.737 ms (14.5%)
Agent profiling 1.186 s 115.557 ms (10.8%)
Total tracing 11.027 s -
Total appsec 11.158 s 130.994 ms (1.2%)
Total iast 11.138 s 111.598 ms (1.0%)
Total profiling 10.9 s -127.251 ms (-1.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.236 s 177.277 ms (16.7%)
Agent iast 1.23 s 171.249 ms (16.2%)
Agent profiling 1.188 s 128.754 ms (12.2%)
Total tracing 10.917 s -
Total appsec 11.036 s 119.174 ms (1.1%)
Total iast 11.236 s 318.925 ms (2.9%)
Total profiling 11.008 s 91.32 ms (0.8%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~749076a976, baseline=1.59.0-SNAPSHOT~02cc48359b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (627.781 ms) : 0, 627781
BytebuddyAgent [candidate] (622.732 ms) : 0, 622732
AgentMeter [baseline] (29.183 ms) : 0, 29183
AgentMeter [candidate] (28.682 ms) : 0, 28682
GlobalTracer [baseline] (260.248 ms) : 0, 260248
GlobalTracer [candidate] (256.641 ms) : 0, 256641
AppSec [baseline] (33.395 ms) : 0, 33395
AppSec [candidate] (32.86 ms) : 0, 32860
Debugger [baseline] (63.606 ms) : 0, 63606
Debugger [candidate] (64.215 ms) : 0, 64215
Remote Config [baseline] (616.449 µs) : 0, 616
Remote Config [candidate] (610.224 µs) : 0, 610
Telemetry [baseline] (12.421 ms) : 0, 12421
Telemetry [candidate] (11.462 ms) : 0, 11462
Flare Poller [baseline] (6.216 ms) : 0, 6216
Flare Poller [candidate] (5.275 ms) : 0, 5275
section appsec
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (650.913 ms) : 0, 650913
BytebuddyAgent [candidate] (654.385 ms) : 0, 654385
AgentMeter [baseline] (11.795 ms) : 0, 11795
AgentMeter [candidate] (11.819 ms) : 0, 11819
GlobalTracer [baseline] (257.374 ms) : 0, 257374
GlobalTracer [candidate] (258.824 ms) : 0, 258824
AppSec [baseline] (168.075 ms) : 0, 168075
AppSec [candidate] (167.867 ms) : 0, 167867
Debugger [baseline] (68.325 ms) : 0, 68325
Debugger [candidate] (67.52 ms) : 0, 67520
Remote Config [baseline] (660.142 µs) : 0, 660
Remote Config [candidate] (663.762 µs) : 0, 664
Telemetry [baseline] (9.286 ms) : 0, 9286
Telemetry [candidate] (9.303 ms) : 0, 9303
Flare Poller [baseline] (3.688 ms) : 0, 3688
Flare Poller [candidate] (3.682 ms) : 0, 3682
IAST [baseline] (25.468 ms) : 0, 25468
IAST [candidate] (25.72 ms) : 0, 25720
section iast
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (789.402 ms) : 0, 789402
BytebuddyAgent [candidate] (792.904 ms) : 0, 792904
AgentMeter [baseline] (11.232 ms) : 0, 11232
AgentMeter [candidate] (11.247 ms) : 0, 11247
GlobalTracer [baseline] (248.021 ms) : 0, 248021
GlobalTracer [candidate] (249.389 ms) : 0, 249389
AppSec [baseline] (32.355 ms) : 0, 32355
AppSec [candidate] (35.65 ms) : 0, 35650
Debugger [baseline] (68.98 ms) : 0, 68980
Debugger [candidate] (64.898 ms) : 0, 64898
Remote Config [baseline] (609.872 µs) : 0, 610
Remote Config [candidate] (544.113 µs) : 0, 544
Telemetry [baseline] (8.603 ms) : 0, 8603
Telemetry [candidate] (8.569 ms) : 0, 8569
Flare Poller [baseline] (3.472 ms) : 0, 3472
Flare Poller [candidate] (3.478 ms) : 0, 3478
IAST [baseline] (26.838 ms) : 0, 26838
IAST [candidate] (26.872 ms) : 0, 26872
section profiling
ProfilingAgent [baseline] (99.175 ms) : 0, 99175
ProfilingAgent [candidate] (98.602 ms) : 0, 98602
crashtracking [baseline] (1.226 ms) : 0, 1226
crashtracking [candidate] (1.221 ms) : 0, 1221
BytebuddyAgent [baseline] (676.71 ms) : 0, 676710
BytebuddyAgent [candidate] (679.407 ms) : 0, 679407
AgentMeter [baseline] (8.664 ms) : 0, 8664
AgentMeter [candidate] (8.664 ms) : 0, 8664
GlobalTracer [baseline] (217.263 ms) : 0, 217263
GlobalTracer [candidate] (217.289 ms) : 0, 217289
AppSec [baseline] (32.063 ms) : 0, 32063
AppSec [candidate] (32.11 ms) : 0, 32110
Debugger [baseline] (67.789 ms) : 0, 67789
Debugger [candidate] (67.512 ms) : 0, 67512
Remote Config [baseline] (594.919 µs) : 0, 595
Remote Config [candidate] (591.043 µs) : 0, 591
Telemetry [baseline] (8.72 ms) : 0, 8720
Telemetry [candidate] (8.677 ms) : 0, 8677
Flare Poller [baseline] (3.782 ms) : 0, 3782
Flare Poller [candidate] (3.775 ms) : 0, 3775
Profiling [baseline] (99.77 ms) : 0, 99770
Profiling [candidate] (99.162 ms) : 0, 99162
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-jacoco
git_commit_date 1769704474 1769781186
git_commit_sha 02cc483 749076a
release_version 1.59.0-SNAPSHOT~02cc48359b 1.59.0-SNAPSHOT~749076a976
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769784257 1769784257
ci_job_id 1389996528 1389996528
ci_pipeline_id 93817800 93817800
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-an1e28di 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-an1e28di 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 19 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-201.633µs; -62.244µs] or [-7.336%; -2.265%]		 unsure
[-565.090µs; -51.010µs] or [-7.276%; -0.657%]		 unstable
[-122.946op/s; +189.321op/s] or [-9.257%; +14.254%]		 2.616ms 7.458ms 1361.344op/s 2.748ms 7.766ms 1328.156op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~749076a976, baseline=1.59.0-SNAPSHOT~02cc48359b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.175 ms) : 1163, 1186
.   : milestone, 1175,
iast (3.022 ms) : 2987, 3057
.   : milestone, 3022,
iast_FULL (5.813 ms) : 5755, 5871
.   : milestone, 5813,
iast_GLOBAL (3.45 ms) : 3403, 3497
.   : milestone, 3450,
profiling (1.929 ms) : 1913, 1945
.   : milestone, 1929,
tracing (1.786 ms) : 1772, 1800
.   : milestone, 1786,
section candidate
no_agent (1.205 ms) : 1193, 1216
.   : milestone, 1205,
iast (3.133 ms) : 3092, 3174
.   : milestone, 3133,
iast_FULL (5.691 ms) : 5635, 5747
.   : milestone, 5691,
iast_GLOBAL (3.364 ms) : 3312, 3415
.   : milestone, 3364,
profiling (2.082 ms) : 2063, 2101
.   : milestone, 2082,
tracing (1.883 ms) : 1867, 1899
.   : milestone, 1883,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.175 ms [1.163 ms, 1.186 ms] -
iast 3.022 ms [2.987 ms, 3.057 ms] 1.847 ms (157.3%)
iast_FULL 5.813 ms [5.755 ms, 5.871 ms] 4.638 ms (394.9%)
iast_GLOBAL 3.45 ms [3.403 ms, 3.497 ms] 2.276 ms (193.7%)
profiling 1.929 ms [1.913 ms, 1.945 ms] 754.339 µs (64.2%)
tracing 1.786 ms [1.772 ms, 1.8 ms] 611.428 µs (52.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.205 ms [1.193 ms, 1.216 ms] -
iast 3.133 ms [3.092 ms, 3.174 ms] 1.928 ms (160.0%)
iast_FULL 5.691 ms [5.635 ms, 5.747 ms] 4.486 ms (372.3%)
iast_GLOBAL 3.364 ms [3.312 ms, 3.415 ms] 2.159 ms (179.2%)
profiling 2.082 ms [2.063 ms, 2.101 ms] 877.147 µs (72.8%)
tracing 1.883 ms [1.867 ms, 1.899 ms] 678.211 µs (56.3%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~749076a976, baseline=1.59.0-SNAPSHOT~02cc48359b
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.168 ms) : 18970, 19366
.   : milestone, 19168,
appsec (18.644 ms) : 18453, 18835
.   : milestone, 18644,
code_origins (17.769 ms) : 17590, 17948
.   : milestone, 17769,
iast (17.645 ms) : 17469, 17821
.   : milestone, 17645,
profiling (18.736 ms) : 18547, 18925
.   : milestone, 18736,
tracing (17.568 ms) : 17394, 17741
.   : milestone, 17568,
section candidate
no_agent (18.231 ms) : 18045, 18417
.   : milestone, 18231,
appsec (18.529 ms) : 18342, 18716
.   : milestone, 18529,
code_origins (17.693 ms) : 17519, 17867
.   : milestone, 17693,
iast (17.479 ms) : 17306, 17652
.   : milestone, 17479,
profiling (18.808 ms) : 18618, 18998
.   : milestone, 18808,
tracing (17.307 ms) : 17137, 17477
.   : milestone, 17307,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.168 ms [18.97 ms, 19.366 ms] -
appsec 18.644 ms [18.453 ms, 18.835 ms] -524.048 µs (-2.7%)
code_origins 17.769 ms [17.59 ms, 17.948 ms] -1.399 ms (-7.3%)
iast 17.645 ms [17.469 ms, 17.821 ms] -1.523 ms (-7.9%)
profiling 18.736 ms [18.547 ms, 18.925 ms] -431.863 µs (-2.3%)
tracing 17.568 ms [17.394 ms, 17.741 ms] -1.6 ms (-8.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.231 ms [18.045 ms, 18.417 ms] -
appsec 18.529 ms [18.342 ms, 18.716 ms] 298.201 µs (1.6%)
code_origins 17.693 ms [17.519 ms, 17.867 ms] -537.964 µs (-3.0%)
iast 17.479 ms [17.306 ms, 17.652 ms] -751.835 µs (-4.1%)
profiling 18.808 ms [18.618 ms, 18.998 ms] 576.881 µs (3.2%)
tracing 17.307 ms [17.137 ms, 17.477 ms] -924.148 µs (-5.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-jacoco
git_commit_date 1769704474 1769781186
git_commit_sha 02cc483 749076a
release_version 1.59.0-SNAPSHOT~02cc48359b 1.59.0-SNAPSHOT~749076a976
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1769783993 1769783993
ci_job_id 1389996529 1389996529
ci_pipeline_id 93817800 93817800
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-fd5ufpiy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-fd5ufpiy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~749076a976, baseline=1.59.0-SNAPSHOT~02cc48359b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1472, 1495
.   : milestone, 1483,
appsec (3.76 ms) : 3540, 3980
.   : milestone, 3760,
iast (2.271 ms) : 2201, 2341
.   : milestone, 2271,
iast_GLOBAL (2.312 ms) : 2242, 2382
.   : milestone, 2312,
profiling (2.507 ms) : 2292, 2723
.   : milestone, 2507,
tracing (2.093 ms) : 2039, 2147
.   : milestone, 2093,
section candidate
no_agent (1.485 ms) : 1474, 1497
.   : milestone, 1485,
appsec (3.8 ms) : 3578, 4021
.   : milestone, 3800,
iast (2.268 ms) : 2198, 2337
.   : milestone, 2268,
iast_GLOBAL (2.326 ms) : 2255, 2396
.   : milestone, 2326,
profiling (2.141 ms) : 2083, 2198
.   : milestone, 2141,
tracing (2.083 ms) : 2029, 2137
.   : milestone, 2083,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.472 ms, 1.495 ms] -
appsec 3.76 ms [3.54 ms, 3.98 ms] 2.277 ms (153.5%)
iast 2.271 ms [2.201 ms, 2.341 ms] 788.079 µs (53.1%)
iast_GLOBAL 2.312 ms [2.242 ms, 2.382 ms] 828.949 µs (55.9%)
profiling 2.507 ms [2.292 ms, 2.723 ms] 1.024 ms (69.0%)
tracing 2.093 ms [2.039 ms, 2.147 ms] 609.712 µs (41.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.474 ms, 1.497 ms] -
appsec 3.8 ms [3.578 ms, 4.021 ms] 2.314 ms (155.8%)
iast 2.268 ms [2.198 ms, 2.337 ms] 782.318 µs (52.7%)
iast_GLOBAL 2.326 ms [2.255 ms, 2.396 ms] 840.064 µs (56.6%)
profiling 2.141 ms [2.083 ms, 2.198 ms] 655.109 µs (44.1%)
tracing 2.083 ms [2.029 ms, 2.137 ms] 597.744 µs (40.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~749076a976, baseline=1.59.0-SNAPSHOT~02cc48359b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.558 s) : 15558000, 15558000
.   : milestone, 15558000,
appsec (15.008 s) : 15008000, 15008000
.   : milestone, 15008000,
iast (18.078 s) : 18078000, 18078000
.   : milestone, 18078000,
iast_GLOBAL (17.402 s) : 17402000, 17402000
.   : milestone, 17402000,
profiling (14.889 s) : 14889000, 14889000
.   : milestone, 14889000,
tracing (14.781 s) : 14781000, 14781000
.   : milestone, 14781000,
section candidate
no_agent (14.905 s) : 14905000, 14905000
.   : milestone, 14905000,
appsec (14.975 s) : 14975000, 14975000
.   : milestone, 14975000,
iast (18.166 s) : 18166000, 18166000
.   : milestone, 18166000,
iast_GLOBAL (17.845 s) : 17845000, 17845000
.   : milestone, 17845000,
profiling (15.326 s) : 15326000, 15326000
.   : milestone, 15326000,
tracing (14.631 s) : 14631000, 14631000
.   : milestone, 14631000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.558 s [15.558 s, 15.558 s] -
appsec 15.008 s [15.008 s, 15.008 s] -550.0 ms (-3.5%)
iast 18.078 s [18.078 s, 18.078 s] 2.52 s (16.2%)
iast_GLOBAL 17.402 s [17.402 s, 17.402 s] 1.844 s (11.9%)
profiling 14.889 s [14.889 s, 14.889 s] -669.0 ms (-4.3%)
tracing 14.781 s [14.781 s, 14.781 s] -777.0 ms (-5.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.905 s [14.905 s, 14.905 s] -
appsec 14.975 s [14.975 s, 14.975 s] 70.0 ms (0.5%)
iast 18.166 s [18.166 s, 18.166 s] 3.261 s (21.9%)
iast_GLOBAL 17.845 s [17.845 s, 17.845 s] 2.94 s (19.7%)
profiling 15.326 s [15.326 s, 15.326 s] 421.0 ms (2.8%)
tracing 14.631 s [14.631 s, 14.631 s] -274.0 ms (-1.8%)

@jpbempel jpbempel merged commit df372f6 into master Jan 30, 2026
556 of 564 checks passed
@jpbempel jpbempel deleted the jpbempel/fix-jacoco branch January 30, 2026 14:56
@github-actions github-actions bot added this to the 1.59.0 milestone Jan 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@evanchooly evanchooly evanchooly approved these changes

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation comp: testing Testing tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

1.59.0

Development

Successfully merging this pull request may close these issues.

3 participants

@jpbempel @evanchooly