Skip to content

Add JDK 25-EA testing to CI #9140

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 9 commits into
base: master
Choose a base branch
from
Open

Add JDK 25-EA testing to CI #9140

wants to merge 9 commits into from

Conversation

sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented Jul 9, 2025 •
edited
Loading

What Does This Do

Add testing for JDK 25 EA as a non-default JVM.

Motivation

Prepare for the general release of Java 25 (ETA Sep 16, 2025).

Additional Notes

Once the general release of JDK 25 is out, we will test it as a default JVM.

For testing, I manually triggered NON_DEFAULT_JVM (e.g. 25) tests to run on this PR: https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/pipelines/70631693

The next steps are to unskip the ignored tests - in particular RuntimeCallSiteTest and MdcTest. The other tests will need increased support from gradle and jacoco.

Contributor Checklist

Jira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-83

@sarahchen6 sarahchen6 added the tag: do not merge Do not merge changes label Jul 9, 2025
@sarahchen6 sarahchen6 changed the title [test] JDK 25 EA build image and tests Test JDK 25 EA build image and tests Jul 9, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jul 9, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/try-jdk-25-image-and-tests
git_commit_date 1753099061 1753105887
git_commit_sha b6521fb eb324be
release_version 1.52.0-SNAPSHOT~b6521fb91a 1.52.0-SNAPSHOT~eb324be0e8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1753107488 1753107488
ci_job_id 1038722826 1038722826
ci_pipeline_id 71172228 71172228
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ybonkb0g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ybonkb0g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 12 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~eb324be0e8, baseline=1.52.0-SNAPSHOT~b6521fb91a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.038 s) : 0, 1037835
Total [baseline] (8.621 s) : 0, 8620822
Agent [candidate] (1.043 s) : 0, 1042810
Total [candidate] (8.627 s) : 0, 8627118
section iast
Agent [baseline] (1.17 s) : 0, 1170332
Total [baseline] (9.274 s) : 0, 9273626
Agent [candidate] (1.2 s) : 0, 1199969
Total [candidate] (9.364 s) : 0, 9364315
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.038 s -
Agent iast 1.17 s 132.498 ms (12.8%)
Total tracing 8.621 s -
Total iast 9.274 s 652.803 ms (7.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent iast 1.2 s 157.158 ms (15.1%)
Total tracing 8.627 s -
Total iast 9.364 s 737.197 ms (8.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~eb324be0e8, baseline=1.52.0-SNAPSHOT~b6521fb91a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.444 ms) : 0, 1444
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (729.392 ms) : 0, 729392
BytebuddyAgent [candidate] (732.457 ms) : 0, 732457
GlobalTracer [baseline] (240.837 ms) : 0, 240837
GlobalTracer [candidate] (242.291 ms) : 0, 242291
AppSec [baseline] (30.345 ms) : 0, 30345
AppSec [candidate] (30.555 ms) : 0, 30555
Debugger [baseline] (6.016 ms) : 0, 6016
Debugger [candidate] (6.066 ms) : 0, 6066
Remote Config [baseline] (639.899 µs) : 0, 640
Remote Config [candidate] (655.229 µs) : 0, 655
Telemetry [baseline] (8.206 ms) : 0, 8206
Telemetry [candidate] (8.246 ms) : 0, 8246
section iast
crashtracking [baseline] (1.422 ms) : 0, 1422
crashtracking [candidate] (1.472 ms) : 0, 1472
BytebuddyAgent [baseline] (844.867 ms) : 0, 844867
BytebuddyAgent [candidate] (868.545 ms) : 0, 868545
GlobalTracer [baseline] (230.8 ms) : 0, 230800
GlobalTracer [candidate] (234.651 ms) : 0, 234651
IAST [baseline] (29.154 ms) : 0, 29154
IAST [candidate] (29.676 ms) : 0, 29676
AppSec [baseline] (26.438 ms) : 0, 26438
AppSec [candidate] (29.689 ms) : 0, 29689
Debugger [baseline] (8.317 ms) : 0, 8317
Debugger [candidate] (5.876 ms) : 0, 5876
Remote Config [baseline] (570.169 µs) : 0, 570
Remote Config [candidate] (605.509 µs) : 0, 606
Telemetry [baseline] (7.894 ms) : 0, 7894
Telemetry [candidate] (8.139 ms) : 0, 8139
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~eb324be0e8, baseline=1.52.0-SNAPSHOT~b6521fb91a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.041 s) : 0, 1040567
Total [baseline] (10.619 s) : 0, 10618753
Agent [candidate] (1.052 s) : 0, 1051876
Total [candidate] (10.738 s) : 0, 10738035
section appsec
Agent [baseline] (1.226 s) : 0, 1226204
Total [baseline] (10.802 s) : 0, 10802267
Agent [candidate] (1.222 s) : 0, 1222212
Total [candidate] (10.794 s) : 0, 10794198
section iast
Agent [baseline] (1.178 s) : 0, 1178223
Total [baseline] (7.551 s) : 0, 7550503
Agent [candidate] (1.191 s) : 0, 1190520
Total [candidate] (10.957 s) : 0, 10957085
section profiling
Agent [baseline] (1.182 s) : 0, 1181816
Total [baseline] (10.821 s) : 0, 10821495
Agent [candidate] (1.191 s) : 0, 1190693
Total [candidate] (10.959 s) : 0, 10958974
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent appsec 1.226 s 185.637 ms (17.8%)
Agent iast 1.178 s 137.656 ms (13.2%)
Agent profiling 1.182 s 141.25 ms (13.6%)
Total tracing 10.619 s -
Total appsec 10.802 s 183.514 ms (1.7%)
Total iast 7.551 s -3.068 s (-28.9%)
Total profiling 10.821 s 202.743 ms (1.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.222 s 170.336 ms (16.2%)
Agent iast 1.191 s 138.644 ms (13.2%)
Agent profiling 1.191 s 138.817 ms (13.2%)
Total tracing 10.738 s -
Total appsec 10.794 s 56.163 ms (0.5%)
Total iast 10.957 s 219.05 ms (2.0%)
Total profiling 10.959 s 220.939 ms (2.1%) 
gantt
    title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~eb324be0e8, baseline=1.52.0-SNAPSHOT~b6521fb91a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.438 ms) : 0, 1438
crashtracking [candidate] (1.45 ms) : 0, 1450
BytebuddyAgent [baseline] (731.256 ms) : 0, 731256
BytebuddyAgent [candidate] (738.822 ms) : 0, 738822
GlobalTracer [baseline] (241.616 ms) : 0, 241616
GlobalTracer [candidate] (244.402 ms) : 0, 244402
AppSec [baseline] (30.35 ms) : 0, 30350
AppSec [candidate] (30.816 ms) : 0, 30816
Debugger [baseline] (6.004 ms) : 0, 6004
Debugger [candidate] (6.107 ms) : 0, 6107
Remote Config [baseline] (644.564 µs) : 0, 645
Remote Config [candidate] (652.146 µs) : 0, 652
Telemetry [baseline] (8.216 ms) : 0, 8216
Telemetry [candidate] (8.332 ms) : 0, 8332
section appsec
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.435 ms) : 0, 1435
BytebuddyAgent [baseline] (757.152 ms) : 0, 757152
BytebuddyAgent [candidate] (754.519 ms) : 0, 754519
GlobalTracer [baseline] (236.022 ms) : 0, 236022
GlobalTracer [candidate] (235.432 ms) : 0, 235432
IAST [baseline] (23.759 ms) : 0, 23759
IAST [candidate] (23.55 ms) : 0, 23550
AppSec [baseline] (167.644 ms) : 0, 167644
AppSec [candidate] (168.328 ms) : 0, 168328
Debugger [baseline] (9.274 ms) : 0, 9274
Debugger [candidate] (8.83 ms) : 0, 8830
Remote Config [baseline] (605.228 µs) : 0, 605
Remote Config [candidate] (611.457 µs) : 0, 611
Telemetry [baseline] (8.91 ms) : 0, 8910
Telemetry [candidate] (8.159 ms) : 0, 8159
section iast
crashtracking [baseline] (1.417 ms) : 0, 1417
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (850.848 ms) : 0, 850848
BytebuddyAgent [candidate] (861.396 ms) : 0, 861396
GlobalTracer [baseline] (232.408 ms) : 0, 232408
GlobalTracer [candidate] (233.131 ms) : 0, 233131
IAST [baseline] (29.301 ms) : 0, 29301
IAST [candidate] (28.585 ms) : 0, 28585
AppSec [baseline] (28.896 ms) : 0, 28896
AppSec [candidate] (29.378 ms) : 0, 29378
Debugger [baseline] (5.706 ms) : 0, 5706
Debugger [candidate] (6.642 ms) : 0, 6642
Remote Config [baseline] (585.413 µs) : 0, 585
Remote Config [candidate] (591.783 µs) : 0, 592
Telemetry [baseline] (8.039 ms) : 0, 8039
Telemetry [candidate] (8.092 ms) : 0, 8092
section profiling
crashtracking [baseline] (1.39 ms) : 0, 1390
crashtracking [candidate] (1.412 ms) : 0, 1412
BytebuddyAgent [baseline] (757.822 ms) : 0, 757822
BytebuddyAgent [candidate] (762.881 ms) : 0, 762881
GlobalTracer [baseline] (219.864 ms) : 0, 219864
GlobalTracer [candidate] (222.124 ms) : 0, 222124
AppSec [baseline] (30.163 ms) : 0, 30163
AppSec [candidate] (30.524 ms) : 0, 30524
Debugger [baseline] (6.218 ms) : 0, 6218
Debugger [candidate] (6.368 ms) : 0, 6368
Remote Config [baseline] (666.07 µs) : 0, 666
Remote Config [candidate] (669.812 µs) : 0, 670
Telemetry [baseline] (12.428 ms) : 0, 12428
Telemetry [candidate] (15.58 ms) : 0, 15580
ProfilingAgent [baseline] (104.812 ms) : 0, 104812
ProfilingAgent [candidate] (102.309 ms) : 0, 102309
Profiling [baseline] (104.835 ms) : 0, 104835
Profiling [candidate] (102.332 ms) : 0, 102332
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/try-jdk-25-image-and-tests
git_commit_date 1753099061 1753105887
git_commit_sha b6521fb eb324be
release_version 1.52.0-SNAPSHOT~b6521fb91a 1.52.0-SNAPSHOT~eb324be0e8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1753107259 1753107259
ci_job_id 1038722827 1038722827
ci_pipeline_id 71172228 71172228
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-jthrf5ay 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-jthrf5ay 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+222.537µs; +515.302µs] or [+2.623%; +6.074%]		 unstable
[-93.603op/s; +48.603op/s] or [-17.126%; +8.892%]		 8.853ms 524.062op/s 8.484ms 546.562op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.086ms; +1.724ms] or [+3.010%; +4.777%]		 unstable
[-13.622op/s; +3.897op/s] or [-10.516%; +3.009%]		 37.505ms 124.675op/s 36.099ms 129.537op/s
scenario:load:petclinic:iast:high_load better
[-1.770ms; -0.973ms] or [-3.994%; -2.195%]		 unstable
[-4.315op/s; +10.965op/s] or [-4.086%; +10.383%]		 42.942ms 108.925op/s 44.313ms 105.600op/s
scenario:load:petclinic:appsec:high_load better
[-2.474ms; -1.516ms] or [-4.892%; -2.996%]		 unstable
[-3.037op/s; +10.687op/s] or [-3.283%; +11.551%]		 48.589ms 96.350op/s 50.584ms 92.525op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~eb324be0e8, baseline=1.52.0-SNAPSHOT~b6521fb91a
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.381 ms) : 4332, 4430
.   : milestone, 4381,
iast (9.296 ms) : 9136, 9457
.   : milestone, 9296,
iast_FULL (14.122 ms) : 13841, 14403
.   : milestone, 14122,
iast_GLOBAL (10.435 ms) : 10250, 10620
.   : milestone, 10435,
profiling (8.484 ms) : 8354, 8614
.   : milestone, 8484,
tracing (7.523 ms) : 7415, 7631
.   : milestone, 7523,
section candidate
no_agent (4.289 ms) : 4242, 4336
.   : milestone, 4289,
iast (9.418 ms) : 9257, 9578
.   : milestone, 9418,
iast_FULL (14.344 ms) : 14054, 14633
.   : milestone, 14344,
iast_GLOBAL (10.337 ms) : 10154, 10520
.   : milestone, 10337,
profiling (8.853 ms) : 8711, 8995
.   : milestone, 8853,
tracing (7.544 ms) : 7430, 7657
.   : milestone, 7544,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.381 ms [4.332 ms, 4.43 ms] -
iast 9.296 ms [9.136 ms, 9.457 ms] 4.915 ms (112.2%)
iast_FULL 14.122 ms [13.841 ms, 14.403 ms] 9.741 ms (222.3%)
iast_GLOBAL 10.435 ms [10.25 ms, 10.62 ms] 6.054 ms (138.2%)
profiling 8.484 ms [8.354 ms, 8.614 ms] 4.103 ms (93.6%)
tracing 7.523 ms [7.415 ms, 7.631 ms] 3.142 ms (71.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.289 ms [4.242 ms, 4.336 ms] -
iast 9.418 ms [9.257 ms, 9.578 ms] 5.129 ms (119.6%)
iast_FULL 14.344 ms [14.054 ms, 14.633 ms] 10.055 ms (234.4%)
iast_GLOBAL 10.337 ms [10.154 ms, 10.52 ms] 6.048 ms (141.0%)
profiling 8.853 ms [8.711 ms, 8.995 ms] 4.564 ms (106.4%)
tracing 7.544 ms [7.43 ms, 7.657 ms] 3.255 ms (75.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~eb324be0e8, baseline=1.52.0-SNAPSHOT~b6521fb91a
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.099 ms) : 35806, 36393
.   : milestone, 36099,
appsec (50.584 ms) : 50129, 51039
.   : milestone, 50584,
code_origins (45.334 ms) : 44940, 45728
.   : milestone, 45334,
iast (44.313 ms) : 43935, 44691
.   : milestone, 44313,
profiling (47.81 ms) : 47368, 48253
.   : milestone, 47810,
tracing (44.672 ms) : 44281, 45062
.   : milestone, 44672,
section candidate
no_agent (37.505 ms) : 37206, 37804
.   : milestone, 37505,
appsec (48.589 ms) : 48153, 49025
.   : milestone, 48589,
code_origins (45.22 ms) : 44833, 45607
.   : milestone, 45220,
iast (42.942 ms) : 42579, 43304
.   : milestone, 42942,
profiling (48.315 ms) : 47858, 48773
.   : milestone, 48315,
tracing (43.534 ms) : 43180, 43889
.   : milestone, 43534,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.099 ms [35.806 ms, 36.393 ms] -
appsec 50.584 ms [50.129 ms, 51.039 ms] 14.485 ms (40.1%)
code_origins 45.334 ms [44.94 ms, 45.728 ms] 9.235 ms (25.6%)
iast 44.313 ms [43.935 ms, 44.691 ms] 8.214 ms (22.8%)
profiling 47.81 ms [47.368 ms, 48.253 ms] 11.711 ms (32.4%)
tracing 44.672 ms [44.281 ms, 45.062 ms] 8.573 ms (23.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.505 ms [37.206 ms, 37.804 ms] -
appsec 48.589 ms [48.153 ms, 49.025 ms] 11.084 ms (29.6%)
code_origins 45.22 ms [44.833 ms, 45.607 ms] 7.716 ms (20.6%)
iast 42.942 ms [42.579 ms, 43.304 ms] 5.437 ms (14.5%)
profiling 48.315 ms [47.858 ms, 48.773 ms] 10.811 ms (28.8%)
tracing 43.534 ms [43.18 ms, 43.889 ms] 6.03 ms (16.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/try-jdk-25-image-and-tests
git_commit_date 1753099061 1753105887
git_commit_sha b6521fb eb324be
release_version 1.52.0-SNAPSHOT~b6521fb91a 1.52.0-SNAPSHOT~eb324be0e8
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1753107814 1753107814
ci_job_id 1038722828 1038722828
ci_pipeline_id 71172228 71172228
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-wpq9hfma 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-wpq9hfma 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~eb324be0e8, baseline=1.52.0-SNAPSHOT~b6521fb91a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.675 s) : 15675000, 15675000
.   : milestone, 15675000,
appsec (14.975 s) : 14975000, 14975000
.   : milestone, 14975000,
iast (18.553 s) : 18553000, 18553000
.   : milestone, 18553000,
iast_GLOBAL (17.914 s) : 17914000, 17914000
.   : milestone, 17914000,
profiling (15.011 s) : 15011000, 15011000
.   : milestone, 15011000,
tracing (15.027 s) : 15027000, 15027000
.   : milestone, 15027000,
section candidate
no_agent (15.36 s) : 15360000, 15360000
.   : milestone, 15360000,
appsec (14.92 s) : 14920000, 14920000
.   : milestone, 14920000,
iast (18.331 s) : 18331000, 18331000
.   : milestone, 18331000,
iast_GLOBAL (18.029 s) : 18029000, 18029000
.   : milestone, 18029000,
profiling (15.367 s) : 15367000, 15367000
.   : milestone, 15367000,
tracing (14.893 s) : 14893000, 14893000
.   : milestone, 14893000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.675 s [15.675 s, 15.675 s] -
appsec 14.975 s [14.975 s, 14.975 s] -700.0 ms (-4.5%)
iast 18.553 s [18.553 s, 18.553 s] 2.878 s (18.4%)
iast_GLOBAL 17.914 s [17.914 s, 17.914 s] 2.239 s (14.3%)
profiling 15.011 s [15.011 s, 15.011 s] -664.0 ms (-4.2%)
tracing 15.027 s [15.027 s, 15.027 s] -648.0 ms (-4.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.36 s [15.36 s, 15.36 s] -
appsec 14.92 s [14.92 s, 14.92 s] -440.0 ms (-2.9%)
iast 18.331 s [18.331 s, 18.331 s] 2.971 s (19.3%)
iast_GLOBAL 18.029 s [18.029 s, 18.029 s] 2.669 s (17.4%)
profiling 15.367 s [15.367 s, 15.367 s] 7.0 ms (0.0%)
tracing 14.893 s [14.893 s, 14.893 s] -467.0 ms (-3.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~eb324be0e8, baseline=1.52.0-SNAPSHOT~b6521fb91a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1463, 1487
.   : milestone, 1475,
appsec (3.649 ms) : 3433, 3865
.   : milestone, 3649,
iast (2.196 ms) : 2134, 2258
.   : milestone, 2196,
iast_GLOBAL (2.24 ms) : 2178, 2303
.   : milestone, 2240,
profiling (2.032 ms) : 1982, 2081
.   : milestone, 2032,
tracing (2.012 ms) : 1963, 2060
.   : milestone, 2012,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.635 ms) : 3416, 3854
.   : milestone, 3635,
iast (2.198 ms) : 2135, 2260
.   : milestone, 2198,
iast_GLOBAL (2.232 ms) : 2169, 2295
.   : milestone, 2232,
profiling (2.051 ms) : 2000, 2102
.   : milestone, 2051,
tracing (2.004 ms) : 1956, 2052
.   : milestone, 2004,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.487 ms] -
appsec 3.649 ms [3.433 ms, 3.865 ms] 2.174 ms (147.4%)
iast 2.196 ms [2.134 ms, 2.258 ms] 720.893 µs (48.9%)
iast_GLOBAL 2.24 ms [2.178 ms, 2.303 ms] 765.257 µs (51.9%)
profiling 2.032 ms [1.982 ms, 2.081 ms] 556.629 µs (37.7%)
tracing 2.012 ms [1.963 ms, 2.06 ms] 536.638 µs (36.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 3.635 ms [3.416 ms, 3.854 ms] 2.161 ms (146.5%)
iast 2.198 ms [2.135 ms, 2.26 ms] 723.213 µs (49.1%)
iast_GLOBAL 2.232 ms [2.169 ms, 2.295 ms] 757.721 µs (51.4%)
profiling 2.051 ms [2.0 ms, 2.102 ms] 576.894 µs (39.1%)
tracing 2.004 ms [1.956 ms, 2.052 ms] 529.575 µs (35.9%)

@sarahchen6 sarahchen6 changed the title Test JDK 25 EA build image and tests Add JDK 25-EA testing to CI Jul 10, 2025
@sarahchen6 sarahchen6 force-pushed the sarahchen6/try-jdk-25-image-and-tests branch from 802838e to a7d756b Compare July 10, 2025 22:11
@sarahchen6 sarahchen6 force-pushed the sarahchen6/try-jdk-25-image-and-tests branch from a7d756b to 33dc1bb Compare July 14, 2025 17:48
@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements comp: testing Testing and removed tag: do not merge Do not merge changes labels Jul 14, 2025
@sarahchen6 sarahchen6 marked this pull request as ready for review July 14, 2025 22:02
@sarahchen6 sarahchen6 requested review from a team as code owners July 14, 2025 22:02
@sarahchen6 sarahchen6 requested review from daniel-mohedano, smola, sezen-datadog, bric3 and randomanderson and removed request for a team July 14, 2025 22:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@daniel-mohedano daniel-mohedano Awaiting requested review from daniel-mohedano daniel-mohedano is a code owner automatically assigned from DataDog/ci-app-libraries-java

@smola smola Awaiting requested review from smola smola is a code owner automatically assigned from DataDog/asm-java

@sezen-datadog sezen-datadog Awaiting requested review from sezen-datadog sezen-datadog is a code owner automatically assigned from DataDog/asm-java

@bric3 bric3 Awaiting requested review from bric3 bric3 is a code owner automatically assigned from DataDog/apm-lang-platform-java

@randomanderson randomanderson Awaiting requested review from randomanderson randomanderson is a code owner automatically assigned from DataDog/apm-release-platform

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
comp: testing Testing type: enhancement Enhancements and improvements
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@sarahchen6