Skip to content

Add additional debug logging related to JPS #8718

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

Add additional debug logging related to JPS #8718

wants to merge 3 commits into from

Conversation

MattAlp
Copy link
Contributor

@MattAlp MattAlp commented Apr 22, 2025 •
edited by jira bot
Loading

What Does This Do

Records via telemetry if the jvmstat module isn't found, for observability across different JVM distributions

Jira ticket: PROF-11678

@MattAlp MattAlp added comp: core Tracer core comp: profiling Profiling comp: telemetry Telemetry labels Apr 22, 2025
@MattAlp MattAlp requested a review from a team as a code owner April 22, 2025 13:32
@MattAlp MattAlp requested a review from amarziali April 22, 2025 13:32
@DataDog DataDog deleted a comment from github-actions bot Apr 22, 2025
@MattAlp MattAlp requested a review from jbachorik April 22, 2025 14:05
@pr-commenter
Copy link

pr-commenter bot commented Apr 22, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/additional-jvmstat-telemetry
git_commit_date 1745405337 1745431624
git_commit_sha 22535c7 87b0131
release_version 1.49.0-SNAPSHOT~22535c74a4 1.49.0-SNAPSHOT~87b0131427
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1745434622 1745434622
ci_job_id 909475325 909475325
ci_pipeline_id 63103436 63103436
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-mljj-zqf-project-304-concurrent-0-km06lu4f 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-mljj-zqf-project-304-concurrent-0-km06lu4f 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 12 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.49.0-SNAPSHOT~87b0131427, baseline=1.49.0-SNAPSHOT~22535c74a4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1062752
Total [baseline] (10.597 s) : 0, 10596963
Agent [candidate] (1.06 s) : 0, 1059756
Total [candidate] (10.554 s) : 0, 10554457
section appsec
Agent [baseline] (1.203 s) : 0, 1203104
Total [baseline] (10.817 s) : 0, 10816905
Agent [candidate] (1.214 s) : 0, 1214333
Total [candidate] (10.834 s) : 0, 10833543
section iast
Agent [baseline] (1.197 s) : 0, 1196651
Total [baseline] (11.047 s) : 0, 11047423
Agent [candidate] (1.189 s) : 0, 1189149
Total [candidate] (10.996 s) : 0, 10995862
section profiling
Agent [baseline] (1.309 s) : 0, 1309328
Total [baseline] (11.074 s) : 0, 11074321
Agent [candidate] (1.323 s) : 0, 1322568
Total [candidate] (10.959 s) : 0, 10958549
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent appsec 1.203 s 140.351 ms (13.2%)
Agent iast 1.197 s 133.899 ms (12.6%)
Agent profiling 1.309 s 246.576 ms (23.2%)
Total tracing 10.597 s -
Total appsec 10.817 s 219.941 ms (2.1%)
Total iast 11.047 s 450.459 ms (4.3%)
Total profiling 11.074 s 477.358 ms (4.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.214 s 154.577 ms (14.6%)
Agent iast 1.189 s 129.393 ms (12.2%)
Agent profiling 1.323 s 262.812 ms (24.8%)
Total tracing 10.554 s -
Total appsec 10.834 s 279.085 ms (2.6%)
Total iast 10.996 s 441.405 ms (4.2%)
Total profiling 10.959 s 404.091 ms (3.8%) 
gantt
    title petclinic - break down per module: candidate=1.49.0-SNAPSHOT~87b0131427, baseline=1.49.0-SNAPSHOT~22535c74a4

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (724.248 ms) : 0, 724248
BytebuddyAgent [candidate] (723.968 ms) : 0, 723968
GlobalTracer [baseline] (239.971 ms) : 0, 239971
GlobalTracer [candidate] (239.768 ms) : 0, 239768
AppSec [baseline] (55.532 ms) : 0, 55532
AppSec [candidate] (55.144 ms) : 0, 55144
Debugger [baseline] (5.09 ms) : 0, 5090
Debugger [candidate] (6.555 ms) : 0, 6555
Remote Config [baseline] (705.856 µs) : 0, 706
Remote Config [candidate] (701.117 µs) : 0, 701
Telemetry [baseline] (13.653 ms) : 0, 13653
Telemetry [candidate] (9.991 ms) : 0, 9991
section appsec
BytebuddyAgent [baseline] (743.084 ms) : 0, 743084
BytebuddyAgent [candidate] (750.152 ms) : 0, 750152
GlobalTracer [baseline] (237.104 ms) : 0, 237104
GlobalTracer [candidate] (239.151 ms) : 0, 239151
AppSec [baseline] (175.34 ms) : 0, 175340
AppSec [candidate] (176.859 ms) : 0, 176859
Debugger [baseline] (4.223 ms) : 0, 4223
Debugger [candidate] (4.236 ms) : 0, 4236
Remote Config [baseline] (628.624 µs) : 0, 629
Remote Config [candidate] (646.653 µs) : 0, 647
Telemetry [baseline] (8.157 ms) : 0, 8157
Telemetry [candidate] (8.243 ms) : 0, 8243
IAST [baseline] (21.933 ms) : 0, 21933
IAST [candidate] (22.338 ms) : 0, 22338
section iast
BytebuddyAgent [baseline] (848.78 ms) : 0, 848780
BytebuddyAgent [candidate] (842.73 ms) : 0, 842730
GlobalTracer [baseline] (231.41 ms) : 0, 231410
GlobalTracer [candidate] (229.935 ms) : 0, 229935
AppSec [baseline] (53.218 ms) : 0, 53218
AppSec [candidate] (54.879 ms) : 0, 54879
Debugger [baseline] (4.252 ms) : 0, 4252
Debugger [candidate] (4.272 ms) : 0, 4272
Remote Config [baseline] (614.663 µs) : 0, 615
Remote Config [candidate] (605.433 µs) : 0, 605
Telemetry [baseline] (8.843 ms) : 0, 8843
Telemetry [candidate] (8.76 ms) : 0, 8760
IAST [baseline] (24.347 ms) : 0, 24347
IAST [candidate] (22.889 ms) : 0, 22889
section profiling
ProfilingAgent [baseline] (101.88 ms) : 0, 101880
ProfilingAgent [candidate] (103.057 ms) : 0, 103057
BytebuddyAgent [baseline] (714.111 ms) : 0, 714111
BytebuddyAgent [candidate] (720.475 ms) : 0, 720475
GlobalTracer [baseline] (374.995 ms) : 0, 374995
GlobalTracer [candidate] (380.015 ms) : 0, 380015
AppSec [baseline] (54.156 ms) : 0, 54156
AppSec [candidate] (54.017 ms) : 0, 54017
Debugger [baseline] (4.388 ms) : 0, 4388
Debugger [candidate] (4.469 ms) : 0, 4469
Remote Config [baseline] (667.538 µs) : 0, 668
Remote Config [candidate] (670.407 µs) : 0, 670
Telemetry [baseline] (8.879 ms) : 0, 8879
Telemetry [candidate] (9.099 ms) : 0, 9099
Profiling [baseline] (101.906 ms) : 0, 101906
Profiling [candidate] (103.083 ms) : 0, 103083
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.49.0-SNAPSHOT~87b0131427, baseline=1.49.0-SNAPSHOT~22535c74a4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1061998
Total [baseline] (8.694 s) : 0, 8693990
Agent [candidate] (1.067 s) : 0, 1066556
Total [candidate] (8.735 s) : 0, 8734535
section iast
Agent [baseline] (1.195 s) : 0, 1194606
Total [baseline] (9.293 s) : 0, 9292772
Agent [candidate] (1.187 s) : 0, 1187330
Total [candidate] (9.254 s) : 0, 9253993
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.19 s) : 0, 1189716
Total [baseline] (9.214 s) : 0, 9213619
Agent [candidate] (1.197 s) : 0, 1197228
Total [candidate] (9.306 s) : 0, 9306300
section iast_TELEMETRY_OFF
Agent [baseline] (1.2 s) : 0, 1200279
Total [baseline] (9.306 s) : 0, 9306280
Agent [candidate] (1.187 s) : 0, 1186767
Total [candidate] (9.304 s) : 0, 9304013
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.195 s 132.608 ms (12.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.19 s 127.718 ms (12.0%)
Agent iast_TELEMETRY_OFF 1.2 s 138.281 ms (13.0%)
Total tracing 8.694 s -
Total iast 9.293 s 598.782 ms (6.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.214 s 519.629 ms (6.0%)
Total iast_TELEMETRY_OFF 9.306 s 612.29 ms (7.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.067 s -
Agent iast 1.187 s 120.774 ms (11.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.197 s 130.672 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.187 s 120.212 ms (11.3%)
Total tracing 8.735 s -
Total iast 9.254 s 519.458 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.306 s 571.765 ms (6.5%)
Total iast_TELEMETRY_OFF 9.304 s 569.478 ms (6.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.49.0-SNAPSHOT~87b0131427, baseline=1.49.0-SNAPSHOT~22535c74a4

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (723.666 ms) : 0, 723666
BytebuddyAgent [candidate] (728.947 ms) : 0, 728947
GlobalTracer [baseline] (240.38 ms) : 0, 240380
GlobalTracer [candidate] (241.921 ms) : 0, 241921
AppSec [baseline] (56.321 ms) : 0, 56321
AppSec [candidate] (55.312 ms) : 0, 55312
Debugger [baseline] (5.229 ms) : 0, 5229
Debugger [candidate] (5.138 ms) : 0, 5138
Remote Config [baseline] (696.032 µs) : 0, 696
Remote Config [candidate] (699.629 µs) : 0, 700
Telemetry [baseline] (12.169 ms) : 0, 12169
Telemetry [candidate] (10.848 ms) : 0, 10848
section iast
BytebuddyAgent [baseline] (847.346 ms) : 0, 847346
BytebuddyAgent [candidate] (842.149 ms) : 0, 842149
GlobalTracer [baseline] (230.855 ms) : 0, 230855
GlobalTracer [candidate] (230.11 ms) : 0, 230110
IAST [baseline] (23.558 ms) : 0, 23558
IAST [candidate] (25.756 ms) : 0, 25756
AppSec [baseline] (54.824 ms) : 0, 54824
AppSec [candidate] (50.808 ms) : 0, 50808
Debugger [baseline] (4.248 ms) : 0, 4248
Debugger [candidate] (4.155 ms) : 0, 4155
Remote Config [baseline] (621.479 µs) : 0, 621
Remote Config [candidate] (600.507 µs) : 0, 601
Telemetry [baseline] (8.864 ms) : 0, 8864
Telemetry [candidate] (8.675 ms) : 0, 8675
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (842.519 ms) : 0, 842519
BytebuddyAgent [candidate] (848.855 ms) : 0, 848855
GlobalTracer [baseline] (230.453 ms) : 0, 230453
GlobalTracer [candidate] (231.442 ms) : 0, 231442
IAST [baseline] (23.116 ms) : 0, 23116
IAST [candidate] (23.977 ms) : 0, 23977
AppSec [baseline] (53.337 ms) : 0, 53337
AppSec [candidate] (54.128 ms) : 0, 54128
Debugger [baseline] (4.266 ms) : 0, 4266
Debugger [candidate] (4.25 ms) : 0, 4250
Remote Config [baseline] (635.076 µs) : 0, 635
Remote Config [candidate] (621.878 µs) : 0, 622
Telemetry [baseline] (8.917 ms) : 0, 8917
Telemetry [candidate] (8.758 ms) : 0, 8758
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (851.522 ms) : 0, 851522
BytebuddyAgent [candidate] (840.362 ms) : 0, 840362
GlobalTracer [baseline] (232.162 ms) : 0, 232162
GlobalTracer [candidate] (230.623 ms) : 0, 230623
IAST [baseline] (23.488 ms) : 0, 23488
IAST [candidate] (22.422 ms) : 0, 22422
AppSec [baseline] (55.815 ms) : 0, 55815
AppSec [candidate] (56.443 ms) : 0, 56443
Debugger [baseline] (4.215 ms) : 0, 4215
Debugger [candidate] (4.194 ms) : 0, 4194
Remote Config [baseline] (632.871 µs) : 0, 633
Remote Config [candidate] (621.306 µs) : 0, 621
Telemetry [baseline] (8.73 ms) : 0, 8730
Telemetry [candidate] (8.586 ms) : 0, 8586
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-04-23T18:27:00 2025-04-23T18:34:45
git_branch master mattalp/additional-jvmstat-telemetry
git_commit_date 1745405337 1745431624
git_commit_sha 22535c7 87b0131
release_version 1.49.0-SNAPSHOT~22535c74a4 1.49.0-SNAPSHOT~87b0131427
start_time 2025-04-23T18:26:46 2025-04-23T18:34:31
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1745433684 1745433684
ci_job_id 909475326 909475326
ci_pipeline_id 63103436 63103436
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-7s1ghto-project-304-concurrent-0-qcdahpbm 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-7s1ghto-project-304-concurrent-0-qcdahpbm 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~87b0131427, baseline=1.49.0-SNAPSHOT~22535c74a4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.342 ms) : 1323, 1362
.   : milestone, 1342,
appsec (1.751 ms) : 1728, 1775
.   : milestone, 1751,
appsec_no_iast (1.734 ms) : 1709, 1758
.   : milestone, 1734,
code_origins (1.694 ms) : 1667, 1721
.   : milestone, 1694,
iast (1.519 ms) : 1494, 1543
.   : milestone, 1519,
profiling (1.528 ms) : 1504, 1551
.   : milestone, 1528,
tracing (1.496 ms) : 1471, 1520
.   : milestone, 1496,
section candidate
no_agent (1.367 ms) : 1348, 1386
.   : milestone, 1367,
appsec (1.734 ms) : 1710, 1758
.   : milestone, 1734,
appsec_no_iast (1.735 ms) : 1710, 1760
.   : milestone, 1735,
code_origins (1.686 ms) : 1659, 1712
.   : milestone, 1686,
iast (1.527 ms) : 1502, 1551
.   : milestone, 1527,
profiling (1.548 ms) : 1522, 1573
.   : milestone, 1548,
tracing (1.505 ms) : 1481, 1529
.   : milestone, 1505,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.342 ms [1.323 ms, 1.362 ms] -
appsec 1.751 ms [1.728 ms, 1.775 ms] 409.003 µs (30.5%)
appsec_no_iast 1.734 ms [1.709 ms, 1.758 ms] 391.176 µs (29.1%)
code_origins 1.694 ms [1.667 ms, 1.721 ms] 351.553 µs (26.2%)
iast 1.519 ms [1.494 ms, 1.543 ms] 176.19 µs (13.1%)
profiling 1.528 ms [1.504 ms, 1.551 ms] 185.257 µs (13.8%)
tracing 1.496 ms [1.471 ms, 1.52 ms] 153.097 µs (11.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.367 ms [1.348 ms, 1.386 ms] -
appsec 1.734 ms [1.71 ms, 1.758 ms] 366.912 µs (26.8%)
appsec_no_iast 1.735 ms [1.71 ms, 1.76 ms] 367.722 µs (26.9%)
code_origins 1.686 ms [1.659 ms, 1.712 ms] 318.375 µs (23.3%)
iast 1.527 ms [1.502 ms, 1.551 ms] 159.45 µs (11.7%)
profiling 1.548 ms [1.522 ms, 1.573 ms] 180.382 µs (13.2%)
tracing 1.505 ms [1.481 ms, 1.529 ms] 137.941 µs (10.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~87b0131427, baseline=1.49.0-SNAPSHOT~22535c74a4
    dateFormat X
    axisFormat %s
section baseline
no_agent (384.735 µs) : 365, 405
.   : milestone, 385,
iast (517.717 µs) : 495, 540
.   : milestone, 518,
iast_FULL (735.604 µs) : 714, 758
.   : milestone, 736,
iast_GLOBAL (559.384 µs) : 538, 581
.   : milestone, 559,
iast_HARDCODED_SECRET_DISABLED (513.893 µs) : 492, 536
.   : milestone, 514,
iast_INACTIVE (468.129 µs) : 447, 490
.   : milestone, 468,
iast_TELEMETRY_OFF (503.873 µs) : 482, 526
.   : milestone, 504,
tracing (455.691 µs) : 435, 476
.   : milestone, 456,
section candidate
no_agent (383.124 µs) : 364, 403
.   : milestone, 383,
iast (527.462 µs) : 504, 551
.   : milestone, 527,
iast_FULL (732.69 µs) : 711, 755
.   : milestone, 733,
iast_GLOBAL (564.431 µs) : 543, 586
.   : milestone, 564,
iast_HARDCODED_SECRET_DISABLED (520.492 µs) : 499, 542
.   : milestone, 520,
iast_INACTIVE (472.193 µs) : 450, 494
.   : milestone, 472,
iast_TELEMETRY_OFF (501.905 µs) : 480, 524
.   : milestone, 502,
tracing (458.855 µs) : 438, 480
.   : milestone, 459,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 384.735 µs [364.959 µs, 404.511 µs] -
iast 517.717 µs [495.439 µs, 539.994 µs] 132.981 µs (34.6%)
iast_FULL 735.604 µs [713.625 µs, 757.582 µs] 350.868 µs (91.2%)
iast_GLOBAL 559.384 µs [537.706 µs, 581.062 µs] 174.649 µs (45.4%)
iast_HARDCODED_SECRET_DISABLED 513.893 µs [492.096 µs, 535.69 µs] 129.158 µs (33.6%)
iast_INACTIVE 468.129 µs [446.648 µs, 489.611 µs] 83.394 µs (21.7%)
iast_TELEMETRY_OFF 503.873 µs [481.862 µs, 525.884 µs] 119.138 µs (31.0%)
tracing 455.691 µs [435.045 µs, 476.338 µs] 70.956 µs (18.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 383.124 µs [363.614 µs, 402.633 µs] -
iast 527.462 µs [504.201 µs, 550.723 µs] 144.339 µs (37.7%)
iast_FULL 732.69 µs [710.774 µs, 754.605 µs] 349.566 µs (91.2%)
iast_GLOBAL 564.431 µs [542.837 µs, 586.025 µs] 181.307 µs (47.3%)
iast_HARDCODED_SECRET_DISABLED 520.492 µs [498.77 µs, 542.215 µs] 137.369 µs (35.9%)
iast_INACTIVE 472.193 µs [449.952 µs, 494.434 µs] 89.07 µs (23.2%)
iast_TELEMETRY_OFF 501.905 µs [480.258 µs, 523.551 µs] 118.781 µs (31.0%)
tracing 458.855 µs [438.024 µs, 479.686 µs] 75.731 µs (19.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/additional-jvmstat-telemetry
git_commit_date 1745405337 1745431624
git_commit_sha 22535c7 87b0131
release_version 1.49.0-SNAPSHOT~22535c74a4 1.49.0-SNAPSHOT~87b0131427
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1745434133 1745434133
ci_job_id 909475327 909475327
ci_pipeline_id 63103436 63103436
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-btk2qjfb-project-304-concurrent-0-iyqaavns 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-btk2qjfb-project-304-concurrent-0-iyqaavns 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~87b0131427, baseline=1.49.0-SNAPSHOT~22535c74a4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (2.359 ms) : 2315, 2402
.   : milestone, 2359,
iast (2.139 ms) : 2083, 2195
.   : milestone, 2139,
iast_GLOBAL (2.177 ms) : 2121, 2233
.   : milestone, 2177,
profiling (2.006 ms) : 1961, 2051
.   : milestone, 2006,
tracing (1.962 ms) : 1919, 2005
.   : milestone, 1962,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (2.355 ms) : 2312, 2399
.   : milestone, 2355,
iast (2.127 ms) : 2071, 2183
.   : milestone, 2127,
iast_GLOBAL (2.175 ms) : 2119, 2231
.   : milestone, 2175,
profiling (1.998 ms) : 1952, 2043
.   : milestone, 1998,
tracing (1.954 ms) : 1911, 1996
.   : milestone, 1954,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 2.359 ms [2.315 ms, 2.402 ms] 880.738 µs (59.6%)
iast 2.139 ms [2.083 ms, 2.195 ms] 661.455 µs (44.8%)
iast_GLOBAL 2.177 ms [2.121 ms, 2.233 ms] 698.888 µs (47.3%)
profiling 2.006 ms [1.961 ms, 2.051 ms] 528.115 µs (35.7%)
tracing 1.962 ms [1.919 ms, 2.005 ms] 484.088 µs (32.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.491 ms] -
appsec 2.355 ms [2.312 ms, 2.399 ms] 875.875 µs (59.2%)
iast 2.127 ms [2.071 ms, 2.183 ms] 647.615 µs (43.8%)
iast_GLOBAL 2.175 ms [2.119 ms, 2.231 ms] 695.659 µs (47.0%)
profiling 1.998 ms [1.952 ms, 2.043 ms] 518.308 µs (35.0%)
tracing 1.954 ms [1.911 ms, 1.996 ms] 474.121 µs (32.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~87b0131427, baseline=1.49.0-SNAPSHOT~22535c74a4
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.312 s) : 15312000, 15312000
.   : milestone, 15312000,
appsec (14.934 s) : 14934000, 14934000
.   : milestone, 14934000,
iast (18.849 s) : 18849000, 18849000
.   : milestone, 18849000,
iast_GLOBAL (18.116 s) : 18116000, 18116000
.   : milestone, 18116000,
profiling (15.185 s) : 15185000, 15185000
.   : milestone, 15185000,
tracing (15.069 s) : 15069000, 15069000
.   : milestone, 15069000,
section candidate
no_agent (14.887 s) : 14887000, 14887000
.   : milestone, 14887000,
appsec (15.118 s) : 15118000, 15118000
.   : milestone, 15118000,
iast (19.081 s) : 19081000, 19081000
.   : milestone, 19081000,
iast_GLOBAL (18.023 s) : 18023000, 18023000
.   : milestone, 18023000,
profiling (14.967 s) : 14967000, 14967000
.   : milestone, 14967000,
tracing (15.044 s) : 15044000, 15044000
.   : milestone, 15044000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.312 s [15.312 s, 15.312 s] -
appsec 14.934 s [14.934 s, 14.934 s] -378.0 ms (-2.5%)
iast 18.849 s [18.849 s, 18.849 s] 3.537 s (23.1%)
iast_GLOBAL 18.116 s [18.116 s, 18.116 s] 2.804 s (18.3%)
profiling 15.185 s [15.185 s, 15.185 s] -127.0 ms (-0.8%)
tracing 15.069 s [15.069 s, 15.069 s] -243.0 ms (-1.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.887 s [14.887 s, 14.887 s] -
appsec 15.118 s [15.118 s, 15.118 s] 231.0 ms (1.6%)
iast 19.081 s [19.081 s, 19.081 s] 4.194 s (28.2%)
iast_GLOBAL 18.023 s [18.023 s, 18.023 s] 3.136 s (21.1%)
profiling 14.967 s [14.967 s, 14.967 s] 80.0 ms (0.5%)
tracing 15.044 s [15.044 s, 15.044 s] 157.0 ms (1.1%)

@MattAlp
Copy link
Contributor Author

MattAlp commented Apr 22, 2025

Re-associating this with PROF-11678

@MattAlp MattAlp mentioned this pull request Apr 22, 2025
Merged
7 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jbachorik jbachorik jbachorik approved these changes

@amarziali amarziali Awaiting requested review from amarziali amarziali is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: core Tracer core comp: profiling Profiling comp: telemetry Telemetry type: enhancement
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@MattAlp @jbachorik