Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use jvmstat for JDKs 9+ programmatically #8641

Draft
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

MattAlp
Copy link
Contributor

@MattAlp MattAlp commented Mar 28, 2025

What Does This Do

This PR begins the process of deprecating the use of jps via a subprocess, accomplished by exposing the jvmstat code used by jps under the hood using module patching (for JDKs 9+).

Motivation

Customer machines often come without tools like jps available, causing cleanup related-tasks to fail.

Additional Notes

Contributor Checklist

Jira ticket: PROF-11290

@pr-commenter
Copy link

pr-commenter bot commented Mar 28, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/patch-jvmstat-access
git_commit_date 1743177610 1743193735
git_commit_sha 2a848ef 9c0bcf5
release_version 1.48.0-SNAPSHOT~2a848ef2e2 1.48.0-SNAPSHOT~9c0bcf5efc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743196607 1743196607
ci_job_id 871120585 871120585
ci_pipeline_id 60407890 60407890
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-rewukxas-project-304-concurrent-0-pr3p1yjb 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-rewukxas-project-304-concurrent-0-pr3p1yjb 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 66 metrics, 5 unstable metrics.

Startup time reports for petclinic
Loading
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~9c0bcf5efc, baseline=1.48.0-SNAPSHOT~2a848ef2e2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.05 s) : 0, 1049538
Total [baseline] (10.519 s) : 0, 10519169
Agent [candidate] (1.051 s) : 0, 1051150
Total [candidate] (10.514 s) : 0, 10514347
section appsec
Agent [baseline] (1.194 s) : 0, 1193832
Total [baseline] (10.707 s) : 0, 10706928
Agent [candidate] (1.193 s) : 0, 1193050
Total [candidate] (10.804 s) : 0, 10803630
section iast
Agent [baseline] (1.178 s) : 0, 1178192
Total [baseline] (11.014 s) : 0, 11014452
Agent [candidate] (1.18 s) : 0, 1179626
Total [candidate] (10.985 s) : 0, 10985303
section profiling
Agent [baseline] (1.28 s) : 0, 1279653
Total [baseline] (10.836 s) : 0, 10836477
Agent [candidate] (1.297 s) : 0, 1297443
Total [candidate] (10.948 s) : 0, 10948486
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent appsec 1.194 s 144.293 ms (13.7%)
Agent iast 1.178 s 128.653 ms (12.3%)
Agent profiling 1.28 s 230.114 ms (21.9%)
Total tracing 10.519 s -
Total appsec 10.707 s 187.76 ms (1.8%)
Total iast 11.014 s 495.283 ms (4.7%)
Total profiling 10.836 s 317.308 ms (3.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent appsec 1.193 s 141.901 ms (13.5%)
Agent iast 1.18 s 128.476 ms (12.2%)
Agent profiling 1.297 s 246.293 ms (23.4%)
Total tracing 10.514 s -
Total appsec 10.804 s 289.283 ms (2.8%)
Total iast 10.985 s 470.956 ms (4.5%)
Total profiling 10.948 s 434.139 ms (4.1%)
Loading
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~9c0bcf5efc, baseline=1.48.0-SNAPSHOT~2a848ef2e2

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.4 ms) : 0, 717400
BytebuddyAgent [candidate] (715.822 ms) : 0, 715822
GlobalTracer [baseline] (238.592 ms) : 0, 238592
GlobalTracer [candidate] (239.595 ms) : 0, 239595
AppSec [baseline] (54.205 ms) : 0, 54205
AppSec [candidate] (56.001 ms) : 0, 56001
Debugger [baseline] (4.432 ms) : 0, 4432
Debugger [candidate] (4.393 ms) : 0, 4393
Remote Config [baseline] (691.2 µs) : 0, 691
Remote Config [candidate] (708.049 µs) : 0, 708
Telemetry [baseline] (13.661 ms) : 0, 13661
Telemetry [candidate] (12.209 ms) : 0, 12209
section appsec
BytebuddyAgent [baseline] (737.586 ms) : 0, 737586
BytebuddyAgent [candidate] (737.168 ms) : 0, 737168
GlobalTracer [baseline] (235.09 ms) : 0, 235090
GlobalTracer [candidate] (237.318 ms) : 0, 237318
IAST [baseline] (21.583 ms) : 0, 21583
IAST [candidate] (21.819 ms) : 0, 21819
AppSec [baseline] (176.01 ms) : 0, 176010
AppSec [candidate] (171.649 ms) : 0, 171649
Debugger [baseline] (4.288 ms) : 0, 4288
Debugger [candidate] (4.682 ms) : 0, 4682
Remote Config [baseline] (645.84 µs) : 0, 646
Remote Config [candidate] (655.346 µs) : 0, 655
Telemetry [baseline] (8.917 ms) : 0, 8917
Telemetry [candidate] (8.191 ms) : 0, 8191
section iast
BytebuddyAgent [baseline] (836.277 ms) : 0, 836277
BytebuddyAgent [candidate] (834.995 ms) : 0, 834995
GlobalTracer [baseline] (228.889 ms) : 0, 228889
GlobalTracer [candidate] (230.692 ms) : 0, 230692
IAST [baseline] (22.755 ms) : 0, 22755
IAST [candidate] (22.763 ms) : 0, 22763
AppSec [baseline] (56.181 ms) : 0, 56181
AppSec [candidate] (55.139 ms) : 0, 55139
Debugger [baseline] (4.176 ms) : 0, 4176
Debugger [candidate] (4.286 ms) : 0, 4286
Remote Config [baseline] (619.719 µs) : 0, 620
Remote Config [candidate] (614.657 µs) : 0, 615
Telemetry [baseline] (8.82 ms) : 0, 8820
Telemetry [candidate] (8.773 ms) : 0, 8773
section profiling
BytebuddyAgent [baseline] (714.742 ms) : 0, 714742
BytebuddyAgent [candidate] (721.247 ms) : 0, 721247
GlobalTracer [baseline] (348.64 ms) : 0, 348640
GlobalTracer [candidate] (356.008 ms) : 0, 356008
AppSec [baseline] (53.93 ms) : 0, 53930
AppSec [candidate] (54.614 ms) : 0, 54614
Debugger [baseline] (4.327 ms) : 0, 4327
Debugger [candidate] (4.406 ms) : 0, 4406
Remote Config [baseline] (691.889 µs) : 0, 692
Remote Config [candidate] (725.38 µs) : 0, 725
Telemetry [baseline] (9.048 ms) : 0, 9048
Telemetry [candidate] (9.165 ms) : 0, 9165
ProfilingAgent [baseline] (102.299 ms) : 0, 102299
ProfilingAgent [candidate] (103.17 ms) : 0, 103170
Profiling [baseline] (102.324 ms) : 0, 102324
Profiling [candidate] (103.195 ms) : 0, 103195
Startup time reports for insecure-bank
Loading
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~9c0bcf5efc, baseline=1.48.0-SNAPSHOT~2a848ef2e2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1061406
Total [baseline] (8.701 s) : 0, 8700880
Agent [candidate] (1.05 s) : 0, 1050051
Total [candidate] (8.662 s) : 0, 8661816
section iast
Agent [baseline] (1.176 s) : 0, 1176447
Total [baseline] (9.26 s) : 0, 9259871
Agent [candidate] (1.182 s) : 0, 1181794
Total [candidate] (9.29 s) : 0, 9290497
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.184 s) : 0, 1184301
Total [baseline] (9.227 s) : 0, 9226662
Agent [candidate] (1.186 s) : 0, 1186386
Total [candidate] (9.249 s) : 0, 9248616
section iast_TELEMETRY_OFF
Agent [baseline] (1.18 s) : 0, 1179869
Total [baseline] (9.265 s) : 0, 9264962
Agent [candidate] (1.178 s) : 0, 1177893
Total [candidate] (9.268 s) : 0, 9267898
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.176 s 115.041 ms (10.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.184 s 122.895 ms (11.6%)
Agent iast_TELEMETRY_OFF 1.18 s 118.463 ms (11.2%)
Total tracing 8.701 s -
Total iast 9.26 s 558.992 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.227 s 525.782 ms (6.0%)
Total iast_TELEMETRY_OFF 9.265 s 564.083 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent iast 1.182 s 131.743 ms (12.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.186 s 136.335 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.178 s 127.842 ms (12.2%)
Total tracing 8.662 s -
Total iast 9.29 s 628.681 ms (7.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.249 s 586.8 ms (6.8%)
Total iast_TELEMETRY_OFF 9.268 s 606.082 ms (7.0%)
Loading
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~9c0bcf5efc, baseline=1.48.0-SNAPSHOT~2a848ef2e2

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (725.815 ms) : 0, 725815
BytebuddyAgent [candidate] (716.59 ms) : 0, 716590
GlobalTracer [baseline] (241.371 ms) : 0, 241371
GlobalTracer [candidate] (239.307 ms) : 0, 239307
AppSec [baseline] (55.449 ms) : 0, 55449
AppSec [candidate] (54.347 ms) : 0, 54347
Debugger [baseline] (5.223 ms) : 0, 5223
Debugger [candidate] (4.429 ms) : 0, 4429
Remote Config [baseline] (692.31 µs) : 0, 692
Remote Config [candidate] (730.152 µs) : 0, 730
Telemetry [baseline] (12.163 ms) : 0, 12163
Telemetry [candidate] (12.269 ms) : 0, 12269
section iast
BytebuddyAgent [baseline] (835.895 ms) : 0, 835895
BytebuddyAgent [candidate] (836.142 ms) : 0, 836142
GlobalTracer [baseline] (228.204 ms) : 0, 228204
GlobalTracer [candidate] (230.705 ms) : 0, 230705
IAST [baseline] (22.773 ms) : 0, 22773
IAST [candidate] (22.953 ms) : 0, 22953
AppSec [baseline] (55.397 ms) : 0, 55397
AppSec [candidate] (55.892 ms) : 0, 55892
Debugger [baseline] (4.193 ms) : 0, 4193
Debugger [candidate] (4.331 ms) : 0, 4331
Remote Config [baseline] (613.788 µs) : 0, 614
Remote Config [candidate] (629.908 µs) : 0, 630
Telemetry [baseline] (8.832 ms) : 0, 8832
Telemetry [candidate] (8.817 ms) : 0, 8817
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (841.667 ms) : 0, 841667
BytebuddyAgent [candidate] (840.796 ms) : 0, 840796
GlobalTracer [baseline] (229.663 ms) : 0, 229663
GlobalTracer [candidate] (231.229 ms) : 0, 231229
IAST [baseline] (22.971 ms) : 0, 22971
IAST [candidate] (22.908 ms) : 0, 22908
AppSec [baseline] (55.811 ms) : 0, 55811
AppSec [candidate] (55.384 ms) : 0, 55384
Debugger [baseline] (4.173 ms) : 0, 4173
Debugger [candidate] (4.251 ms) : 0, 4251
Remote Config [baseline] (607.645 µs) : 0, 608
Remote Config [candidate] (615.799 µs) : 0, 616
Telemetry [baseline] (8.914 ms) : 0, 8914
Telemetry [candidate] (8.73 ms) : 0, 8730
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (838.566 ms) : 0, 838566
BytebuddyAgent [candidate] (832.988 ms) : 0, 832988
GlobalTracer [baseline] (228.984 ms) : 0, 228984
GlobalTracer [candidate] (230.365 ms) : 0, 230365
IAST [baseline] (22.493 ms) : 0, 22493
IAST [candidate] (22.485 ms) : 0, 22485
AppSec [baseline] (55.829 ms) : 0, 55829
AppSec [candidate] (56.023 ms) : 0, 56023
Debugger [baseline] (4.183 ms) : 0, 4183
Debugger [candidate] (4.218 ms) : 0, 4218
Remote Config [baseline] (617.295 µs) : 0, 617
Remote Config [candidate] (623.704 µs) : 0, 624
Telemetry [baseline] (8.719 ms) : 0, 8719
Telemetry [candidate] (8.8 ms) : 0, 8800

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-28T20:49:02 2025-03-28T20:56:44
git_branch master mattalp/patch-jvmstat-access
git_commit_date 1743177610 1743193735
git_commit_sha 2a848ef 9c0bcf5
release_version 1.48.0-SNAPSHOT~2a848ef2e2 1.48.0-SNAPSHOT~9c0bcf5efc
start_time 2025-03-28T20:48:48 2025-03-28T20:56:30
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743195800 1743195800
ci_job_id 871120586 871120586
ci_pipeline_id 60407890 60407890
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-rewukxas-project-304-concurrent-1-h5cgcgmq 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-rewukxas-project-304-concurrent-1-h5cgcgmq 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic
Loading
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~9c0bcf5efc, baseline=1.48.0-SNAPSHOT~2a848ef2e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.35 ms) : 1329, 1370
.   : milestone, 1350,
appsec (1.737 ms) : 1713, 1762
.   : milestone, 1737,
appsec_no_iast (1.72 ms) : 1696, 1744
.   : milestone, 1720,
code_origins (1.666 ms) : 1639, 1692
.   : milestone, 1666,
iast (1.5 ms) : 1476, 1523
.   : milestone, 1500,
profiling (1.511 ms) : 1488, 1534
.   : milestone, 1511,
tracing (1.492 ms) : 1467, 1516
.   : milestone, 1492,
section candidate
no_agent (1.363 ms) : 1343, 1382
.   : milestone, 1363,
appsec (1.725 ms) : 1701, 1748
.   : milestone, 1725,
appsec_no_iast (1.736 ms) : 1713, 1759
.   : milestone, 1736,
code_origins (1.674 ms) : 1647, 1701
.   : milestone, 1674,
iast (1.499 ms) : 1475, 1523
.   : milestone, 1499,
profiling (1.539 ms) : 1514, 1564
.   : milestone, 1539,
tracing (1.492 ms) : 1467, 1517
.   : milestone, 1492,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.35 ms [1.329 ms, 1.37 ms] -
appsec 1.737 ms [1.713 ms, 1.762 ms] 387.748 µs (28.7%)
appsec_no_iast 1.72 ms [1.696 ms, 1.744 ms] 370.339 µs (27.4%)
code_origins 1.666 ms [1.639 ms, 1.692 ms] 315.979 µs (23.4%)
iast 1.5 ms [1.476 ms, 1.523 ms] 149.922 µs (11.1%)
profiling 1.511 ms [1.488 ms, 1.534 ms] 161.135 µs (11.9%)
tracing 1.492 ms [1.467 ms, 1.516 ms] 142.004 µs (10.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.363 ms [1.343 ms, 1.382 ms] -
appsec 1.725 ms [1.701 ms, 1.748 ms] 361.885 µs (26.6%)
appsec_no_iast 1.736 ms [1.713 ms, 1.759 ms] 373.24 µs (27.4%)
code_origins 1.674 ms [1.647 ms, 1.701 ms] 311.255 µs (22.8%)
iast 1.499 ms [1.475 ms, 1.523 ms] 136.13 µs (10.0%)
profiling 1.539 ms [1.514 ms, 1.564 ms] 176.026 µs (12.9%)
tracing 1.492 ms [1.467 ms, 1.517 ms] 128.931 µs (9.5%)
Request duration reports for insecure-bank
Loading
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~9c0bcf5efc, baseline=1.48.0-SNAPSHOT~2a848ef2e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.282 µs) : 358, 399
.   : milestone, 378,
iast (507.482 µs) : 485, 529
.   : milestone, 507,
iast_FULL (727.782 µs) : 706, 750
.   : milestone, 728,
iast_GLOBAL (550.638 µs) : 529, 572
.   : milestone, 551,
iast_HARDCODED_SECRET_DISABLED (509.881 µs) : 488, 531
.   : milestone, 510,
iast_INACTIVE (454.308 µs) : 433, 475
.   : milestone, 454,
iast_TELEMETRY_OFF (493.073 µs) : 471, 515
.   : milestone, 493,
tracing (455.37 µs) : 434, 477
.   : milestone, 455,
section candidate
no_agent (378.997 µs) : 359, 399
.   : milestone, 379,
iast (511.479 µs) : 490, 533
.   : milestone, 511,
iast_FULL (720.95 µs) : 699, 743
.   : milestone, 721,
iast_GLOBAL (552.82 µs) : 531, 574
.   : milestone, 553,
iast_HARDCODED_SECRET_DISABLED (504.328 µs) : 483, 526
.   : milestone, 504,
iast_INACTIVE (459.348 µs) : 438, 481
.   : milestone, 459,
iast_TELEMETRY_OFF (501.202 µs) : 479, 523
.   : milestone, 501,
tracing (456.7 µs) : 436, 478
.   : milestone, 457,
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.282 µs [357.633 µs, 398.93 µs] -
iast 507.482 µs [485.494 µs, 529.47 µs] 129.2 µs (34.2%)
iast_FULL 727.782 µs [705.754 µs, 749.809 µs] 349.5 µs (92.4%)
iast_GLOBAL 550.638 µs [528.851 µs, 572.424 µs] 172.356 µs (45.6%)
iast_HARDCODED_SECRET_DISABLED 509.881 µs [488.312 µs, 531.45 µs] 131.599 µs (34.8%)
iast_INACTIVE 454.308 µs [433.158 µs, 475.459 µs] 76.027 µs (20.1%)
iast_TELEMETRY_OFF 493.073 µs [471.425 µs, 514.72 µs] 114.791 µs (30.3%)
tracing 455.37 µs [434.059 µs, 476.681 µs] 77.088 µs (20.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.997 µs [359.41 µs, 398.584 µs] -
iast 511.479 µs [489.642 µs, 533.316 µs] 132.482 µs (35.0%)
iast_FULL 720.95 µs [699.13 µs, 742.771 µs] 341.954 µs (90.2%)
iast_GLOBAL 552.82 µs [531.201 µs, 574.438 µs] 173.823 µs (45.9%)
iast_HARDCODED_SECRET_DISABLED 504.328 µs [482.601 µs, 526.055 µs] 125.331 µs (33.1%)
iast_INACTIVE 459.348 µs [438.154 µs, 480.542 µs] 80.351 µs (21.2%)
iast_TELEMETRY_OFF 501.202 µs [478.905 µs, 523.499 µs] 122.205 µs (32.2%)
tracing 456.7 µs [435.612 µs, 477.788 µs] 77.703 µs (20.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/patch-jvmstat-access
git_commit_date 1743177610 1743193735
git_commit_sha 2a848ef 9c0bcf5
release_version 1.48.0-SNAPSHOT~2a848ef2e2 1.48.0-SNAPSHOT~9c0bcf5efc
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1743196142 1743196142
ci_job_id 871120587 871120587
ci_pipeline_id 60407890 60407890
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xjcpkyqs-project-304-concurrent-0-j36sxkyg 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xjcpkyqs-project-304-concurrent-0-j36sxkyg 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
Loading
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~9c0bcf5efc, baseline=1.48.0-SNAPSHOT~2a848ef2e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.345 ms) : 2301, 2389
.   : milestone, 2345,
iast (2.117 ms) : 2061, 2173
.   : milestone, 2117,
iast_GLOBAL (2.163 ms) : 2107, 2219
.   : milestone, 2163,
profiling (1.977 ms) : 1932, 2021
.   : milestone, 1977,
tracing (1.962 ms) : 1919, 2005
.   : milestone, 1962,
section candidate
no_agent (1.469 ms) : 1458, 1481
.   : milestone, 1469,
appsec (2.34 ms) : 2296, 2384
.   : milestone, 2340,
iast (2.13 ms) : 2074, 2186
.   : milestone, 2130,
iast_GLOBAL (2.178 ms) : 2121, 2235
.   : milestone, 2178,
profiling (1.985 ms) : 1940, 2030
.   : milestone, 1985,
tracing (1.957 ms) : 1913, 2000
.   : milestone, 1957,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 2.345 ms [2.301 ms, 2.389 ms] 872.621 µs (59.3%)
iast 2.117 ms [2.061 ms, 2.173 ms] 644.292 µs (43.7%)
iast_GLOBAL 2.163 ms [2.107 ms, 2.219 ms] 690.236 µs (46.9%)
profiling 1.977 ms [1.932 ms, 2.021 ms] 504.133 µs (34.2%)
tracing 1.962 ms [1.919 ms, 2.005 ms] 489.53 µs (33.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.481 ms] -
appsec 2.34 ms [2.296 ms, 2.384 ms] 870.312 µs (59.2%)
iast 2.13 ms [2.074 ms, 2.186 ms] 660.267 µs (44.9%)
iast_GLOBAL 2.178 ms [2.121 ms, 2.235 ms] 708.505 µs (48.2%)
profiling 1.985 ms [1.94 ms, 2.03 ms] 515.894 µs (35.1%)
tracing 1.957 ms [1.913 ms, 2.0 ms] 487.243 µs (33.2%)
Execution time for biojava
Loading
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~9c0bcf5efc, baseline=1.48.0-SNAPSHOT~2a848ef2e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.912 s) : 14912000, 14912000
.   : milestone, 14912000,
appsec (14.811 s) : 14811000, 14811000
.   : milestone, 14811000,
iast (18.844 s) : 18844000, 18844000
.   : milestone, 18844000,
iast_GLOBAL (18.107 s) : 18107000, 18107000
.   : milestone, 18107000,
profiling (15.006 s) : 15006000, 15006000
.   : milestone, 15006000,
tracing (15.283 s) : 15283000, 15283000
.   : milestone, 15283000,
section candidate
no_agent (15.36 s) : 15360000, 15360000
.   : milestone, 15360000,
appsec (15.095 s) : 15095000, 15095000
.   : milestone, 15095000,
iast (19.015 s) : 19015000, 19015000
.   : milestone, 19015000,
iast_GLOBAL (17.912 s) : 17912000, 17912000
.   : milestone, 17912000,
profiling (15.205 s) : 15205000, 15205000
.   : milestone, 15205000,
tracing (14.96 s) : 14960000, 14960000
.   : milestone, 14960000,
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.912 s [14.912 s, 14.912 s] -
appsec 14.811 s [14.811 s, 14.811 s] -101.0 ms (-0.7%)
iast 18.844 s [18.844 s, 18.844 s] 3.932 s (26.4%)
iast_GLOBAL 18.107 s [18.107 s, 18.107 s] 3.195 s (21.4%)
profiling 15.006 s [15.006 s, 15.006 s] 94.0 ms (0.6%)
tracing 15.283 s [15.283 s, 15.283 s] 371.0 ms (2.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.36 s [15.36 s, 15.36 s] -
appsec 15.095 s [15.095 s, 15.095 s] -265.0 ms (-1.7%)
iast 19.015 s [19.015 s, 19.015 s] 3.655 s (23.8%)
iast_GLOBAL 17.912 s [17.912 s, 17.912 s] 2.552 s (16.6%)
profiling 15.205 s [15.205 s, 15.205 s] -155.0 ms (-1.0%)
tracing 14.96 s [14.96 s, 14.96 s] -400.0 ms (-2.6%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant