Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[POC] Benchmark fingerprinting rules #8603

Closed
wants to merge 2 commits into from
Closed

[POC] Benchmark fingerprinting rules #8603

wants to merge 2 commits into from

Conversation

smola
Copy link
Member

@smola smola commented Mar 21, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@smola smola added tag: do not merge Do not merge changes comp: asm waf Application Security Management (WAF) labels Mar 21, 2025
@pr-commenter
Copy link

pr-commenter bot commented Mar 21, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/bench-fingerprint-rules
git_commit_date 1742566522 1742568737
git_commit_sha efdcea8 83a8c1a
release_version 1.48.0-SNAPSHOT~efdcea8304 1.48.0-SNAPSHOT~83a8c1aa46
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1742571846 1742571846
ci_job_id 859076567 859076567
ci_pipeline_id 59597716 59597716
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-8h5zseff-project-304-concurrent-0-y7n9ziua 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-8h5zseff-project-304-concurrent-0-y7n9ziua 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 2 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~83a8c1aa46, baseline=1.48.0-SNAPSHOT~efdcea8304

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1040348
Total [baseline] (10.439 s) : 0, 10439009
Agent [candidate] (1.042 s) : 0, 1042144
Total [candidate] (10.417 s) : 0, 10416957
section appsec
Agent [baseline] (1.187 s) : 0, 1186598
Total [baseline] (10.81 s) : 0, 10810255
Agent [candidate] (1.182 s) : 0, 1182368
Total [candidate] (10.728 s) : 0, 10728194
section iast
Agent [baseline] (1.174 s) : 0, 1173959
Total [baseline] (10.991 s) : 0, 10991112
Agent [candidate] (1.17 s) : 0, 1169732
Total [candidate] (11.002 s) : 0, 11001684
section profiling
Agent [baseline] (1.263 s) : 0, 1263140
Total [baseline] (10.838 s) : 0, 10838340
Agent [candidate] (1.258 s) : 0, 1258063
Total [candidate] (10.779 s) : 0, 10778685
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.187 s 146.25 ms (14.1%)
Agent iast 1.174 s 133.611 ms (12.8%)
Agent profiling 1.263 s 222.792 ms (21.4%)
Total tracing 10.439 s -
Total appsec 10.81 s 371.246 ms (3.6%)
Total iast 10.991 s 552.103 ms (5.3%)
Total profiling 10.838 s 399.331 ms (3.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent appsec 1.182 s 140.223 ms (13.5%)
Agent iast 1.17 s 127.587 ms (12.2%)
Agent profiling 1.258 s 215.919 ms (20.7%)
Total tracing 10.417 s -
Total appsec 10.728 s 311.237 ms (3.0%)
Total iast 11.002 s 584.728 ms (5.6%)
Total profiling 10.779 s 361.728 ms (3.5%) 
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~83a8c1aa46, baseline=1.48.0-SNAPSHOT~efdcea8304

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.792 ms) : 0, 717792
BytebuddyAgent [candidate] (718.087 ms) : 0, 718087
GlobalTracer [baseline] (238.977 ms) : 0, 238977
GlobalTracer [candidate] (239.753 ms) : 0, 239753
AppSec [baseline] (54.712 ms) : 0, 54712
AppSec [candidate] (54.659 ms) : 0, 54659
Remote Config [baseline] (687.098 µs) : 0, 687
Remote Config [candidate] (709.363 µs) : 0, 709
Telemetry [baseline] (12.22 ms) : 0, 12220
Telemetry [candidate] (12.962 ms) : 0, 12962
section appsec
BytebuddyAgent [baseline] (738.512 ms) : 0, 738512
BytebuddyAgent [candidate] (735.017 ms) : 0, 735017
GlobalTracer [baseline] (236.601 ms) : 0, 236601
GlobalTracer [candidate] (235.606 ms) : 0, 235606
AppSec [baseline] (175.802 ms) : 0, 175802
AppSec [candidate] (176.163 ms) : 0, 176163
Remote Config [baseline] (666.11 µs) : 0, 666
Remote Config [candidate] (669.184 µs) : 0, 669
Telemetry [baseline] (8.275 ms) : 0, 8275
Telemetry [candidate] (8.275 ms) : 0, 8275
IAST [baseline] (21.565 ms) : 0, 21565
IAST [candidate] (21.486 ms) : 0, 21486
section iast
BytebuddyAgent [baseline] (838.108 ms) : 0, 838108
BytebuddyAgent [candidate] (835.884 ms) : 0, 835884
GlobalTracer [baseline] (230.892 ms) : 0, 230892
GlobalTracer [candidate] (229.269 ms) : 0, 229269
AppSec [baseline] (56.519 ms) : 0, 56519
AppSec [candidate] (56.421 ms) : 0, 56421
Remote Config [baseline] (615.472 µs) : 0, 615
Remote Config [candidate] (628.206 µs) : 0, 628
Telemetry [baseline] (8.822 ms) : 0, 8822
Telemetry [candidate] (8.774 ms) : 0, 8774
IAST [baseline] (23.075 ms) : 0, 23075
IAST [candidate] (22.844 ms) : 0, 22844
section profiling
BytebuddyAgent [baseline] (711.657 ms) : 0, 711657
BytebuddyAgent [candidate] (708.189 ms) : 0, 708189
GlobalTracer [baseline] (349.555 ms) : 0, 349555
GlobalTracer [candidate] (349.337 ms) : 0, 349337
AppSec [baseline] (54.219 ms) : 0, 54219
AppSec [candidate] (53.165 ms) : 0, 53165
Remote Config [baseline] (709.218 µs) : 0, 709
Remote Config [candidate] (705.016 µs) : 0, 705
Telemetry [baseline] (8.867 ms) : 0, 8867
Telemetry [candidate] (8.874 ms) : 0, 8874
ProfilingAgent [baseline] (96.576 ms) : 0, 96576
ProfilingAgent [candidate] (96.414 ms) : 0, 96414
Profiling [baseline] (96.601 ms) : 0, 96601
Profiling [candidate] (96.439 ms) : 0, 96439
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~83a8c1aa46, baseline=1.48.0-SNAPSHOT~efdcea8304

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1048950
Total [baseline] (8.664 s) : 0, 8663754
Agent [candidate] (1.039 s) : 0, 1039411
Total [candidate] (8.662 s) : 0, 8661900
section iast
Agent [baseline] (1.169 s) : 0, 1169196
Total [baseline] (9.209 s) : 0, 9209036
Agent [candidate] (1.171 s) : 0, 1170804
Total [candidate] (9.225 s) : 0, 9225085
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.174 s) : 0, 1173950
Total [baseline] (9.197 s) : 0, 9197437
Agent [candidate] (1.173 s) : 0, 1172728
Total [candidate] (9.202 s) : 0, 9202365
section iast_TELEMETRY_OFF
Agent [baseline] (1.171 s) : 0, 1171066
Total [baseline] (9.188 s) : 0, 9187543
Agent [candidate] (1.174 s) : 0, 1173578
Total [candidate] (9.267 s) : 0, 9266642
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.169 s 120.246 ms (11.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.174 s 125.001 ms (11.9%)
Agent iast_TELEMETRY_OFF 1.171 s 122.116 ms (11.6%)
Total tracing 8.664 s -
Total iast 9.209 s 545.282 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.197 s 533.683 ms (6.2%)
Total iast_TELEMETRY_OFF 9.188 s 523.789 ms (6.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.039 s -
Agent iast 1.171 s 131.393 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.173 s 133.317 ms (12.8%)
Agent iast_TELEMETRY_OFF 1.174 s 134.168 ms (12.9%)
Total tracing 8.662 s -
Total iast 9.225 s 563.186 ms (6.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.202 s 540.466 ms (6.2%)
Total iast_TELEMETRY_OFF 9.267 s 604.743 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~83a8c1aa46, baseline=1.48.0-SNAPSHOT~efdcea8304

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (722.994 ms) : 0, 722994
BytebuddyAgent [candidate] (716.719 ms) : 0, 716719
GlobalTracer [baseline] (240.444 ms) : 0, 240444
GlobalTracer [candidate] (238.926 ms) : 0, 238926
AppSec [baseline] (55.003 ms) : 0, 55003
AppSec [candidate] (54.644 ms) : 0, 54644
Remote Config [baseline] (703.296 µs) : 0, 703
Remote Config [candidate] (696.145 µs) : 0, 696
Telemetry [baseline] (13.726 ms) : 0, 13726
Telemetry [candidate] (12.476 ms) : 0, 12476
section iast
BytebuddyAgent [baseline] (836.405 ms) : 0, 836405
BytebuddyAgent [candidate] (836.494 ms) : 0, 836494
GlobalTracer [baseline] (229.3 ms) : 0, 229300
GlobalTracer [candidate] (230.243 ms) : 0, 230243
AppSec [baseline] (55.597 ms) : 0, 55597
AppSec [candidate] (56.022 ms) : 0, 56022
Remote Config [baseline] (603.211 µs) : 0, 603
Remote Config [candidate] (605.971 µs) : 0, 606
Telemetry [baseline] (8.564 ms) : 0, 8564
Telemetry [candidate] (8.672 ms) : 0, 8672
IAST [baseline] (22.823 ms) : 0, 22823
IAST [candidate] (22.897 ms) : 0, 22897
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (840.657 ms) : 0, 840657
BytebuddyAgent [candidate] (837.94 ms) : 0, 837940
GlobalTracer [baseline] (229.744 ms) : 0, 229744
GlobalTracer [candidate] (230.71 ms) : 0, 230710
AppSec [baseline] (55.586 ms) : 0, 55586
AppSec [candidate] (55.912 ms) : 0, 55912
Remote Config [baseline] (615.961 µs) : 0, 616
Remote Config [candidate] (610.571 µs) : 0, 611
Telemetry [baseline] (8.572 ms) : 0, 8572
Telemetry [candidate] (8.622 ms) : 0, 8622
IAST [baseline] (22.753 ms) : 0, 22753
IAST [candidate] (22.977 ms) : 0, 22977
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (836.871 ms) : 0, 836871
BytebuddyAgent [candidate] (838.473 ms) : 0, 838473
GlobalTracer [baseline] (230.245 ms) : 0, 230245
GlobalTracer [candidate] (231.054 ms) : 0, 231054
AppSec [baseline] (56.17 ms) : 0, 56170
AppSec [candidate] (56.385 ms) : 0, 56385
Remote Config [baseline] (611.801 µs) : 0, 612
Remote Config [candidate] (614.325 µs) : 0, 614
Telemetry [baseline] (8.652 ms) : 0, 8652
Telemetry [candidate] (8.694 ms) : 0, 8694
IAST [baseline] (22.448 ms) : 0, 22448
IAST [candidate] (22.415 ms) : 0, 22415
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-21T15:18:05 2025-03-21T15:26:22
git_branch master smola/bench-fingerprint-rules
git_commit_date 1742566522 1742568737
git_commit_sha efdcea8 83a8c1a
release_version 1.48.0-SNAPSHOT~efdcea8304 1.48.0-SNAPSHOT~83a8c1aa46
start_time 2025-03-21T15:17:42 2025-03-21T15:25:59
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1742571205 1742571205
ci_job_id 859076568 859076568
ci_pipeline_id 59597716 59597716
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-kucxac5a-project-304-concurrent-0-b02atrmg 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-kucxac5a-project-304-concurrent-0-b02atrmg 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 18 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~83a8c1aa46, baseline=1.48.0-SNAPSHOT~efdcea8304
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.367 ms) : 1348, 1386
.   : milestone, 1367,
appsec (1.714 ms) : 1691, 1737
.   : milestone, 1714,
appsec_no_iast (1.739 ms) : 1715, 1763
.   : milestone, 1739,
code_origins (1.696 ms) : 1670, 1722
.   : milestone, 1696,
iast (1.505 ms) : 1481, 1529
.   : milestone, 1505,
profiling (1.497 ms) : 1473, 1521
.   : milestone, 1497,
tracing (1.503 ms) : 1479, 1527
.   : milestone, 1503,
section candidate
no_agent (1.36 ms) : 1341, 1380
.   : milestone, 1360,
appsec (1.763 ms) : 1740, 1786
.   : milestone, 1763,
appsec_no_iast (1.733 ms) : 1708, 1758
.   : milestone, 1733,
code_origins (1.672 ms) : 1645, 1699
.   : milestone, 1672,
iast (1.527 ms) : 1503, 1552
.   : milestone, 1527,
profiling (1.523 ms) : 1500, 1547
.   : milestone, 1523,
tracing (1.497 ms) : 1473, 1522
.   : milestone, 1497,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.367 ms [1.348 ms, 1.386 ms] -
appsec 1.714 ms [1.691 ms, 1.737 ms] 346.964 µs (25.4%)
appsec_no_iast 1.739 ms [1.715 ms, 1.763 ms] 372.165 µs (27.2%)
code_origins 1.696 ms [1.67 ms, 1.722 ms] 329.152 µs (24.1%)
iast 1.505 ms [1.481 ms, 1.529 ms] 138.065 µs (10.1%)
profiling 1.497 ms [1.473 ms, 1.521 ms] 129.852 µs (9.5%)
tracing 1.503 ms [1.479 ms, 1.527 ms] 136.434 µs (10.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.36 ms [1.341 ms, 1.38 ms] -
appsec 1.763 ms [1.74 ms, 1.786 ms] 402.5 µs (29.6%)
appsec_no_iast 1.733 ms [1.708 ms, 1.758 ms] 372.711 µs (27.4%)
code_origins 1.672 ms [1.645 ms, 1.699 ms] 311.394 µs (22.9%)
iast 1.527 ms [1.503 ms, 1.552 ms] 166.862 µs (12.3%)
profiling 1.523 ms [1.5 ms, 1.547 ms] 162.713 µs (12.0%)
tracing 1.497 ms [1.473 ms, 1.522 ms] 136.924 µs (10.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~83a8c1aa46, baseline=1.48.0-SNAPSHOT~efdcea8304
    dateFormat X
    axisFormat %s
section baseline
no_agent (385.197 µs) : 365, 405
.   : milestone, 385,
appsec (879.547 µs) : 857, 902
.   : milestone, 880,
iast (515.724 µs) : 494, 538
.   : milestone, 516,
iast_FULL (734.317 µs) : 712, 756
.   : milestone, 734,
iast_GLOBAL (553.567 µs) : 532, 575
.   : milestone, 554,
iast_HARDCODED_SECRET_DISABLED (511.8 µs) : 490, 533
.   : milestone, 512,
iast_INACTIVE (462.22 µs) : 441, 483
.   : milestone, 462,
iast_TELEMETRY_OFF (498.485 µs) : 477, 520
.   : milestone, 498,
tracing (459.493 µs) : 438, 481
.   : milestone, 459,
section candidate
no_agent (388.152 µs) : 367, 409
.   : milestone, 388,
appsec (888.423 µs) : 866, 911
.   : milestone, 888,
iast (508.246 µs) : 487, 530
.   : milestone, 508,
iast_FULL (740.548 µs) : 718, 763
.   : milestone, 741,
iast_GLOBAL (562.233 µs) : 540, 585
.   : milestone, 562,
iast_HARDCODED_SECRET_DISABLED (511.599 µs) : 490, 533
.   : milestone, 512,
iast_INACTIVE (456.14 µs) : 433, 479
.   : milestone, 456,
iast_TELEMETRY_OFF (499.03 µs) : 477, 521
.   : milestone, 499,
tracing (460.15 µs) : 440, 481
.   : milestone, 460,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 385.197 µs [365.416 µs, 404.978 µs] -
appsec 879.547 µs [857.199 µs, 901.894 µs] 494.35 µs (128.3%)
iast 515.724 µs [493.758 µs, 537.69 µs] 130.527 µs (33.9%)
iast_FULL 734.317 µs [712.264 µs, 756.37 µs] 349.12 µs (90.6%)
iast_GLOBAL 553.567 µs [531.694 µs, 575.441 µs] 168.37 µs (43.7%)
iast_HARDCODED_SECRET_DISABLED 511.8 µs [490.267 µs, 533.332 µs] 126.603 µs (32.9%)
iast_INACTIVE 462.22 µs [441.275 µs, 483.165 µs] 77.023 µs (20.0%)
iast_TELEMETRY_OFF 498.485 µs [476.98 µs, 519.99 µs] 113.288 µs (29.4%)
tracing 459.493 µs [438.361 µs, 480.625 µs] 74.296 µs (19.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 388.152 µs [367.393 µs, 408.912 µs] -
appsec 888.423 µs [866.203 µs, 910.643 µs] 500.271 µs (128.9%)
iast 508.246 µs [486.566 µs, 529.926 µs] 120.094 µs (30.9%)
iast_FULL 740.548 µs [718.29 µs, 762.806 µs] 352.396 µs (90.8%)
iast_GLOBAL 562.233 µs [539.773 µs, 584.693 µs] 174.081 µs (44.8%)
iast_HARDCODED_SECRET_DISABLED 511.599 µs [490.035 µs, 533.162 µs] 123.446 µs (31.8%)
iast_INACTIVE 456.14 µs [433.103 µs, 479.177 µs] 67.988 µs (17.5%)
iast_TELEMETRY_OFF 499.03 µs [477.481 µs, 520.579 µs] 110.878 µs (28.6%)
tracing 460.15 µs [439.527 µs, 480.774 µs] 71.998 µs (18.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/bench-fingerprint-rules
git_commit_date 1742566522 1742568737
git_commit_sha efdcea8 83a8c1a
release_version 1.48.0-SNAPSHOT~efdcea8304 1.48.0-SNAPSHOT~83a8c1aa46
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1742571387 1742571387
ci_job_id 859076569 859076569
ci_pipeline_id 59597716 59597716
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-8h5zseff-project-304-concurrent-1-jc1fx6lq 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-8h5zseff-project-304-concurrent-1-jc1fx6lq 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~83a8c1aa46, baseline=1.48.0-SNAPSHOT~efdcea8304
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.614 s) : 15614000, 15614000
.   : milestone, 15614000,
appsec (15.044 s) : 15044000, 15044000
.   : milestone, 15044000,
iast (18.326 s) : 18326000, 18326000
.   : milestone, 18326000,
iast_GLOBAL (17.919 s) : 17919000, 17919000
.   : milestone, 17919000,
profiling (15.186 s) : 15186000, 15186000
.   : milestone, 15186000,
tracing (14.968 s) : 14968000, 14968000
.   : milestone, 14968000,
section candidate
no_agent (15.289 s) : 15289000, 15289000
.   : milestone, 15289000,
appsec (15.049 s) : 15049000, 15049000
.   : milestone, 15049000,
iast (18.46 s) : 18460000, 18460000
.   : milestone, 18460000,
iast_GLOBAL (17.989 s) : 17989000, 17989000
.   : milestone, 17989000,
profiling (14.944 s) : 14944000, 14944000
.   : milestone, 14944000,
tracing (14.995 s) : 14995000, 14995000
.   : milestone, 14995000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.614 s [15.614 s, 15.614 s] -
appsec 15.044 s [15.044 s, 15.044 s] -570.0 ms (-3.7%)
iast 18.326 s [18.326 s, 18.326 s] 2.712 s (17.4%)
iast_GLOBAL 17.919 s [17.919 s, 17.919 s] 2.305 s (14.8%)
profiling 15.186 s [15.186 s, 15.186 s] -428.0 ms (-2.7%)
tracing 14.968 s [14.968 s, 14.968 s] -646.0 ms (-4.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.289 s [15.289 s, 15.289 s] -
appsec 15.049 s [15.049 s, 15.049 s] -240.0 ms (-1.6%)
iast 18.46 s [18.46 s, 18.46 s] 3.171 s (20.7%)
iast_GLOBAL 17.989 s [17.989 s, 17.989 s] 2.7 s (17.7%)
profiling 14.944 s [14.944 s, 14.944 s] -345.0 ms (-2.3%)
tracing 14.995 s [14.995 s, 14.995 s] -294.0 ms (-1.9%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~83a8c1aa46, baseline=1.48.0-SNAPSHOT~efdcea8304
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (2.341 ms) : 2298, 2385
.   : milestone, 2341,
iast (2.119 ms) : 2063, 2175
.   : milestone, 2119,
iast_GLOBAL (2.16 ms) : 2104, 2216
.   : milestone, 2160,
profiling (1.973 ms) : 1929, 2017
.   : milestone, 1973,
tracing (1.946 ms) : 1904, 1988
.   : milestone, 1946,
section candidate
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (2.375 ms) : 2331, 2420
.   : milestone, 2375,
iast (2.12 ms) : 2064, 2176
.   : milestone, 2120,
iast_GLOBAL (2.164 ms) : 2108, 2221
.   : milestone, 2164,
profiling (1.962 ms) : 1918, 2006
.   : milestone, 1962,
tracing (1.951 ms) : 1908, 1994
.   : milestone, 1951,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.456 ms, 1.479 ms] -
appsec 2.341 ms [2.298 ms, 2.385 ms] 874.032 µs (59.6%)
iast 2.119 ms [2.063 ms, 2.175 ms] 651.797 µs (44.4%)
iast_GLOBAL 2.16 ms [2.104 ms, 2.216 ms] 692.268 µs (47.2%)
profiling 1.973 ms [1.929 ms, 2.017 ms] 505.821 µs (34.5%)
tracing 1.946 ms [1.904 ms, 1.988 ms] 478.67 µs (32.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 2.375 ms [2.331 ms, 2.42 ms] 906.948 µs (61.8%)
iast 2.12 ms [2.064 ms, 2.176 ms] 651.151 µs (44.3%)
iast_GLOBAL 2.164 ms [2.108 ms, 2.221 ms] 695.754 µs (47.4%)
profiling 1.962 ms [1.918 ms, 2.006 ms] 493.207 µs (33.6%)
tracing 1.951 ms [1.908 ms, 1.994 ms] 482.695 µs (32.9%)

@smola smola force-pushed the smola/bench-fingerprint-rules branch from b652928 to 83a8c1a Compare March 21, 2025 14:52
@smola smola closed this Mar 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
comp: asm waf Application Security Management (WAF) tag: do not merge Do not merge changes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@smola