Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

experiment with openlineage spark #8626

Closed
wants to merge 6 commits into from
Closed

experiment with openlineage spark #8626

wants to merge 6 commits into from
+474 −24

Conversation

mobuchowski
Copy link
Contributor

PR for running CI for branch

@mobuchowski
set OL if detected
52438a5 
Signed-off-by: Maciej Obuchowski <[email protected]>

add OL instrumentation class

Signed-off-by: Maciej Obuchowski <[email protected]>

take care of sparkconf/ol lifecycle

Signed-off-by: Maciej Obuchowski <[email protected]>
@mobuchowski
use predetermined trace ids
866a408 
Signed-off-by: Maciej Obuchowski <[email protected]>
@mobuchowski
stop injecting OL if it's not available
ed3e99d 
Signed-off-by: Maciej Obuchowski <[email protected]>
@mobuchowski
disable OL injection without config
ccd94f3 
Signed-off-by: Maciej Obuchowski <[email protected]>
@mobuchowski
add config variable to determine whether enable ol injection
1c43c96 
Signed-off-by: Maciej Obuchowski <[email protected]>
@mobuchowski mobuchowski added the tag: do not merge Do not merge changes label Mar 27, 2025
@pr-commenter
Copy link

pr-commenter bot commented Mar 27, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mobuchowski/openlineage-tracer-test
git_commit_date 1743401885 1743410634
git_commit_sha 7580e7b 95b0529
release_version 1.48.0-SNAPSHOT~7580e7bc62 1.48.0-SNAPSHOT~95b0529aad
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743413783 1743413783
ci_job_id 871871405 871871405
ci_pipeline_id 60477797 60477797
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xjcpkyqs-project-304-concurrent-0-73eempgo 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xjcpkyqs-project-304-concurrent-0-73eempgo 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 5 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Remote Config better
[-82.324µs; -19.287µs] or [-12.755%; -2.988%]		 594.641µs 645.446µs
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Remote Config better
[-52.323µs; -17.065µs] or [-8.428%; -2.749%]		 586.117µs 620.811µs
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~95b0529aad, baseline=1.48.0-SNAPSHOT~7580e7bc62

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058478
Total [baseline] (8.717 s) : 0, 8716619
Agent [candidate] (1.066 s) : 0, 1065934
Total [candidate] (8.725 s) : 0, 8724560
section iast
Agent [baseline] (1.188 s) : 0, 1188344
Total [baseline] (9.267 s) : 0, 9266999
Agent [candidate] (1.179 s) : 0, 1178936
Total [candidate] (9.235 s) : 0, 9235150
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.18 s) : 0, 1179918
Total [baseline] (9.2 s) : 0, 9199994
Agent [candidate] (1.18 s) : 0, 1180351
Total [candidate] (9.26 s) : 0, 9260245
section iast_TELEMETRY_OFF
Agent [baseline] (1.186 s) : 0, 1186158
Total [baseline] (9.25 s) : 0, 9249765
Agent [candidate] (1.181 s) : 0, 1181233
Total [candidate] (9.274 s) : 0, 9273775
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.188 s 129.866 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 121.44 ms (11.5%)
Agent iast_TELEMETRY_OFF 1.186 s 127.68 ms (12.1%)
Total tracing 8.717 s -
Total iast 9.267 s 550.38 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.2 s 483.375 ms (5.5%)
Total iast_TELEMETRY_OFF 9.25 s 533.146 ms (6.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.179 s 113.002 ms (10.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 114.417 ms (10.7%)
Agent iast_TELEMETRY_OFF 1.181 s 115.299 ms (10.8%)
Total tracing 8.725 s -
Total iast 9.235 s 510.59 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.26 s 535.686 ms (6.1%)
Total iast_TELEMETRY_OFF 9.274 s 549.215 ms (6.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~95b0529aad, baseline=1.48.0-SNAPSHOT~7580e7bc62

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (723.315 ms) : 0, 723315
BytebuddyAgent [candidate] (729.157 ms) : 0, 729157
GlobalTracer [baseline] (240.754 ms) : 0, 240754
GlobalTracer [candidate] (244.052 ms) : 0, 244052
AppSec [baseline] (55.514 ms) : 0, 55514
AppSec [candidate] (55.986 ms) : 0, 55986
Debugger [baseline] (4.525 ms) : 0, 4525
Debugger [candidate] (4.496 ms) : 0, 4496
Remote Config [baseline] (768.97 µs) : 0, 769
Remote Config [candidate] (758.636 µs) : 0, 759
Telemetry [baseline] (12.802 ms) : 0, 12802
Telemetry [candidate] (15.241 ms) : 0, 15241
section iast
BytebuddyAgent [baseline] (844.124 ms) : 0, 844124
BytebuddyAgent [candidate] (839.577 ms) : 0, 839577
GlobalTracer [baseline] (230.197 ms) : 0, 230197
GlobalTracer [candidate] (230.95 ms) : 0, 230950
IAST [baseline] (23.162 ms) : 0, 23162
IAST [candidate] (22.802 ms) : 0, 22802
AppSec [baseline] (56.479 ms) : 0, 56479
AppSec [candidate] (56.048 ms) : 0, 56048
Debugger [baseline] (4.244 ms) : 0, 4244
Debugger [candidate] (4.161 ms) : 0, 4161
Remote Config [baseline] (645.446 µs) : 0, 645
Remote Config [candidate] (594.641 µs) : 0, 595
Telemetry [baseline] (8.879 ms) : 0, 8879
Telemetry [candidate] (8.812 ms) : 0, 8812
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (837.267 ms) : 0, 837267
BytebuddyAgent [candidate] (841.01 ms) : 0, 841010
GlobalTracer [baseline] (229.401 ms) : 0, 229401
GlobalTracer [candidate] (231.268 ms) : 0, 231268
IAST [baseline] (22.965 ms) : 0, 22965
IAST [candidate] (22.825 ms) : 0, 22825
AppSec [baseline] (56.058 ms) : 0, 56058
AppSec [candidate] (55.791 ms) : 0, 55791
Debugger [baseline] (4.23 ms) : 0, 4230
Debugger [candidate] (4.142 ms) : 0, 4142
Remote Config [baseline] (620.811 µs) : 0, 621
Remote Config [candidate] (586.117 µs) : 0, 586
Telemetry [baseline] (8.941 ms) : 0, 8941
Telemetry [candidate] (8.74 ms) : 0, 8740
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (841.343 ms) : 0, 841343
BytebuddyAgent [candidate] (841.615 ms) : 0, 841615
GlobalTracer [baseline] (231.456 ms) : 0, 231456
GlobalTracer [candidate] (231.209 ms) : 0, 231209
IAST [baseline] (22.784 ms) : 0, 22784
IAST [candidate] (22.714 ms) : 0, 22714
AppSec [baseline] (56.258 ms) : 0, 56258
AppSec [candidate] (56.167 ms) : 0, 56167
Debugger [baseline] (4.232 ms) : 0, 4232
Debugger [candidate] (4.152 ms) : 0, 4152
Remote Config [baseline] (628.79 µs) : 0, 629
Remote Config [candidate] (596.396 µs) : 0, 596
Telemetry [baseline] (8.876 ms) : 0, 8876
Telemetry [candidate] (8.682 ms) : 0, 8682
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~95b0529aad, baseline=1.48.0-SNAPSHOT~7580e7bc62

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1053524
Total [baseline] (10.442 s) : 0, 10441617
Agent [candidate] (1.051 s) : 0, 1051221
Total [candidate] (10.451 s) : 0, 10450821
section appsec
Agent [baseline] (1.196 s) : 0, 1196239
Total [baseline] (10.744 s) : 0, 10744038
Agent [candidate] (1.192 s) : 0, 1191728
Total [candidate] (10.726 s) : 0, 10726126
section iast
Agent [baseline] (1.179 s) : 0, 1178731
Total [baseline] (11.036 s) : 0, 11036094
Agent [candidate] (1.185 s) : 0, 1184632
Total [candidate] (11.082 s) : 0, 11082340
section profiling
Agent [baseline] (1.274 s) : 0, 1274247
Total [baseline] (10.772 s) : 0, 10772170
Agent [candidate] (1.273 s) : 0, 1272900
Total [candidate] (10.832 s) : 0, 10832234
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent appsec 1.196 s 142.714 ms (13.5%)
Agent iast 1.179 s 125.206 ms (11.9%)
Agent profiling 1.274 s 220.723 ms (21.0%)
Total tracing 10.442 s -
Total appsec 10.744 s 302.421 ms (2.9%)
Total iast 11.036 s 594.477 ms (5.7%)
Total profiling 10.772 s 330.553 ms (3.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent appsec 1.192 s 140.507 ms (13.4%)
Agent iast 1.185 s 133.411 ms (12.7%)
Agent profiling 1.273 s 221.679 ms (21.1%)
Total tracing 10.451 s -
Total appsec 10.726 s 275.304 ms (2.6%)
Total iast 11.082 s 631.519 ms (6.0%)
Total profiling 10.832 s 381.413 ms (3.6%) 
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~95b0529aad, baseline=1.48.0-SNAPSHOT~7580e7bc62

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (720.353 ms) : 0, 720353
BytebuddyAgent [candidate] (719.591 ms) : 0, 719591
GlobalTracer [baseline] (238.534 ms) : 0, 238534
GlobalTracer [candidate] (240.589 ms) : 0, 240589
AppSec [baseline] (54.562 ms) : 0, 54562
AppSec [candidate] (55.046 ms) : 0, 55046
Debugger [baseline] (4.418 ms) : 0, 4418
Debugger [candidate] (5.858 ms) : 0, 5858
Remote Config [baseline] (682.131 µs) : 0, 682
Remote Config [candidate] (709.518 µs) : 0, 710
Telemetry [baseline] (14.221 ms) : 0, 14221
Telemetry [candidate] (13.452 ms) : 0, 13452
section appsec
BytebuddyAgent [baseline] (739.996 ms) : 0, 739996
BytebuddyAgent [candidate] (738.791 ms) : 0, 738791
GlobalTracer [baseline] (235.437 ms) : 0, 235437
GlobalTracer [candidate] (237.157 ms) : 0, 237157
AppSec [baseline] (176.359 ms) : 0, 176359
AppSec [candidate] (175.303 ms) : 0, 175303
Debugger [baseline] (4.261 ms) : 0, 4261
Debugger [candidate] (4.296 ms) : 0, 4296
Remote Config [baseline] (634.369 µs) : 0, 634
Remote Config [candidate] (643.575 µs) : 0, 644
Telemetry [baseline] (8.167 ms) : 0, 8167
Telemetry [candidate] (8.861 ms) : 0, 8861
IAST [baseline] (21.766 ms) : 0, 21766
IAST [candidate] (21.374 ms) : 0, 21374
section iast
BytebuddyAgent [baseline] (836.529 ms) : 0, 836529
BytebuddyAgent [candidate] (842.158 ms) : 0, 842158
GlobalTracer [baseline] (229.02 ms) : 0, 229020
GlobalTracer [candidate] (233.063 ms) : 0, 233063
AppSec [baseline] (55.973 ms) : 0, 55973
AppSec [candidate] (56.493 ms) : 0, 56493
Debugger [baseline] (4.219 ms) : 0, 4219
Debugger [candidate] (4.187 ms) : 0, 4187
Remote Config [baseline] (610.606 µs) : 0, 611
Remote Config [candidate] (606.084 µs) : 0, 606
Telemetry [baseline] (8.787 ms) : 0, 8787
Telemetry [candidate] (8.864 ms) : 0, 8864
IAST [baseline] (23.103 ms) : 0, 23103
IAST [candidate] (23.225 ms) : 0, 23225
section profiling
ProfilingAgent [baseline] (102.915 ms) : 0, 102915
ProfilingAgent [candidate] (102.387 ms) : 0, 102387
BytebuddyAgent [baseline] (709.711 ms) : 0, 709711
BytebuddyAgent [candidate] (710.694 ms) : 0, 710694
GlobalTracer [baseline] (347.89 ms) : 0, 347890
GlobalTracer [candidate] (350.847 ms) : 0, 350847
AppSec [baseline] (54.1 ms) : 0, 54100
AppSec [candidate] (53.436 ms) : 0, 53436
Debugger [baseline] (4.289 ms) : 0, 4289
Debugger [candidate] (4.285 ms) : 0, 4285
Remote Config [baseline] (691.699 µs) : 0, 692
Remote Config [candidate] (691.488 µs) : 0, 691
Telemetry [baseline] (8.972 ms) : 0, 8972
Telemetry [candidate] (8.926 ms) : 0, 8926
Profiling [baseline] (102.941 ms) : 0, 102941
Profiling [candidate] (102.413 ms) : 0, 102413
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-31T09:06:30 2025-03-31T09:14:15
git_branch master mobuchowski/openlineage-tracer-test
git_commit_date 1743401885 1743410634
git_commit_sha 7580e7b 95b0529
release_version 1.48.0-SNAPSHOT~7580e7bc62 1.48.0-SNAPSHOT~95b0529aad
start_time 2025-03-31T09:06:15 2025-03-31T09:14:00
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1743412852 1743412852
ci_job_id 871871406 871871406
ci_pipeline_id 60477797 60477797
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vapngg-f-project-304-concurrent-0-4t5s67ex 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vapngg-f-project-304-concurrent-0-4t5s67ex 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~95b0529aad, baseline=1.48.0-SNAPSHOT~7580e7bc62
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.368 ms) : 1348, 1388
.   : milestone, 1368,
appsec (1.723 ms) : 1699, 1747
.   : milestone, 1723,
appsec_no_iast (1.745 ms) : 1722, 1769
.   : milestone, 1745,
code_origins (1.689 ms) : 1663, 1716
.   : milestone, 1689,
iast (1.527 ms) : 1502, 1553
.   : milestone, 1527,
profiling (1.509 ms) : 1485, 1533
.   : milestone, 1509,
tracing (1.518 ms) : 1494, 1543
.   : milestone, 1518,
section candidate
no_agent (1.374 ms) : 1354, 1393
.   : milestone, 1374,
appsec (1.729 ms) : 1706, 1753
.   : milestone, 1729,
appsec_no_iast (1.75 ms) : 1727, 1774
.   : milestone, 1750,
code_origins (1.666 ms) : 1639, 1693
.   : milestone, 1666,
iast (1.512 ms) : 1487, 1538
.   : milestone, 1512,
profiling (1.552 ms) : 1526, 1577
.   : milestone, 1552,
tracing (1.494 ms) : 1471, 1518
.   : milestone, 1494,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.368 ms [1.348 ms, 1.388 ms] -
appsec 1.723 ms [1.699 ms, 1.747 ms] 355.228 µs (26.0%)
appsec_no_iast 1.745 ms [1.722 ms, 1.769 ms] 377.685 µs (27.6%)
code_origins 1.689 ms [1.663 ms, 1.716 ms] 321.577 µs (23.5%)
iast 1.527 ms [1.502 ms, 1.553 ms] 159.733 µs (11.7%)
profiling 1.509 ms [1.485 ms, 1.533 ms] 141.408 µs (10.3%)
tracing 1.518 ms [1.494 ms, 1.543 ms] 150.809 µs (11.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.374 ms [1.354 ms, 1.393 ms] -
appsec 1.729 ms [1.706 ms, 1.753 ms] 355.821 µs (25.9%)
appsec_no_iast 1.75 ms [1.727 ms, 1.774 ms] 376.863 µs (27.4%)
code_origins 1.666 ms [1.639 ms, 1.693 ms] 292.12 µs (21.3%)
iast 1.512 ms [1.487 ms, 1.538 ms] 138.805 µs (10.1%)
profiling 1.552 ms [1.526 ms, 1.577 ms] 178.097 µs (13.0%)
tracing 1.494 ms [1.471 ms, 1.518 ms] 120.921 µs (8.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~95b0529aad, baseline=1.48.0-SNAPSHOT~7580e7bc62
    dateFormat X
    axisFormat %s
section baseline
no_agent (387.322 µs) : 368, 407
.   : milestone, 387,
iast (515.773 µs) : 494, 538
.   : milestone, 516,
iast_FULL (730.836 µs) : 709, 753
.   : milestone, 731,
iast_GLOBAL (578.351 µs) : 554, 603
.   : milestone, 578,
iast_HARDCODED_SECRET_DISABLED (515.847 µs) : 494, 538
.   : milestone, 516,
iast_INACTIVE (465.208 µs) : 444, 486
.   : milestone, 465,
iast_TELEMETRY_OFF (502.819 µs) : 481, 525
.   : milestone, 503,
tracing (462.843 µs) : 441, 485
.   : milestone, 463,
section candidate
no_agent (378.674 µs) : 359, 398
.   : milestone, 379,
iast (515.19 µs) : 493, 537
.   : milestone, 515,
iast_FULL (732.946 µs) : 710, 756
.   : milestone, 733,
iast_GLOBAL (559.254 µs) : 538, 581
.   : milestone, 559,
iast_HARDCODED_SECRET_DISABLED (518.598 µs) : 497, 541
.   : milestone, 519,
iast_INACTIVE (461.57 µs) : 441, 483
.   : milestone, 462,
iast_TELEMETRY_OFF (501.217 µs) : 479, 523
.   : milestone, 501,
tracing (465.739 µs) : 445, 487
.   : milestone, 466,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 387.322 µs [367.863 µs, 406.781 µs] -
iast 515.773 µs [493.95 µs, 537.596 µs] 128.451 µs (33.2%)
iast_FULL 730.836 µs [708.807 µs, 752.866 µs] 343.514 µs (88.7%)
iast_GLOBAL 578.351 µs [553.897 µs, 602.805 µs] 191.028 µs (49.3%)
iast_HARDCODED_SECRET_DISABLED 515.847 µs [493.717 µs, 537.978 µs] 128.525 µs (33.2%)
iast_INACTIVE 465.208 µs [443.937 µs, 486.479 µs] 77.886 µs (20.1%)
iast_TELEMETRY_OFF 502.819 µs [480.844 µs, 524.795 µs] 115.497 µs (29.8%)
tracing 462.843 µs [441.078 µs, 484.608 µs] 75.52 µs (19.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.674 µs [359.197 µs, 398.152 µs] -
iast 515.19 µs [493.016 µs, 537.363 µs] 136.515 µs (36.1%)
iast_FULL 732.946 µs [710.343 µs, 755.549 µs] 354.272 µs (93.6%)
iast_GLOBAL 559.254 µs [537.608 µs, 580.9 µs] 180.58 µs (47.7%)
iast_HARDCODED_SECRET_DISABLED 518.598 µs [496.67 µs, 540.526 µs] 139.923 µs (37.0%)
iast_INACTIVE 461.57 µs [440.632 µs, 482.507 µs] 82.895 µs (21.9%)
iast_TELEMETRY_OFF 501.217 µs [479.367 µs, 523.067 µs] 122.543 µs (32.4%)
tracing 465.739 µs [444.876 µs, 486.603 µs] 87.065 µs (23.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mobuchowski/openlineage-tracer-test
git_commit_date 1743401885 1743410634
git_commit_sha 7580e7b 95b0529
release_version 1.48.0-SNAPSHOT~7580e7bc62 1.48.0-SNAPSHOT~95b0529aad
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1743413287 1743413287
ci_job_id 871871407 871871407
ci_pipeline_id 60477797 60477797
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-9xmy4xzs-project-304-concurrent-0-yz7kw7pr 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-9xmy4xzs-project-304-concurrent-0-yz7kw7pr 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~95b0529aad, baseline=1.48.0-SNAPSHOT~7580e7bc62
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.328 s) : 15328000, 15328000
.   : milestone, 15328000,
appsec (15.018 s) : 15018000, 15018000
.   : milestone, 15018000,
iast (18.321 s) : 18321000, 18321000
.   : milestone, 18321000,
iast_GLOBAL (17.939 s) : 17939000, 17939000
.   : milestone, 17939000,
profiling (15.012 s) : 15012000, 15012000
.   : milestone, 15012000,
tracing (15.158 s) : 15158000, 15158000
.   : milestone, 15158000,
section candidate
no_agent (15.509 s) : 15509000, 15509000
.   : milestone, 15509000,
appsec (14.994 s) : 14994000, 14994000
.   : milestone, 14994000,
iast (18.381 s) : 18381000, 18381000
.   : milestone, 18381000,
iast_GLOBAL (18.109 s) : 18109000, 18109000
.   : milestone, 18109000,
profiling (15.25 s) : 15250000, 15250000
.   : milestone, 15250000,
tracing (14.841 s) : 14841000, 14841000
.   : milestone, 14841000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.328 s [15.328 s, 15.328 s] -
appsec 15.018 s [15.018 s, 15.018 s] -310.0 ms (-2.0%)
iast 18.321 s [18.321 s, 18.321 s] 2.993 s (19.5%)
iast_GLOBAL 17.939 s [17.939 s, 17.939 s] 2.611 s (17.0%)
profiling 15.012 s [15.012 s, 15.012 s] -316.0 ms (-2.1%)
tracing 15.158 s [15.158 s, 15.158 s] -170.0 ms (-1.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.509 s [15.509 s, 15.509 s] -
appsec 14.994 s [14.994 s, 14.994 s] -515.0 ms (-3.3%)
iast 18.381 s [18.381 s, 18.381 s] 2.872 s (18.5%)
iast_GLOBAL 18.109 s [18.109 s, 18.109 s] 2.6 s (16.8%)
profiling 15.25 s [15.25 s, 15.25 s] -259.0 ms (-1.7%)
tracing 14.841 s [14.841 s, 14.841 s] -668.0 ms (-4.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~95b0529aad, baseline=1.48.0-SNAPSHOT~7580e7bc62
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (2.342 ms) : 2298, 2385
.   : milestone, 2342,
iast (2.114 ms) : 2058, 2169
.   : milestone, 2114,
iast_GLOBAL (2.16 ms) : 2105, 2216
.   : milestone, 2160,
profiling (1.964 ms) : 1920, 2007
.   : milestone, 1964,
tracing (1.948 ms) : 1906, 1991
.   : milestone, 1948,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.335 ms) : 2291, 2379
.   : milestone, 2335,
iast (2.113 ms) : 2057, 2168
.   : milestone, 2113,
iast_GLOBAL (2.156 ms) : 2101, 2212
.   : milestone, 2156,
profiling (1.958 ms) : 1915, 2002
.   : milestone, 1958,
tracing (1.951 ms) : 1908, 1993
.   : milestone, 1951,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 2.342 ms [2.298 ms, 2.385 ms] 873.026 µs (59.4%)
iast 2.114 ms [2.058 ms, 2.169 ms] 644.796 µs (43.9%)
iast_GLOBAL 2.16 ms [2.105 ms, 2.216 ms] 691.657 µs (47.1%)
profiling 1.964 ms [1.92 ms, 2.007 ms] 494.803 µs (33.7%)
tracing 1.948 ms [1.906 ms, 1.991 ms] 479.65 µs (32.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.335 ms [2.291 ms, 2.379 ms] 864.311 µs (58.8%)
iast 2.113 ms [2.057 ms, 2.168 ms] 642.067 µs (43.7%)
iast_GLOBAL 2.156 ms [2.101 ms, 2.212 ms] 685.659 µs (46.6%)
profiling 1.958 ms [1.915 ms, 2.002 ms] 487.705 µs (33.2%)
tracing 1.951 ms [1.908 ms, 1.993 ms] 479.969 µs (32.6%)

@mobuchowski mobuchowski force-pushed the mobuchowski/openlineage-tracer-test branch 4 times, most recently from c7c75ac to 21e0d03 Compare March 30, 2025 22:05
@mobuchowski
synchronize setting listener
95b0529 
Signed-off-by: Maciej Obuchowski <[email protected]>
@mobuchowski mobuchowski force-pushed the mobuchowski/openlineage-tracer-test branch from 21e0d03 to 95b0529 Compare March 31, 2025 08:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
tag: do not merge Do not merge changes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@mobuchowski