Skip to content

Add script to perform release #9174

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jul 17, 2025
Merged

Add script to perform release #9174

merged 2 commits into from
Jul 17, 2025

Conversation

PerfectSlayer
Copy link
Contributor

What Does This Do

This script will replace the first step of the release process.

Motivation

It will help with the replacement of legacy gradle plugin by moving checks and computation in shell script instead to simplify our build. Check #9149

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@PerfectSlayer PerfectSlayer added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jul 15, 2025
@PerfectSlayer PerfectSlayer requested a review from a team as a code owner July 15, 2025 11:23
@PerfectSlayer PerfectSlayer requested a review from amarziali July 15, 2025 11:23
@pr-commenter
Copy link

pr-commenter bot commented Jul 15, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1752742917 1752755814
git_commit_sha 847275b d5ed762
release_version 1.52.0-SNAPSHOT~847275bcc2 1.52.0-SNAPSHOT~d5ed76280b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1752757672 1752757672
ci_job_id 1033679803 1033679803
ci_pipeline_id 70847968 70847968
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-jwcnfi6d 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-jwcnfi6d 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 9 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~d5ed76280b, baseline=1.52.0-SNAPSHOT~847275bcc2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.036 s) : 0, 1036365
Total [baseline] (10.69 s) : 0, 10689702
Agent [candidate] (1.038 s) : 0, 1038416
Total [candidate] (10.624 s) : 0, 10623833
section appsec
Agent [baseline] (1.225 s) : 0, 1224977
Total [baseline] (10.791 s) : 0, 10790927
Agent [candidate] (1.215 s) : 0, 1215035
Total [candidate] (10.762 s) : 0, 10762018
section iast
Agent [baseline] (1.178 s) : 0, 1177875
Total [baseline] (10.898 s) : 0, 10898057
Agent [candidate] (1.181 s) : 0, 1180754
Total [candidate] (10.926 s) : 0, 10926167
section profiling
Agent [baseline] (1.183 s) : 0, 1182673
Total [baseline] (10.832 s) : 0, 10832478
Agent [candidate] (1.198 s) : 0, 1197861
Total [candidate] (10.982 s) : 0, 10981614
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.036 s -
Agent appsec 1.225 s 188.612 ms (18.2%)
Agent iast 1.178 s 141.51 ms (13.7%)
Agent profiling 1.183 s 146.308 ms (14.1%)
Total tracing 10.69 s -
Total appsec 10.791 s 101.225 ms (0.9%)
Total iast 10.898 s 208.356 ms (1.9%)
Total profiling 10.832 s 142.777 ms (1.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.038 s -
Agent appsec 1.215 s 176.619 ms (17.0%)
Agent iast 1.181 s 142.338 ms (13.7%)
Agent profiling 1.198 s 159.445 ms (15.4%)
Total tracing 10.624 s -
Total appsec 10.762 s 138.185 ms (1.3%)
Total iast 10.926 s 302.334 ms (2.8%)
Total profiling 10.982 s 357.782 ms (3.4%)
gantt
    title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~d5ed76280b, baseline=1.52.0-SNAPSHOT~847275bcc2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.432 ms) : 0, 1432
crashtracking [candidate] (1.425 ms) : 0, 1425
BytebuddyAgent [baseline] (727.889 ms) : 0, 727889
BytebuddyAgent [candidate] (729.71 ms) : 0, 729710
GlobalTracer [baseline] (240.9 ms) : 0, 240900
GlobalTracer [candidate] (241.183 ms) : 0, 241183
AppSec [baseline] (30.397 ms) : 0, 30397
AppSec [candidate] (30.338 ms) : 0, 30338
Debugger [baseline] (6.003 ms) : 0, 6003
Debugger [candidate] (6.015 ms) : 0, 6015
Remote Config [baseline] (654.116 µs) : 0, 654
Remote Config [candidate] (658.134 µs) : 0, 658
Telemetry [baseline] (8.176 ms) : 0, 8176
Telemetry [candidate] (8.169 ms) : 0, 8169
section appsec
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.434 ms) : 0, 1434
BytebuddyAgent [baseline] (757.115 ms) : 0, 757115
BytebuddyAgent [candidate] (750.46 ms) : 0, 750460
GlobalTracer [baseline] (235.772 ms) : 0, 235772
GlobalTracer [candidate] (233.623 ms) : 0, 233623
AppSec [baseline] (168.998 ms) : 0, 168998
AppSec [candidate] (168.366 ms) : 0, 168366
Debugger [baseline] (7.908 ms) : 0, 7908
Debugger [candidate] (6.301 ms) : 0, 6301
Remote Config [baseline] (605.029 µs) : 0, 605
Remote Config [candidate] (595.734 µs) : 0, 596
Telemetry [baseline] (8.185 ms) : 0, 8185
Telemetry [candidate] (9.567 ms) : 0, 9567
IAST [baseline] (23.609 ms) : 0, 23609
IAST [candidate] (23.511 ms) : 0, 23511
section iast
crashtracking [baseline] (1.437 ms) : 0, 1437
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (852.663 ms) : 0, 852663
BytebuddyAgent [candidate] (853.483 ms) : 0, 853483
GlobalTracer [baseline] (230.766 ms) : 0, 230766
GlobalTracer [candidate] (232.332 ms) : 0, 232332
AppSec [baseline] (24.787 ms) : 0, 24787
AppSec [candidate] (27.308 ms) : 0, 27308
Debugger [baseline] (6.668 ms) : 0, 6668
Debugger [candidate] (7.473 ms) : 0, 7473
Remote Config [baseline] (587.599 µs) : 0, 588
Remote Config [candidate] (587.615 µs) : 0, 588
Telemetry [baseline] (7.845 ms) : 0, 7845
Telemetry [candidate] (7.923 ms) : 0, 7923
IAST [baseline] (32.232 ms) : 0, 32232
IAST [candidate] (29.176 ms) : 0, 29176
section profiling
crashtracking [baseline] (1.395 ms) : 0, 1395
crashtracking [candidate] (1.431 ms) : 0, 1431
BytebuddyAgent [baseline] (758.784 ms) : 0, 758784
BytebuddyAgent [candidate] (768.33 ms) : 0, 768330
GlobalTracer [baseline] (220.157 ms) : 0, 220157
GlobalTracer [candidate] (222.243 ms) : 0, 222243
AppSec [baseline] (30.292 ms) : 0, 30292
AppSec [candidate] (30.868 ms) : 0, 30868
Debugger [baseline] (6.241 ms) : 0, 6241
Debugger [candidate] (6.376 ms) : 0, 6376
Remote Config [baseline] (663.088 µs) : 0, 663
Remote Config [candidate] (690.641 µs) : 0, 691
Telemetry [baseline] (13.263 ms) : 0, 13263
Telemetry [candidate] (9.703 ms) : 0, 9703
ProfilingAgent [baseline] (103.669 ms) : 0, 103669
ProfilingAgent [candidate] (109.386 ms) : 0, 109386
Profiling [baseline] (103.693 ms) : 0, 103693
Profiling [candidate] (109.41 ms) : 0, 109410
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~d5ed76280b, baseline=1.52.0-SNAPSHOT~847275bcc2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.036 s) : 0, 1035798
Total [baseline] (8.608 s) : 0, 8607947
Agent [candidate] (1.038 s) : 0, 1038249
Total [candidate] (8.606 s) : 0, 8606335
section iast
Agent [baseline] (1.173 s) : 0, 1172816
Total [baseline] (9.258 s) : 0, 9257686
Agent [candidate] (1.18 s) : 0, 1180052
Total [candidate] (9.304 s) : 0, 9303803
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.036 s -
Agent iast 1.173 s 137.018 ms (13.2%)
Total tracing 8.608 s -
Total iast 9.258 s 649.739 ms (7.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.038 s -
Agent iast 1.18 s 141.803 ms (13.7%)
Total tracing 8.606 s -
Total iast 9.304 s 697.468 ms (8.1%)
gantt
    title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~d5ed76280b, baseline=1.52.0-SNAPSHOT~847275bcc2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.431 ms) : 0, 1431
crashtracking [candidate] (1.432 ms) : 0, 1432
BytebuddyAgent [baseline] (727.912 ms) : 0, 727912
BytebuddyAgent [candidate] (729.852 ms) : 0, 729852
GlobalTracer [baseline] (240.44 ms) : 0, 240440
GlobalTracer [candidate] (241.012 ms) : 0, 241012
AppSec [baseline] (30.358 ms) : 0, 30358
AppSec [candidate] (30.309 ms) : 0, 30309
Debugger [baseline] (6.005 ms) : 0, 6005
Debugger [candidate] (5.996 ms) : 0, 5996
Remote Config [baseline] (656.103 µs) : 0, 656
Remote Config [candidate] (649.1 µs) : 0, 649
Telemetry [baseline] (8.194 ms) : 0, 8194
Telemetry [candidate] (8.18 ms) : 0, 8180
section iast
crashtracking [baseline] (1.431 ms) : 0, 1431
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (846.576 ms) : 0, 846576
BytebuddyAgent [candidate] (853.196 ms) : 0, 853196
GlobalTracer [baseline] (231.088 ms) : 0, 231088
GlobalTracer [candidate] (231.737 ms) : 0, 231737
AppSec [baseline] (27.466 ms) : 0, 27466
AppSec [candidate] (28.328 ms) : 0, 28328
Debugger [baseline] (8.553 ms) : 0, 8553
Debugger [candidate] (5.77 ms) : 0, 5770
Remote Config [baseline] (593.583 µs) : 0, 594
Remote Config [candidate] (589.634 µs) : 0, 590
Telemetry [baseline] (7.959 ms) : 0, 7959
Telemetry [candidate] (7.935 ms) : 0, 7935
IAST [baseline] (28.234 ms) : 0, 28234
IAST [candidate] (30.177 ms) : 0, 30177
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1752742917 1752755814
git_commit_sha 847275b d5ed762
release_version 1.52.0-SNAPSHOT~847275bcc2 1.52.0-SNAPSHOT~d5ed76280b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1752757364 1752757364
ci_job_id 1033679804 1033679804
ci_pipeline_id 70847968 70847968
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-kf4i1n8z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-kf4i1n8z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:tracing:high_load better
[-2.969ms; -2.169ms] or [-6.568%; -4.799%]
unstable
[-1.093op/s; +13.668op/s] or [-1.056%; +13.207%]
42.634ms 109.775op/s 45.203ms 103.487op/s
scenario:load:petclinic:profiling:high_load better
[-2.810ms; -1.835ms] or [-5.635%; -3.680%]
unstable
[-2.278op/s; +11.403op/s] or [-2.426%; +12.147%]
47.541ms 98.438op/s 49.864ms 93.875op/s
scenario:load:petclinic:code_origins:high_load better
[-2.845ms; -2.017ms] or [-6.202%; -4.397%]
unstable
[-1.580op/s; +12.980op/s] or [-1.549%; +12.726%]
43.432ms 107.700op/s 45.863ms 102.000op/s
scenario:load:petclinic:no_agent:high_load better
[-1.880ms; -1.238ms] or [-4.988%; -3.285%]
unstable
[-3.159op/s; +13.884op/s] or [-2.547%; +11.194%]
36.140ms 129.387op/s 37.699ms 124.025op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~d5ed76280b, baseline=1.52.0-SNAPSHOT~847275bcc2
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.699 ms) : 37398, 38000
.   : milestone, 37699,
appsec (47.435 ms) : 46996, 47875
.   : milestone, 47435,
code_origins (45.863 ms) : 45467, 46259
.   : milestone, 45863,
iast (43.393 ms) : 43024, 43762
.   : milestone, 43393,
profiling (49.864 ms) : 49395, 50332
.   : milestone, 49864,
tracing (45.203 ms) : 44824, 45582
.   : milestone, 45203,
section candidate
no_agent (36.14 ms) : 35844, 36435
.   : milestone, 36140,
appsec (47.846 ms) : 47408, 48284
.   : milestone, 47846,
code_origins (43.432 ms) : 43059, 43806
.   : milestone, 43432,
iast (43.454 ms) : 43079, 43830
.   : milestone, 43454,
profiling (47.541 ms) : 47105, 47978
.   : milestone, 47541,
tracing (42.634 ms) : 42270, 42998
.   : milestone, 42634,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.699 ms [37.398 ms, 38.0 ms] -
appsec 47.435 ms [46.996 ms, 47.875 ms] 9.736 ms (25.8%)
code_origins 45.863 ms [45.467 ms, 46.259 ms] 8.164 ms (21.7%)
iast 43.393 ms [43.024 ms, 43.762 ms] 5.694 ms (15.1%)
profiling 49.864 ms [49.395 ms, 50.332 ms] 12.165 ms (32.3%)
tracing 45.203 ms [44.824 ms, 45.582 ms] 7.504 ms (19.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.14 ms [35.844 ms, 36.435 ms] -
appsec 47.846 ms [47.408 ms, 48.284 ms] 11.706 ms (32.4%)
code_origins 43.432 ms [43.059 ms, 43.806 ms] 7.293 ms (20.2%)
iast 43.454 ms [43.079 ms, 43.83 ms] 7.315 ms (20.2%)
profiling 47.541 ms [47.105 ms, 47.978 ms] 11.402 ms (31.5%)
tracing 42.634 ms [42.27 ms, 42.998 ms] 6.495 ms (18.0%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~d5ed76280b, baseline=1.52.0-SNAPSHOT~847275bcc2
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.275 ms) : 4227, 4323
.   : milestone, 4275,
iast (9.353 ms) : 9200, 9506
.   : milestone, 9353,
iast_FULL (14.329 ms) : 14042, 14615
.   : milestone, 14329,
iast_GLOBAL (9.837 ms) : 9659, 10016
.   : milestone, 9837,
profiling (8.461 ms) : 8328, 8594
.   : milestone, 8461,
tracing (7.731 ms) : 7619, 7843
.   : milestone, 7731,
section candidate
no_agent (4.391 ms) : 4340, 4443
.   : milestone, 4391,
iast (9.162 ms) : 9012, 9313
.   : milestone, 9162,
iast_FULL (13.8 ms) : 13528, 14072
.   : milestone, 13800,
iast_GLOBAL (9.922 ms) : 9750, 10093
.   : milestone, 9922,
profiling (8.616 ms) : 8476, 8755
.   : milestone, 8616,
tracing (7.662 ms) : 7542, 7782
.   : milestone, 7662,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.275 ms [4.227 ms, 4.323 ms] -
iast 9.353 ms [9.2 ms, 9.506 ms] 5.078 ms (118.8%)
iast_FULL 14.329 ms [14.042 ms, 14.615 ms] 10.054 ms (235.2%)
iast_GLOBAL 9.837 ms [9.659 ms, 10.016 ms] 5.563 ms (130.1%)
profiling 8.461 ms [8.328 ms, 8.594 ms] 4.186 ms (97.9%)
tracing 7.731 ms [7.619 ms, 7.843 ms] 3.456 ms (80.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.391 ms [4.34 ms, 4.443 ms] -
iast 9.162 ms [9.012 ms, 9.313 ms] 4.771 ms (108.6%)
iast_FULL 13.8 ms [13.528 ms, 14.072 ms] 9.409 ms (214.3%)
iast_GLOBAL 9.922 ms [9.75 ms, 10.093 ms] 5.53 ms (125.9%)
profiling 8.616 ms [8.476 ms, 8.755 ms] 4.224 ms (96.2%)
tracing 7.662 ms [7.542 ms, 7.782 ms] 3.27 ms (74.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1752742917 1752755814
git_commit_sha 847275b d5ed762
release_version 1.52.0-SNAPSHOT~847275bcc2 1.52.0-SNAPSHOT~d5ed76280b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1752757899 1752757899
ci_job_id 1033679805 1033679805
ci_pipeline_id 70847968 70847968
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-jc9z406l 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-jc9z406l 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~d5ed76280b, baseline=1.52.0-SNAPSHOT~847275bcc2
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.122 s) : 15122000, 15122000
.   : milestone, 15122000,
appsec (14.777 s) : 14777000, 14777000
.   : milestone, 14777000,
iast (18.553 s) : 18553000, 18553000
.   : milestone, 18553000,
iast_GLOBAL (17.876 s) : 17876000, 17876000
.   : milestone, 17876000,
profiling (15.467 s) : 15467000, 15467000
.   : milestone, 15467000,
tracing (14.95 s) : 14950000, 14950000
.   : milestone, 14950000,
section candidate
no_agent (15.011 s) : 15011000, 15011000
.   : milestone, 15011000,
appsec (14.849 s) : 14849000, 14849000
.   : milestone, 14849000,
iast (17.903 s) : 17903000, 17903000
.   : milestone, 17903000,
iast_GLOBAL (18.12 s) : 18120000, 18120000
.   : milestone, 18120000,
profiling (15.174 s) : 15174000, 15174000
.   : milestone, 15174000,
tracing (14.848 s) : 14848000, 14848000
.   : milestone, 14848000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.122 s [15.122 s, 15.122 s] -
appsec 14.777 s [14.777 s, 14.777 s] -345.0 ms (-2.3%)
iast 18.553 s [18.553 s, 18.553 s] 3.431 s (22.7%)
iast_GLOBAL 17.876 s [17.876 s, 17.876 s] 2.754 s (18.2%)
profiling 15.467 s [15.467 s, 15.467 s] 345.0 ms (2.3%)
tracing 14.95 s [14.95 s, 14.95 s] -172.0 ms (-1.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.011 s [15.011 s, 15.011 s] -
appsec 14.849 s [14.849 s, 14.849 s] -162.0 ms (-1.1%)
iast 17.903 s [17.903 s, 17.903 s] 2.892 s (19.3%)
iast_GLOBAL 18.12 s [18.12 s, 18.12 s] 3.109 s (20.7%)
profiling 15.174 s [15.174 s, 15.174 s] 163.0 ms (1.1%)
tracing 14.848 s [14.848 s, 14.848 s] -163.0 ms (-1.1%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~d5ed76280b, baseline=1.52.0-SNAPSHOT~847275bcc2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (3.645 ms) : 3431, 3859
.   : milestone, 3645,
iast (2.19 ms) : 2127, 2253
.   : milestone, 2190,
iast_GLOBAL (2.227 ms) : 2165, 2290
.   : milestone, 2227,
profiling (2.029 ms) : 1979, 2079
.   : milestone, 2029,
tracing (2.01 ms) : 1962, 2059
.   : milestone, 2010,
section candidate
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (3.612 ms) : 3395, 3830
.   : milestone, 3612,
iast (2.19 ms) : 2128, 2253
.   : milestone, 2190,
iast_GLOBAL (2.226 ms) : 2164, 2289
.   : milestone, 2226,
profiling (2.05 ms) : 1999, 2102
.   : milestone, 2050,
tracing (2.002 ms) : 1953, 2050
.   : milestone, 2002,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.457 ms, 1.48 ms] -
appsec 3.645 ms [3.431 ms, 3.859 ms] 2.177 ms (148.3%)
iast 2.19 ms [2.127 ms, 2.253 ms] 721.541 µs (49.1%)
iast_GLOBAL 2.227 ms [2.165 ms, 2.29 ms] 759.042 µs (51.7%)
profiling 2.029 ms [1.979 ms, 2.079 ms] 560.753 µs (38.2%)
tracing 2.01 ms [1.962 ms, 2.059 ms] 542.192 µs (36.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.466 ms, 1.489 ms] -
appsec 3.612 ms [3.395 ms, 3.83 ms] 2.135 ms (144.5%)
iast 2.19 ms [2.128 ms, 2.253 ms] 712.822 µs (48.3%)
iast_GLOBAL 2.226 ms [2.164 ms, 2.289 ms] 749.195 µs (50.7%)
profiling 2.05 ms [1.999 ms, 2.102 ms] 573.168 µs (38.8%)
tracing 2.002 ms [1.953 ms, 2.05 ms] 524.399 µs (35.5%)

@PerfectSlayer PerfectSlayer force-pushed the bbujon/ci branch 2 times, most recently from b7a17c5 to 7450b1c Compare July 15, 2025 13:24
@PerfectSlayer PerfectSlayer enabled auto-merge (squash) July 16, 2025 08:34
fi

# Check if working copy is clean
if ! git diff-index --quiet HEAD; then
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

note: This could be detected by the --dirty option in git describe

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

git describe --dirty will report untracked file.
Do we want to check them as well? 🤷 (I usually have some scripts related to repo management on the side that I never commit 😅 )

Copy link
Contributor

@bric3 bric3 Jul 17, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't believe so, for example

❯ git status --short --branch
## master...origin/master
❯ touch a
❯ git describe --abbrev=8 --tags --first-parent --match="v[0-9].[0-9]*.[0-9]" --dirty
v1.51.0-42-g847275bc
❯ git status --short --branch
## master...origin/master
?? a

while

❯ echo "// ..." >> build.gradle
❯ git status --short --branch
## master...origin/master
 M build.gradle
❯ git describe --abbrev=8 --tags --first-parent --match="v[0-9].[0-9]*.[0-9]" --dirty
v1.51.0-42-g847275bc-dirty

The --dirty identifies local modifications, so untracked files are not accounted.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You're right. --dirty is not impacted by untracked changed.
But I still struggle to find out why git describe: Give an object a human readable name based on an available ref is more suited that git diff-index: _ Compare a tree to the working tree or index_
Especially since there is no easy way to interact with the human readable name 🤔

Copy link
Contributor

@bric3 bric3 Jul 17, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry for not being clear, my purpose in writing this note is see if it was useful to to perform a single command from to get the dirtiness ad the latest tag (i.e combine L45 and L62). The current code is not problematic, and the ROI there is ... vague. Feel free to dismiss this comment.

Copy link
Contributor

@bric3 bric3 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some tweaks are still possible, but that is good already.

# Check the git log history
LAST_RELEASE_TAG=$(git describe --tags --abbrev=0 --match='v[0-9]*.[0-9]*.[0-9]*')
echo "ℹ️ Last release version: $LAST_RELEASE_TAG"
SUSPICIOUS_COMMITS=$(git log --oneline --first-parent "$LAST_RELEASE_TAG"..HEAD | grep -E -v "Merge pull request #" | grep -E -v "\(#")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

note: I just noticed that PR merged with the merge queue (e.g. via the /merge comment in a PR) are not suffixed with the PR number ((#XXXX)). So this command grep -E -v "\(#") will output merge commits like:

Making members static final to avoid repeated work & allocation

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/merge is related to merge-queue right?
If so, it should not be an issue as we don't use it on this repo as it messes with our CI build (our build is a already based merge build)

And yes, it happens sometimes, that's why it is not blocking but requires manual confirmation to continue.

Copy link
Contributor

@bric3 bric3 Jul 17, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, it has been used already. E.g. here #9179, possibly but unsure here #9166 (as doggo can add a button in the UI, it might not be necessary to write the /merge comment). And that's since 1.51.0, maybe it was used before.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

But after looking it up, it might be possible to disable it, by adding this repository.datadog.yml file at the repo root.

---
schema-version: v1
kind: mergequeue
enable: false

https://datadoghq.atlassian.net/wiki/spaces/DEVX/pages/3121612126/MergeQueue#Configuration-Specification

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh interesting! I will disable it then 👍

---
schema-version: v1
kind: mergequeue
enable: false
Copy link
Contributor

@bric3 bric3 Jul 17, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

suggestion: Might be worth adding the reason why it's disabled. As it might be obvious why.

Suggested change
enable: false
# Disabled because it messes with our existing CI ...to be completed
enable: false

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Damned, this was merged with auto-merge. We will add it in the next commit that fixes the unknown (yet) script issue 😬

@PerfectSlayer PerfectSlayer merged commit 26c5a80 into master Jul 17, 2025
502 checks passed
@PerfectSlayer PerfectSlayer deleted the bbujon/ci branch July 17, 2025 13:46
@github-actions github-actions bot added this to the 1.52.0 milestone Jul 17, 2025
mhlidd pushed a commit that referenced this pull request Jul 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants