ci(iast): fix flakyness #15210

avara1986 · 2025-11-11T13:23:26Z

Checking the IAST CI, it is working but some tests looks flaky:

FLAKY tests/appsec/iast/taint_tracking/test_native_taint_range.py::test_context_race_conditions_threads[py3.10]
FLAKY tests/appsec/iast/test_overhead_control_engine.py::test_oce_max_vulnerabilities_per_request[py3.10]
FLAKY tests/appsec/iast/test_overhead_control_engine.py::test_oce_reset_vulnerabilities_report[py3.10]
FLAKY tests/appsec/iast/test_telemetry.py::test_log_metric[py3.10]
FLAKY tests/appsec/iast/test_telemetry.py::test_log_metric_debug_deduplication[py3.10]
FLAKY tests/appsec/iast/test_telemetry.py::test_log_metric_debug_deduplication_different_messages[py3.10]

github-actions · 2025-11-11T13:24:00Z

CODEOWNERS have been resolved as:

tests/appsec/iast/conftest.py                                           @DataDog/asm-python
tests/appsec/iast/taint_tracking/test_native_taint_range.py             @DataDog/asm-python
tests/appsec/iast/test_overhead_control_engine.py                       @DataDog/asm-python
tests/appsec/iast/test_telemetry.py                                     @DataDog/asm-python

github-actions · 2025-11-11T13:50:07Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 238 ± 3 ms.

The average import time from base is: 244 ± 6 ms.

The import time difference between this PR and base is: -6.5 ± 0.2 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.468 ms (1.04%)

ddtrace.bootstrap.sitecustomize 1.690 ms (0.71%)

ddtrace.bootstrap.preload 1.690 ms (0.71%)

ddtrace.internal.remoteconfig.client 0.731 ms (0.31%)

ddtrace.internal.remoteconfig.worker 0.033 ms (0.01%)

ddtrace 0.778 ms (0.33%)

ddtrace.internal._unpatched 0.119 ms (0.05%)

subprocess 0.090 ms (0.04%)

contextlib 0.090 ms (0.04%)

json 0.029 ms (0.01%)

json.decoder 0.029 ms (0.01%)

re 0.029 ms (0.01%)

enum 0.029 ms (0.01%)

types 0.029 ms (0.01%)

pr-commenter · 2025-11-11T15:10:50Z

Performance SLOs

Comparing candidate avara1986/APPSEC-59960_iast_ci_flakyness (f31dea6) with baseline main (aaf0646)

🟡 Near SLO Breach (3 suites)

🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 20.432ms (SLO: <22.300ms -8.4%) vs baseline: ~same

Memory: ✅ 66.018MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.9%

✅ exception-replay-enabled

Time: ✅ 1.343ms (SLO: <1.450ms -7.4%) vs baseline: +0.1%

Memory: ✅ 64.271MB (SLO: <67.000MB -4.1%) vs baseline: +5.0%

✅ iast

Time: ✅ 20.437ms (SLO: <22.250ms -8.1%) vs baseline: -0.2%

Memory: ✅ 65.999MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.9%

✅ profiler

Time: ✅ 15.417ms (SLO: <16.550ms -6.8%) vs baseline: +0.6%

Memory: ✅ 53.986MB (SLO: <54.500MB 🟡 -0.9%) vs baseline: +4.8%

✅ resource-renaming

Time: ✅ 20.482ms (SLO: <21.750ms -5.8%) vs baseline: -0.1%

Memory: ✅ 66.038MB (SLO: <67.000MB 🟡 -1.4%) vs baseline: +4.9%

✅ span-code-origin

Time: ✅ 25.335ms (SLO: <28.200ms 📉 -10.2%) vs baseline: -0.5%

Memory: ✅ 67.357MB (SLO: <69.500MB -3.1%) vs baseline: +4.5%

✅ tracer

Time: ✅ 20.421ms (SLO: <21.750ms -6.1%) vs baseline: -0.3%

Memory: ✅ 66.006MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.9%

✅ tracer-and-profiler

Time: ✅ 22.538ms (SLO: <23.500ms -4.1%) vs baseline: -0.1%

Memory: ✅ 67.895MB (SLO: <68.000MB 🟡 -0.2%) vs baseline: +5.2%

✅ tracer-dont-create-db-spans

Time: ✅ 19.264ms (SLO: <21.500ms 📉 -10.4%) vs baseline: -0.2%

Memory: ✅ 65.975MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.8%

✅ tracer-minimal

Time: ✅ 16.622ms (SLO: <17.500ms -5.0%) vs baseline: ~same

Memory: ✅ 66.014MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.9%

✅ tracer-native

Time: ✅ 20.438ms (SLO: <21.750ms -6.0%) vs baseline: ~same

Memory: ✅ 67.967MB (SLO: <72.500MB -6.3%) vs baseline: +4.9%

✅ tracer-no-caches

Time: ✅ 18.494ms (SLO: <19.650ms -5.9%) vs baseline: ~same

Memory: ✅ 66.027MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.9%

✅ tracer-no-databases

Time: ✅ 18.740ms (SLO: <20.100ms -6.8%) vs baseline: -0.2%

Memory: ✅ 65.937MB (SLO: <67.000MB 🟡 -1.6%) vs baseline: +4.8%

✅ tracer-no-middleware

Time: ✅ 20.161ms (SLO: <21.500ms -6.2%) vs baseline: ~same

Memory: ✅ 66.014MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.8%

✅ tracer-no-templates

Time: ✅ 20.345ms (SLO: <22.000ms -7.5%) vs baseline: -0.1%

Memory: ✅ 65.983MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.9%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.089ms (SLO: <19.850ms -8.9%) vs baseline: ~same

Memory: ✅ 66.128MB (SLO: <66.500MB 🟡 -0.6%) vs baseline: +4.8%

✅ errortracking-enabled-user

Time: ✅ 18.095ms (SLO: <19.400ms -6.7%) vs baseline: +0.3%

Memory: ✅ 66.080MB (SLO: <66.500MB 🟡 -0.6%) vs baseline: +4.7%

✅ tracer-enabled

Time: ✅ 18.072ms (SLO: <19.450ms -7.1%) vs baseline: ~same

Memory: ✅ 65.942MB (SLO: <66.500MB 🟡 -0.8%) vs baseline: +5.0%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.594ms (SLO: <4.750ms -3.3%) vs baseline: -0.6%

Memory: ✅ 62.344MB (SLO: <65.000MB -4.1%) vs baseline: +4.9%

✅ appsec-post

Time: ✅ 6.626ms (SLO: <6.750ms 🟡 -1.8%) vs baseline: -0.2%

Memory: ✅ 62.329MB (SLO: <65.000MB -4.1%) vs baseline: +4.8%

✅ appsec-telemetry

Time: ✅ 4.583ms (SLO: <4.750ms -3.5%) vs baseline: ~same

Memory: ✅ 62.383MB (SLO: <65.000MB -4.0%) vs baseline: +5.0%

✅ debugger

Time: ✅ 1.861ms (SLO: <2.000ms -6.9%) vs baseline: ~same

Memory: ✅ 45.072MB (SLO: <47.000MB -4.1%) vs baseline: +4.6%

✅ iast-get

Time: ✅ 1.858ms (SLO: <2.000ms -7.1%) vs baseline: +0.4%

Memory: ✅ 42.078MB (SLO: <49.000MB 📉 -14.1%) vs baseline: +4.8%

✅ profiler

Time: ✅ 1.914ms (SLO: <2.100ms -8.8%) vs baseline: -0.2%

Memory: ✅ 46.775MB (SLO: <47.000MB 🟡 -0.5%) vs baseline: +5.1%

✅ resource-renaming

Time: ✅ 3.360ms (SLO: <3.650ms -7.9%) vs baseline: -0.5%

Memory: ✅ 52.556MB (SLO: <53.500MB 🟡 -1.8%) vs baseline: +4.8%

✅ tracer

Time: ✅ 3.357ms (SLO: <3.650ms -8.0%) vs baseline: ~same

Memory: ✅ 52.465MB (SLO: <53.500MB 🟡 -1.9%) vs baseline: +4.7%

✅ tracer-native

Time: ✅ 3.351ms (SLO: <3.650ms -8.2%) vs baseline: ~same

Memory: ✅ 54.313MB (SLO: <60.000MB -9.5%) vs baseline: +4.7%

⚠️ Unstable Tests (1 suite)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.328µs (SLO: <20.000µs 📉 -33.4%) vs baseline: +0.4%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.7%

✅ context_with_data_no_listeners

Time: ✅ 3.242µs (SLO: <10.000µs 📉 -67.6%) vs baseline: -1.2%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.8%

✅ get_item_exists

Time: ✅ 0.582µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.5%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +4.9%

✅ get_item_missing

Time: ✅ 0.638µs (SLO: <10.000µs 📉 -93.6%) vs baseline: ~same

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.7%

✅ set_item

Time: ✅ 24.245µs (SLO: <30.000µs 📉 -19.2%) vs baseline: +1.5%

Memory: ✅ 31.497MB (SLO: <33.500MB -6.0%) vs baseline: +4.9%

✅ All Tests Passing (20 suites)

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.069ms (SLO: <2.300ms 📉 -10.0%) vs baseline: ~same

Memory: ✅ 52.258MB (SLO: <53.500MB -2.3%) vs baseline: +4.2%

✅ errortracking-enabled-user

Time: ✅ 2.091ms (SLO: <2.250ms -7.1%) vs baseline: +1.1%

Memory: ✅ 52.376MB (SLO: <53.500MB -2.1%) vs baseline: +4.4%

✅ tracer-enabled

Time: ✅ 2.066ms (SLO: <2.300ms 📉 -10.2%) vs baseline: -0.5%

Memory: ✅ 52.258MB (SLO: <53.500MB -2.3%) vs baseline: +4.3%

✅ flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.969ms (SLO: <4.200ms -5.5%) vs baseline: -0.5%

Memory: ✅ 62.364MB (SLO: <66.000MB -5.5%) vs baseline: +5.0%

✅ iast-enabled

Time: ✅ 2.437ms (SLO: <2.800ms 📉 -13.0%) vs baseline: ~same

Memory: ✅ 58.432MB (SLO: <60.000MB -2.6%) vs baseline: +4.5%

✅ tracer-enabled

Time: ✅ 2.057ms (SLO: <2.250ms -8.6%) vs baseline: -0.4%

Memory: ✅ 52.671MB (SLO: <54.500MB -3.4%) vs baseline: +5.0%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.478µs (SLO: <100.000µs 📉 -18.5%) vs baseline: -0.1%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +5.1%

✅ b3_headers

Time: ✅ 14.299µs (SLO: <20.000µs 📉 -28.5%) vs baseline: +0.7%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +4.9%

✅ b3_single_headers

Time: ✅ 14.092µs (SLO: <20.000µs 📉 -29.5%) vs baseline: +5.3%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.8%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 66.072µs (SLO: <80.000µs 📉 -17.4%) vs baseline: +3.8%

Memory: ✅ 31.890MB (SLO: <33.500MB -4.8%) vs baseline: +4.3%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.527µs (SLO: <80.000µs 📉 -16.8%) vs baseline: +0.8%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.7%

✅ empty_headers

Time: ✅ 1.621µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.1%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.8%

✅ full_t_id_datadog_headers

Time: ✅ 23.058µs (SLO: <30.000µs 📉 -23.1%) vs baseline: +0.3%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +5.1%

✅ invalid_priority_header

Time: ✅ 6.548µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.2%

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.5%

✅ invalid_span_id_header

Time: ✅ 6.527µs (SLO: <10.000µs 📉 -34.7%) vs baseline: ~same

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.6%

✅ invalid_tags_header

Time: ✅ 6.501µs (SLO: <10.000µs 📉 -35.0%) vs baseline: -0.8%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +4.8%

✅ invalid_trace_id_header

Time: ✅ 6.489µs (SLO: <10.000µs 📉 -35.1%) vs baseline: -0.3%

Memory: ✅ 32.027MB (SLO: <33.500MB -4.4%) vs baseline: +5.0%

✅ large_header_no_matches

Time: ✅ 27.626µs (SLO: <30.000µs -7.9%) vs baseline: -0.3%

Memory: ✅ 31.890MB (SLO: <33.500MB -4.8%) vs baseline: +4.5%

✅ large_valid_headers_all

Time: ✅ 28.745µs (SLO: <40.000µs 📉 -28.1%) vs baseline: +0.3%

Memory: ✅ 32.008MB (SLO: <33.500MB -4.5%) vs baseline: +5.0%

✅ medium_header_no_matches

Time: ✅ 9.902µs (SLO: <20.000µs 📉 -50.5%) vs baseline: +0.9%

Memory: ✅ 32.047MB (SLO: <33.500MB -4.3%) vs baseline: +5.2%

✅ medium_valid_headers_all

Time: ✅ 11.264µs (SLO: <20.000µs 📉 -43.7%) vs baseline: +0.4%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.9%

✅ none_propagation_style

Time: ✅ 1.746µs (SLO: <10.000µs 📉 -82.5%) vs baseline: +1.6%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.6%

✅ tracecontext_headers

Time: ✅ 35.615µs (SLO: <40.000µs 📉 -11.0%) vs baseline: +2.4%

Memory: ✅ 32.008MB (SLO: <33.500MB -4.5%) vs baseline: +5.0%

✅ valid_headers_all

Time: ✅ 6.588µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +1.2%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +5.1%

✅ valid_headers_basic

Time: ✅ 6.127µs (SLO: <10.000µs 📉 -38.7%) vs baseline: +0.5%

Memory: ✅ 32.008MB (SLO: <33.500MB -4.5%) vs baseline: +5.1%

✅ wsgi_empty_headers

Time: ✅ 1.622µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.3%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.7%

✅ wsgi_invalid_priority_header

Time: ✅ 6.606µs (SLO: <10.000µs 📉 -33.9%) vs baseline: +0.3%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.6%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.610µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.6%

Memory: ✅ 32.008MB (SLO: <33.500MB -4.5%) vs baseline: +4.8%

✅ wsgi_invalid_tags_header

Time: ✅ 6.592µs (SLO: <10.000µs 📉 -34.1%) vs baseline: -0.3%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.7%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.580µs (SLO: <10.000µs 📉 -34.2%) vs baseline: ~same

Memory: ✅ 32.047MB (SLO: <33.500MB -4.3%) vs baseline: +5.1%

✅ wsgi_large_header_no_matches

Time: ✅ 28.667µs (SLO: <40.000µs 📉 -28.3%) vs baseline: ~same

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +4.9%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.765µs (SLO: <40.000µs 📉 -25.6%) vs baseline: +0.2%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +5.1%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.214µs (SLO: <20.000µs 📉 -48.9%) vs baseline: +0.7%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.7%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.525µs (SLO: <20.000µs 📉 -42.4%) vs baseline: ~same

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.8%

✅ wsgi_valid_headers_all

Time: ✅ 6.606µs (SLO: <10.000µs 📉 -33.9%) vs baseline: +0.7%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +5.1%

✅ wsgi_valid_headers_basic

Time: ✅ 6.204µs (SLO: <10.000µs 📉 -38.0%) vs baseline: +1.3%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.9%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.012µs (SLO: <30.000µs 📉 -30.0%) vs baseline: -0.6%

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.7%

✅ with_all

Time: ✅ 29.699µs (SLO: <40.000µs 📉 -25.8%) vs baseline: +4.5%

Memory: ✅ 32.027MB (SLO: <33.500MB -4.4%) vs baseline: +5.2%

✅ with_dd_origin

Time: ✅ 24.872µs (SLO: <30.000µs 📉 -17.1%) vs baseline: -0.2%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.9%

✅ with_priority_and_origin

Time: ✅ 25.197µs (SLO: <40.000µs 📉 -37.0%) vs baseline: +3.9%

Memory: ✅ 32.008MB (SLO: <33.500MB -4.5%) vs baseline: +5.1%

✅ with_sampling_priority

Time: ✅ 21.025µs (SLO: <30.000µs 📉 -29.9%) vs baseline: ~same

Memory: ✅ 32.027MB (SLO: <33.500MB -4.4%) vs baseline: +5.2%

✅ with_tags

Time: ✅ 26.805µs (SLO: <40.000µs 📉 -33.0%) vs baseline: +0.6%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.9%

✅ with_tags_invalid

Time: ✅ 28.057µs (SLO: <40.000µs 📉 -29.9%) vs baseline: +0.5%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.7%

✅ with_tags_max_size

Time: ✅ 28.673µs (SLO: <40.000µs 📉 -28.3%) vs baseline: +6.1%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +5.1%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 31.968µs (SLO: <40.000µs 📉 -20.1%) vs baseline: ~same

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.6%

✅ re_expand_noaspect

Time: ✅ 28.483µs (SLO: <40.000µs 📉 -28.8%) vs baseline: -0.2%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ re_findall_aspect

Time: ✅ 2.944µs (SLO: <10.000µs 📉 -70.6%) vs baseline: +1.5%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.9%

✅ re_findall_noaspect

Time: ✅ 1.414µs (SLO: <10.000µs 📉 -85.9%) vs baseline: ~same

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +5.0%

✅ re_finditer_aspect

Time: ✅ 4.410µs (SLO: <10.000µs 📉 -55.9%) vs baseline: +0.3%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.8%

✅ re_finditer_noaspect

Time: ✅ 1.406µs (SLO: <10.000µs 📉 -85.9%) vs baseline: +0.2%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ re_fullmatch_aspect

Time: ✅ 2.654µs (SLO: <10.000µs 📉 -73.5%) vs baseline: -1.1%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ re_fullmatch_noaspect

Time: ✅ 1.310µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +0.1%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ re_group_aspect

Time: ✅ 2.927µs (SLO: <10.000µs 📉 -70.7%) vs baseline: -1.0%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.9%

✅ re_group_noaspect

Time: ✅ 1.602µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.9%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ re_groups_aspect

Time: ✅ 3.115µs (SLO: <10.000µs 📉 -68.9%) vs baseline: +1.2%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ re_groups_noaspect

Time: ✅ 1.699µs (SLO: <10.000µs 📉 -83.0%) vs baseline: -1.6%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.6%

✅ re_match_aspect

Time: ✅ 2.708µs (SLO: <10.000µs 📉 -72.9%) vs baseline: +0.6%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.9%

✅ re_match_noaspect

Time: ✅ 1.299µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -2.0%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +5.0%

✅ re_search_aspect

Time: ✅ 2.526µs (SLO: <10.000µs 📉 -74.7%) vs baseline: +0.4%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +5.2%

✅ re_search_noaspect

Time: ✅ 1.208µs (SLO: <10.000µs 📉 -87.9%) vs baseline: +0.6%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +5.3%

✅ re_sub_aspect

Time: ✅ 3.388µs (SLO: <10.000µs 📉 -66.1%) vs baseline: ~same

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +5.1%

✅ re_sub_noaspect

Time: ✅ 1.542µs (SLO: <10.000µs 📉 -84.6%) vs baseline: +0.9%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

✅ re_subn_aspect

Time: ✅ 3.644µs (SLO: <10.000µs 📉 -63.6%) vs baseline: +0.5%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.6%

✅ re_subn_noaspect

Time: ✅ 1.602µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.4%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.405µs (SLO: <10.000µs 📉 -96.0%) vs baseline: ~same

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ add_inplace_aspect

Time: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.6%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ add_inplace_noaspect

Time: ✅ 0.316µs (SLO: <10.000µs 📉 -96.8%) vs baseline: ~same

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.9%

✅ add_noaspect

Time: ✅ 0.280µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.4%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ bytearray_aspect

Time: ✅ 1.308µs (SLO: <10.000µs 📉 -86.9%) vs baseline: -0.4%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.9%

✅ bytearray_extend_aspect

Time: ✅ 1.490µs (SLO: <10.000µs 📉 -85.1%) vs baseline: +1.7%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.9%

✅ bytearray_extend_noaspect

Time: ✅ 0.612µs (SLO: <10.000µs 📉 -93.9%) vs baseline: +0.5%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.9%

✅ bytearray_noaspect

Time: ✅ 0.484µs (SLO: <10.000µs 📉 -95.2%) vs baseline: +1.3%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +5.1%

✅ bytes_aspect

Time: ✅ 1.281µs (SLO: <10.000µs 📉 -87.2%) vs baseline: +0.7%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ bytes_noaspect

Time: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.9%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +5.1%

✅ bytesio_aspect

Time: ✅ 1.302µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -1.6%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ bytesio_noaspect

Time: ✅ 0.497µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.7%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ capitalize_aspect

Time: ✅ 0.736µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -0.2%

Memory: ✅ 37.139MB (SLO: <39.000MB -4.8%) vs baseline: +4.7%

✅ capitalize_noaspect

Time: ✅ 0.436µs (SLO: <10.000µs 📉 -95.6%) vs baseline: -0.3%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.8%

✅ casefold_aspect

Time: ✅ 0.736µs (SLO: <10.000µs 📉 -92.6%) vs baseline: ~same

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.9%

✅ casefold_noaspect

Time: ✅ 0.369µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.3%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.8%

✅ decode_aspect

Time: ✅ 0.722µs (SLO: <10.000µs 📉 -92.8%) vs baseline: ~same

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +5.1%

✅ decode_noaspect

Time: ✅ 0.416µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -0.8%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +5.1%

✅ encode_aspect

Time: ✅ 0.702µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -1.7%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +5.0%

✅ encode_noaspect

Time: ✅ 0.398µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.2%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +5.0%

✅ format_aspect

Time: ✅ 3.334µs (SLO: <10.000µs 📉 -66.7%) vs baseline: -0.7%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ format_map_aspect

Time: ✅ 3.588µs (SLO: <10.000µs 📉 -64.1%) vs baseline: ~same

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +5.1%

✅ format_map_noaspect

Time: ✅ 0.779µs (SLO: <10.000µs 📉 -92.2%) vs baseline: ~same

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ format_noaspect

Time: ✅ 0.599µs (SLO: <10.000µs 📉 -94.0%) vs baseline: +0.6%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ index_aspect

Time: ✅ 0.364µs (SLO: <10.000µs 📉 -96.4%) vs baseline: +1.7%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ index_noaspect

Time: ✅ 0.278µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.6%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +5.1%

✅ join_aspect

Time: ✅ 1.356µs (SLO: <10.000µs 📉 -86.4%) vs baseline: +0.2%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ join_noaspect

Time: ✅ 0.487µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.4%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.9%

✅ ljust_aspect

Time: ✅ 2.614µs (SLO: <20.000µs 📉 -86.9%) vs baseline: ~same

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +5.0%

✅ ljust_noaspect

Time: ✅ 0.407µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.3%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +5.0%

✅ lower_aspect

Time: ✅ 2.192µs (SLO: <10.000µs 📉 -78.1%) vs baseline: -0.3%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.8%

✅ lower_noaspect

Time: ✅ 0.370µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +1.0%

Memory: ✅ 37.139MB (SLO: <39.000MB -4.8%) vs baseline: +4.6%

✅ lstrip_aspect

Time: ✅ 2.275µs (SLO: <20.000µs 📉 -88.6%) vs baseline: +1.3%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ lstrip_noaspect

Time: ✅ 0.377µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.7%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ modulo_aspect

Time: ✅ 0.994µs (SLO: <10.000µs 📉 -90.1%) vs baseline: -0.8%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.8%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.528µs (SLO: <10.000µs 📉 -84.7%) vs baseline: -0.5%

Memory: ✅ 37.080MB (SLO: <39.000MB -4.9%) vs baseline: +4.6%

✅ modulo_aspect_for_bytes

Time: ✅ 0.970µs (SLO: <10.000µs 📉 -90.3%) vs baseline: -1.8%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.6%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.203µs (SLO: <10.000µs 📉 -88.0%) vs baseline: +1.0%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.9%

✅ modulo_noaspect

Time: ✅ 0.628µs (SLO: <10.000µs 📉 -93.7%) vs baseline: +0.2%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ replace_aspect

Time: ✅ 4.849µs (SLO: <10.000µs 📉 -51.5%) vs baseline: ~same

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.8%

✅ replace_noaspect

Time: ✅ 0.459µs (SLO: <10.000µs 📉 -95.4%) vs baseline: ~same

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.9%

✅ repr_aspect

Time: ✅ 0.907µs (SLO: <10.000µs 📉 -90.9%) vs baseline: +0.3%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.5%

✅ repr_noaspect

Time: ✅ 0.413µs (SLO: <10.000µs 📉 -95.9%) vs baseline: ~same

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.9%

✅ rstrip_aspect

Time: ✅ 1.943µs (SLO: <20.000µs 📉 -90.3%) vs baseline: +0.9%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +5.1%

✅ rstrip_noaspect

Time: ✅ 0.380µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.7%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.8%

✅ slice_aspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.7%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.9%

✅ slice_noaspect

Time: ✅ 0.448µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +1.2%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +5.0%

✅ stringio_aspect

Time: ✅ 1.533µs (SLO: <10.000µs 📉 -84.7%) vs baseline: -2.1%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +5.0%

✅ stringio_noaspect

Time: ✅ 0.722µs (SLO: <10.000µs 📉 -92.8%) vs baseline: +1.3%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.8%

✅ strip_aspect

Time: ✅ 2.248µs (SLO: <20.000µs 📉 -88.8%) vs baseline: +1.0%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +5.0%

✅ strip_noaspect

Time: ✅ 0.377µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -2.6%

Memory: ✅ 37.139MB (SLO: <39.000MB -4.8%) vs baseline: +4.6%

✅ swapcase_aspect

Time: ✅ 2.391µs (SLO: <10.000µs 📉 -76.1%) vs baseline: -1.2%

Memory: ✅ 37.120MB (SLO: <39.000MB -4.8%) vs baseline: +4.6%

✅ swapcase_noaspect

Time: ✅ 0.538µs (SLO: <10.000µs 📉 -94.6%) vs baseline: +0.3%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ title_aspect

Time: ✅ 2.337µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -1.1%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ title_noaspect

Time: ✅ 0.501µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.9%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ translate_aspect

Time: ✅ 3.248µs (SLO: <10.000µs 📉 -67.5%) vs baseline: +0.3%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ translate_noaspect

Time: ✅ 1.036µs (SLO: <10.000µs 📉 -89.6%) vs baseline: +0.2%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +5.0%

✅ upper_aspect

Time: ✅ 2.222µs (SLO: <10.000µs 📉 -77.8%) vs baseline: ~same

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +5.0%

✅ upper_noaspect

Time: ✅ 0.377µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +2.8%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +5.1%

✅ iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.176µs (SLO: <10.000µs 📉 -58.2%) vs baseline: -1.7%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ ospathbasename_noaspect

Time: ✅ 1.093µs (SLO: <10.000µs 📉 -89.1%) vs baseline: +0.7%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

✅ ospathjoin_aspect

Time: ✅ 6.137µs (SLO: <10.000µs 📉 -38.6%) vs baseline: +0.9%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ ospathjoin_noaspect

Time: ✅ 2.275µs (SLO: <10.000µs 📉 -77.3%) vs baseline: -0.5%

Memory: ✅ 37.080MB (SLO: <39.000MB -4.9%) vs baseline: +4.7%

✅ ospathnormcase_aspect

Time: ✅ 3.414µs (SLO: <10.000µs 📉 -65.9%) vs baseline: -0.3%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +5.0%

✅ ospathnormcase_noaspect

Time: ✅ 0.572µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.6%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.8%

✅ ospathsplit_aspect

Time: ✅ 4.733µs (SLO: <10.000µs 📉 -52.7%) vs baseline: -1.1%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +5.1%

✅ ospathsplit_noaspect

Time: ✅ 1.596µs (SLO: <10.000µs 📉 -84.0%) vs baseline: ~same

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ ospathsplitdrive_aspect

Time: ✅ 3.613µs (SLO: <10.000µs 📉 -63.9%) vs baseline: -0.6%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.6%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.695µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -0.5%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +5.0%

✅ ospathsplitext_aspect

Time: ✅ 4.481µs (SLO: <10.000µs 📉 -55.2%) vs baseline: -0.2%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ ospathsplitext_noaspect

Time: ✅ 1.374µs (SLO: <10.000µs 📉 -86.3%) vs baseline: -0.7%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +5.1%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.420µs (SLO: <10.000µs 📉 -85.8%) vs baseline: ~same

Memory: ✅ 37.139MB (SLO: <39.000MB -4.8%) vs baseline: +4.8%

✅ rsplit_noaspect

Time: ✅ 0.575µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.8%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +5.0%

✅ split_aspect

Time: ✅ 1.501µs (SLO: <10.000µs 📉 -85.0%) vs baseline: +6.7%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.8%

✅ split_noaspect

Time: ✅ 0.568µs (SLO: <10.000µs 📉 -94.3%) vs baseline: ~same

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ splitlines_aspect

Time: ✅ 1.417µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +0.4%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +5.1%

✅ splitlines_noaspect

Time: ✅ 0.585µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.9%

Memory: ✅ 37.120MB (SLO: <39.000MB -4.8%) vs baseline: +4.5%

✅ iastpropagation - 2/2

✅ no-propagation

Time: ✅ 49.008µs (SLO: <60.000µs 📉 -18.3%) vs baseline: +0.4%

Memory: ✅ 36.766MB (SLO: <39.000MB -5.7%) vs baseline: +4.6%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.361ms (SLO: <42.000ms -3.9%) vs baseline: +0.1%

Memory: ✅ 34.426MB (SLO: <39.000MB 📉 -11.7%) vs baseline: +5.4%

✅ add-link

Time: ✅ 36.049ms (SLO: <38.550ms -6.5%) vs baseline: -0.2%

Memory: ✅ 34.269MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +4.6%

✅ add-metrics

Time: ✅ 219.874ms (SLO: <232.000ms -5.2%) vs baseline: ~same

Memory: ✅ 34.308MB (SLO: <39.000MB 📉 -12.0%) vs baseline: +5.0%

✅ add-tags

Time: ✅ 209.887ms (SLO: <221.600ms -5.3%) vs baseline: ~same

Memory: ✅ 34.288MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +5.1%

✅ get-context

Time: ✅ 28.972ms (SLO: <31.300ms -7.4%) vs baseline: -0.2%

Memory: ✅ 34.328MB (SLO: <39.000MB 📉 -12.0%) vs baseline: +5.0%

✅ is-recording

Time: ✅ 29.178ms (SLO: <31.000ms -5.9%) vs baseline: +0.4%

Memory: ✅ 34.249MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 63.054ms (SLO: <65.850ms -4.2%) vs baseline: +0.4%

Memory: ✅ 34.269MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +4.5%

✅ set-status

Time: ✅ 31.985ms (SLO: <34.150ms -6.3%) vs baseline: +0.2%

Memory: ✅ 34.288MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +4.9%

✅ start

Time: ✅ 28.940ms (SLO: <30.150ms -4.0%) vs baseline: +0.3%

Memory: ✅ 34.308MB (SLO: <39.000MB 📉 -12.0%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 33.855ms (SLO: <35.350ms -4.2%) vs baseline: -0.1%

Memory: ✅ 34.328MB (SLO: <39.000MB 📉 -12.0%) vs baseline: +5.1%

✅ start-finish-telemetry

Time: ✅ 33.877ms (SLO: <35.450ms -4.4%) vs baseline: ~same

Memory: ✅ 34.328MB (SLO: <39.000MB 📉 -12.0%) vs baseline: +5.0%

✅ update-name

Time: ✅ 30.855ms (SLO: <33.400ms -7.6%) vs baseline: ~same

Memory: ✅ 34.249MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.8%

✅ otelspan - 22/22

✅ add-event

Time: ✅ 40.299ms (SLO: <47.150ms 📉 -14.5%) vs baseline: -0.2%

Memory: ✅ 43.568MB (SLO: <47.000MB -7.3%) vs baseline: +4.8%

✅ add-metrics

Time: ✅ 318.180ms (SLO: <344.800ms -7.7%) vs baseline: -0.3%

Memory: ✅ 651.149MB (SLO: <675.000MB -3.5%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 290.234ms (SLO: <314.000ms -7.6%) vs baseline: -0.6%

Memory: ✅ 652.845MB (SLO: <675.000MB -3.3%) vs baseline: +5.0%

✅ get-context

Time: ✅ 80.323ms (SLO: <92.350ms 📉 -13.0%) vs baseline: ~same

Memory: ✅ 39.353MB (SLO: <46.500MB 📉 -15.4%) vs baseline: +4.7%

✅ is-recording

Time: ✅ 38.061ms (SLO: <44.500ms 📉 -14.5%) vs baseline: +0.1%

Memory: ✅ 42.915MB (SLO: <47.500MB -9.7%) vs baseline: +5.0%

✅ record-exception

Time: ✅ 58.511ms (SLO: <67.650ms 📉 -13.5%) vs baseline: +0.2%

Memory: ✅ 39.677MB (SLO: <47.000MB 📉 -15.6%) vs baseline: +5.0%

✅ set-status

Time: ✅ 43.887ms (SLO: <50.400ms 📉 -12.9%) vs baseline: -0.5%

Memory: ✅ 42.954MB (SLO: <47.000MB -8.6%) vs baseline: +4.8%

✅ start

Time: ✅ 37.521ms (SLO: <43.450ms 📉 -13.6%) vs baseline: +0.8%

Memory: ✅ 42.898MB (SLO: <47.000MB -8.7%) vs baseline: +5.0%

✅ start-finish

Time: ✅ 82.008ms (SLO: <88.000ms -6.8%) vs baseline: ~same

Memory: ✅ 34.446MB (SLO: <46.500MB 📉 -25.9%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 83.594ms (SLO: <89.000ms -6.1%) vs baseline: +0.4%

Memory: ✅ 34.308MB (SLO: <46.500MB 📉 -26.2%) vs baseline: +4.5%

✅ update-name

Time: ✅ 38.977ms (SLO: <45.150ms 📉 -13.7%) vs baseline: +0.1%

Memory: ✅ 43.295MB (SLO: <47.000MB -7.9%) vs baseline: +5.1%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 338.479ms (SLO: <354.300ms -4.5%) vs baseline: -1.3%

Memory: ✅ 38.196MB (SLO: <40.000MB -4.5%) vs baseline: +4.7%

✅ cache_on

Time: ✅ 0.393µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +1.1%

Memory: ✅ 36.832MB (SLO: <39.000MB -5.6%) vs baseline: +3.6%

✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 155.453µs (SLO: <170.000µs -8.6%) vs baseline: -0.8%

Memory: ✅ 37.011MB (SLO: <38.500MB -3.9%) vs baseline: +5.3%

✅ import_many_cached

Time: ✅ 120.585µs (SLO: <130.000µs -7.2%) vs baseline: -1.4%

Memory: ✅ 36.618MB (SLO: <38.500MB -4.9%) vs baseline: +3.9%

✅ import_many_stdlib

Time: ✅ 1.623ms (SLO: <1.750ms -7.2%) vs baseline: +1.0%

Memory: ✅ 36.995MB (SLO: <38.500MB -3.9%) vs baseline: +5.0%

✅ import_many_stdlib_cached

Time: ✅ 0.989ms (SLO: <1.100ms 📉 -10.1%) vs baseline: +1.0%

Memory: ✅ 36.866MB (SLO: <38.500MB -4.2%) vs baseline: +4.0%

✅ import_many_unknown

Time: ✅ 846.080µs (SLO: <890.000µs -4.9%) vs baseline: +0.3%

Memory: ✅ 36.733MB (SLO: <38.500MB -4.6%) vs baseline: +3.9%

✅ import_many_unknown_cached

Time: ✅ 796.569µs (SLO: <870.000µs -8.4%) vs baseline: +1.1%

Memory: ✅ 36.848MB (SLO: <38.500MB -4.3%) vs baseline: +4.1%

✅ import_one

Time: ✅ 19.921µs (SLO: <30.000µs 📉 -33.6%) vs baseline: +0.8%

Memory: ✅ 36.470MB (SLO: <39.000MB -6.5%) vs baseline: +3.4%

✅ import_one_cache

Time: ✅ 6.320µs (SLO: <10.000µs 📉 -36.8%) vs baseline: +0.6%

Memory: ✅ 36.851MB (SLO: <38.500MB -4.3%) vs baseline: +4.5%

✅ import_one_stdlib

Time: ✅ 18.740µs (SLO: <20.000µs -6.3%) vs baseline: +0.1%

Memory: ✅ 36.783MB (SLO: <38.500MB -4.5%) vs baseline: +4.4%

✅ import_one_stdlib_cache

Time: ✅ 6.289µs (SLO: <10.000µs 📉 -37.1%) vs baseline: -0.8%

Memory: ✅ 36.806MB (SLO: <38.500MB -4.4%) vs baseline: +4.1%

✅ import_one_unknown

Time: ✅ 45.734µs (SLO: <50.000µs -8.5%) vs baseline: +1.2%

Memory: ✅ 36.779MB (SLO: <38.500MB -4.5%) vs baseline: +4.2%

✅ import_one_unknown_cache

Time: ✅ 6.265µs (SLO: <10.000µs 📉 -37.4%) vs baseline: -0.4%

Memory: ✅ 36.776MB (SLO: <38.500MB -4.5%) vs baseline: +4.0%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.355µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +0.4%

Memory: ✅ 31.516MB (SLO: <34.000MB -7.3%) vs baseline: +4.9%

✅ high_rate_limit

Time: ✅ 2.408µs (SLO: <10.000µs 📉 -75.9%) vs baseline: -0.1%

Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.7%

✅ long_window

Time: ✅ 2.354µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.3%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.7%

✅ low_rate_limit

Time: ✅ 2.362µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +0.5%

Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.8%

✅ no_rate_limit

Time: ✅ 0.827µs (SLO: <10.000µs 📉 -91.7%) vs baseline: +0.4%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.7%

✅ short_window

Time: ✅ 2.490µs (SLO: <10.000µs 📉 -75.1%) vs baseline: -0.3%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.9%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 309.087ms (SLO: <320.950ms -3.7%) vs baseline: ~same

Memory: ✅ 32.657MB (SLO: <34.500MB -5.3%) vs baseline: +4.8%

✅ deep-profiled

Time: ✅ 328.155ms (SLO: <359.150ms -8.6%) vs baseline: +0.1%

Memory: ✅ 37.694MB (SLO: <39.000MB -3.3%) vs baseline: +2.4%

✅ medium

Time: ✅ 7.018ms (SLO: <7.400ms -5.2%) vs baseline: +0.2%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.7%

✅ shallow

Time: ✅ 0.941ms (SLO: <1.050ms 📉 -10.4%) vs baseline: +0.3%

Memory: ✅ 31.949MB (SLO: <34.000MB -6.0%) vs baseline: +5.1%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 138.250µs (SLO: <290.000µs 📉 -52.3%) vs baseline: +0.6%

Memory: ✅ 31.949MB (SLO: <34.000MB -6.0%) vs baseline: +4.9%

✅ high_match

Time: ✅ 175.863µs (SLO: <480.000µs 📉 -63.4%) vs baseline: +1.1%

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +4.9%

✅ low_match

Time: ✅ 98.262µs (SLO: <120.000µs 📉 -18.1%) vs baseline: -0.7%

Memory: ✅ 600.487MB (SLO: <700.000MB 📉 -14.2%) vs baseline: +4.8%

✅ very_low_match

Time: ✅ 2.676ms (SLO: <8.500ms 📉 -68.5%) vs baseline: ~same

Memory: ✅ 67.978MB (SLO: <75.000MB -9.4%) vs baseline: +4.8%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.563µs (SLO: <20.000µs 📉 -47.2%) vs baseline: ~same

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.8%

✅ all-enabled

Time: ✅ 40.101µs (SLO: <50.000µs 📉 -19.8%) vs baseline: ~same

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.9%

✅ collectipvariant_exists

Time: ✅ 41.551µs (SLO: <50.000µs 📉 -16.9%) vs baseline: +1.0%

Memory: ✅ 32.322MB (SLO: <34.000MB -4.9%) vs baseline: +4.8%

✅ no-collectipvariant

Time: ✅ 40.143µs (SLO: <50.000µs 📉 -19.7%) vs baseline: ~same

Memory: ✅ 32.303MB (SLO: <34.000MB -5.0%) vs baseline: +4.6%

✅ no-useragentvariant

Time: ✅ 38.977µs (SLO: <50.000µs 📉 -22.0%) vs baseline: +0.2%

Memory: ✅ 32.283MB (SLO: <34.000MB -5.0%) vs baseline: +4.8%

✅ obfuscation-no-query

Time: ✅ 40.693µs (SLO: <50.000µs 📉 -18.6%) vs baseline: -0.1%

Memory: ✅ 32.303MB (SLO: <34.000MB -5.0%) vs baseline: +4.9%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.584µs (SLO: <90.000µs 📉 -16.0%) vs baseline: -0.5%

Memory: ✅ 32.716MB (SLO: <34.000MB -3.8%) vs baseline: +4.7%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 77.283µs (SLO: <90.000µs 📉 -14.1%) vs baseline: +1.2%

Memory: ✅ 32.657MB (SLO: <34.000MB -4.0%) vs baseline: +4.5%

✅ obfuscation-send-querystring-disabled

Time: ✅ 153.852µs (SLO: <170.000µs -9.5%) vs baseline: -0.2%

Memory: ✅ 32.735MB (SLO: <34.500MB -5.1%) vs baseline: +5.0%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.226µs (SLO: <160.000µs -7.4%) vs baseline: -0.2%

Memory: ✅ 32.755MB (SLO: <34.500MB -5.1%) vs baseline: +5.0%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 155.791µs (SLO: <170.000µs -8.4%) vs baseline: +0.8%

Memory: ✅ 32.755MB (SLO: <34.500MB -5.1%) vs baseline: +5.0%

✅ useragentvariant_exists_1

Time: ✅ 39.551µs (SLO: <50.000µs 📉 -20.9%) vs baseline: +0.2%

Memory: ✅ 32.283MB (SLO: <34.000MB -5.0%) vs baseline: +4.5%

✅ useragentvariant_exists_2

Time: ✅ 40.547µs (SLO: <50.000µs 📉 -18.9%) vs baseline: -0.5%

Memory: ✅ 32.303MB (SLO: <34.000MB -5.0%) vs baseline: +4.7%

✅ useragentvariant_exists_3

Time: ✅ 40.047µs (SLO: <50.000µs 📉 -19.9%) vs baseline: -0.4%

Memory: ✅ 32.322MB (SLO: <34.000MB -4.9%) vs baseline: +4.7%

✅ useragentvariant_not_exists_1

Time: ✅ 40.507µs (SLO: <50.000µs 📉 -19.0%) vs baseline: +2.6%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.9%

✅ useragentvariant_not_exists_2

Time: ✅ 39.473µs (SLO: <50.000µs 📉 -21.1%) vs baseline: -0.3%

Memory: ✅ 32.401MB (SLO: <34.000MB -4.7%) vs baseline: +5.1%

✅ span - 26/26

✅ add-event

Time: ✅ 20.138ms (SLO: <22.500ms 📉 -10.5%) vs baseline: +1.3%

Memory: ✅ 48.451MB (SLO: <53.000MB -8.6%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 90.345ms (SLO: <93.500ms -3.4%) vs baseline: +0.7%

Memory: ✅ 735.695MB (SLO: <961.000MB 📉 -23.4%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 146.849ms (SLO: <155.000ms -5.3%) vs baseline: -0.2%

Memory: ✅ 735.816MB (SLO: <962.500MB 📉 -23.6%) vs baseline: +4.9%

✅ get-context

Time: ✅ 18.798ms (SLO: <20.500ms -8.3%) vs baseline: +2.9%

Memory: ✅ 47.206MB (SLO: <53.000MB 📉 -10.9%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 18.470ms (SLO: <20.500ms -9.9%) vs baseline: ~same

Memory: ✅ 47.192MB (SLO: <53.000MB 📉 -11.0%) vs baseline: +4.6%

✅ record-exception

Time: ✅ 38.059ms (SLO: <40.000ms -4.9%) vs baseline: +1.2%

Memory: ✅ 41.672MB (SLO: <53.000MB 📉 -21.4%) vs baseline: +4.9%

✅ set-status

Time: ✅ 20.553ms (SLO: <22.000ms -6.6%) vs baseline: +1.7%

Memory: ✅ 47.253MB (SLO: <53.000MB 📉 -10.8%) vs baseline: +4.8%

✅ start

Time: ✅ 18.404ms (SLO: <20.500ms 📉 -10.2%) vs baseline: +1.5%

Memory: ✅ 47.209MB (SLO: <53.000MB 📉 -10.9%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 50.794ms (SLO: <52.500ms -3.2%) vs baseline: +0.8%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 52.022ms (SLO: <54.500ms -4.5%) vs baseline: ~same

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.8%

✅ start-finish-traceid128

Time: ✅ 53.800ms (SLO: <57.000ms -5.6%) vs baseline: +0.2%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.9%

✅ start-traceid128

Time: ✅ 18.954ms (SLO: <22.500ms 📉 -15.8%) vs baseline: +2.2%

Memory: ✅ 47.207MB (SLO: <53.000MB 📉 -10.9%) vs baseline: +4.9%

✅ update-name

Time: ✅ 18.703ms (SLO: <22.000ms 📉 -15.0%) vs baseline: +0.1%

Memory: ✅ 47.870MB (SLO: <53.000MB -9.7%) vs baseline: +4.9%

✅ telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 2.979µs (SLO: <20.000µs 📉 -85.1%) vs baseline: +0.5%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.6%

✅ 1-count-metrics-100-times

Time: ✅ 203.488µs (SLO: <220.000µs -7.5%) vs baseline: ~same

Memory: ✅ 31.949MB (SLO: <34.000MB -6.0%) vs baseline: +5.1%

✅ 1-distribution-metric-1-times

Time: ✅ 3.270µs (SLO: <20.000µs 📉 -83.7%) vs baseline: -0.5%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.7%

✅ 1-distribution-metrics-100-times

Time: ✅ 213.031µs (SLO: <220.000µs -3.2%) vs baseline: -0.5%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.8%

✅ 1-gauge-metric-1-times

Time: ✅ 2.186µs (SLO: <20.000µs 📉 -89.1%) vs baseline: +0.5%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.7%

✅ 1-gauge-metrics-100-times

Time: ✅ 137.197µs (SLO: <150.000µs -8.5%) vs baseline: +0.4%

Memory: ✅ 31.949MB (SLO: <34.000MB -6.0%) vs baseline: +4.9%

✅ 1-rate-metric-1-times

Time: ✅ 3.162µs (SLO: <20.000µs 📉 -84.2%) vs baseline: +2.2%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.9%

✅ 1-rate-metrics-100-times

Time: ✅ 215.907µs (SLO: <250.000µs 📉 -13.6%) vs baseline: +0.5%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.7%

✅ 100-count-metrics-100-times

Time: ✅ 20.525ms (SLO: <22.000ms -6.7%) vs baseline: -2.5%

Memory: ✅ 31.949MB (SLO: <34.000MB -6.0%) vs baseline: +5.1%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.226ms (SLO: <2.300ms -3.2%) vs baseline: -1.0%

Memory: ✅ 31.850MB (SLO: <34.000MB -6.3%) vs baseline: +4.5%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.415ms (SLO: <1.550ms -8.7%) vs baseline: +1.1%

Memory: ✅ 31.850MB (SLO: <34.000MB -6.3%) vs baseline: +4.9%

✅ 100-rate-metrics-100-times

Time: ✅ 2.216ms (SLO: <2.550ms 📉 -13.1%) vs baseline: -0.8%

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +5.1%

✅ flush-1-metric

Time: ✅ 4.530µs (SLO: <20.000µs 📉 -77.4%) vs baseline: -0.8%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.9%

✅ flush-100-metrics

Time: ✅ 176.560µs (SLO: <250.000µs 📉 -29.4%) vs baseline: -1.2%

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +4.9%

✅ flush-1000-metrics

Time: ✅ 2.135ms (SLO: <2.500ms 📉 -14.6%) vs baseline: -0.3%

Memory: ✅ 32.676MB (SLO: <34.500MB -5.3%) vs baseline: +4.8%

✅ tracer - 6/6

✅ large

Time: ✅ 28.960ms (SLO: <32.950ms 📉 -12.1%) vs baseline: +0.3%

Memory: ✅ 32.696MB (SLO: <34.500MB -5.2%) vs baseline: +5.0%

✅ medium

Time: ✅ 2.878ms (SLO: <3.200ms 📉 -10.1%) vs baseline: ~same

Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +4.5%

✅ small

Time: ✅ 324.973µs (SLO: <370.000µs 📉 -12.2%) vs baseline: ~same

Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +4.7%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline

ci(iast): fix flakyness

32b83a0

avara1986 added changelog/no-changelog A changelog entry is not required for this PR. ASM Application Security Monitoring labels Nov 11, 2025

codestyle

9162358

ci(iast): fix flakyness

d242a07

avara1986 added 2 commits November 11, 2025 16:41

ci(iast): fix flakyness

3ae78c0

ci(iast): fix flakyness

1014a1e

avara1986 requested a review from christophe-papazian November 11, 2025 19:13

avara1986 added 3 commits November 11, 2025 20:42

ci(iast): fix flakyness

20ed55e

Merge branch 'main' into avara1986/APPSEC-59960_iast_ci_flakyness

f31dea6

Merge branch 'main' into avara1986/APPSEC-59960_iast_ci_flakyness

133de40

avara1986 marked this pull request as ready for review November 12, 2025 07:48

avara1986 requested a review from a team as a code owner November 12, 2025 07:48

Merge branch 'main' into avara1986/APPSEC-59960_iast_ci_flakyness

17a2e30

ci(iast): fix flakyness #15210

Are you sure you want to change the base?

ci(iast): fix flakyness #15210

Conversation

avara1986 commented Nov 11, 2025

Uh oh!

github-actions bot commented Nov 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Nov 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Nov 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Performance SLOs

✅ appsec

✅ exception-replay-enabled

✅ iast

✅ profiler

✅ resource-renaming

✅ span-code-origin

✅ tracer

✅ tracer-and-profiler

✅ tracer-dont-create-db-spans

✅ tracer-minimal

✅ tracer-native

✅ tracer-no-caches

✅ tracer-no-databases

✅ tracer-no-middleware

✅ tracer-no-templates

✅ errortracking-enabled-all

✅ errortracking-enabled-user

✅ tracer-enabled

✅ appsec-get

✅ appsec-post

✅ appsec-telemetry

✅ debugger

✅ iast-get

✅ profiler

✅ resource-renaming

✅ tracer

✅ tracer-native

⚠️ context_with_data_listeners

✅ context_with_data_no_listeners

✅ get_item_exists

✅ get_item_missing

✅ set_item

✅ errortracking-enabled-all

✅ errortracking-enabled-user

✅ tracer-enabled

✅ appsec-enabled

✅ iast-enabled

✅ tracer-enabled

✅ all_styles_all_headers

✅ b3_headers

✅ b3_single_headers

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

✅ empty_headers

✅ full_t_id_datadog_headers

✅ invalid_priority_header

✅ invalid_span_id_header

✅ invalid_tags_header

✅ invalid_trace_id_header

✅ large_header_no_matches

✅ large_valid_headers_all

✅ medium_header_no_matches

✅ medium_valid_headers_all

✅ none_propagation_style

✅ tracecontext_headers

✅ valid_headers_all

✅ valid_headers_basic

✅ wsgi_empty_headers

✅ wsgi_invalid_priority_header

✅ wsgi_invalid_span_id_header

✅ wsgi_invalid_tags_header

✅ wsgi_invalid_trace_id_header

github-actions bot commented Nov 11, 2025 •

edited

Loading

github-actions bot commented Nov 11, 2025 •

edited

Loading

pr-commenter bot commented Nov 11, 2025 •

edited

Loading