chore(tracer): update ai agents intructions and add basic promptfoo tests #15193

avara1986 · 2025-11-10T12:15:32Z

Update AI Agent Instructions and Add Promptfoo Tests

Summary

This PR enhances the AI agent development experience by providing comprehensive documentation, structured skills/workflows, and automated validation tests for the dd-trace-py project setup.

Changes Overview

📚 Enhanced AI Agent Documentation

.claude/CLAUDE.md - Comprehensive project guide for Claude Code
AGENTS.md - Initial setup instructions for AI assistants

🛠️ New Skills System

.claude/skills/bootstrap/SKILL.md - Environment setup skill
.claude/skills/run-tests/SKILL.md - Test execution skill (updated)

📖 IAST/AppSec Development Guide

.cursor/rules/iast.mdc - Complete IAST implementation guide

🧪 Promptfoo Test Suite

Promptfoo is an open-source testing and evaluation framework for LLM (Large Language Model) applications that helps developers validate prompts, models, and AI outputs through automated assertions and comparisons.
It allows you to write test suites (like unit tests but for AI) to ensure your prompts produce consistent, accurate results across different models, versions, and scenarios - essential for production AI applications.

.promptfoo/tests_install_project.yaml - Automated validation tests

.promptfoo/README.md - Complete promptfoo documentation

✅ How to run tests
✅ Test structure explanation
✅ Writing new tests guide
✅ CI integration examples
✅ Troubleshooting guide

.promptfoo/local_cursor_provider.py - Custom provider for Cursor integration

✅ Allows testing with pre-recorded responses
✅ Supports deterministic and offline testing

.promptfoo/__init__.py - Python package initialization

🔧 Configuration Updates

.cursor/rules/promptfoo-llm.mdc - Promptfoo integration rules (new file)

Testing

Run Promptfoo Tests

# Install promptfoo
npm install -g promptfoo

# Set API key
export ANTHROPIC_API_KEY="your-api-key"

# Run validation tests
promptfoo eval -c .promptfoo/tests_install_project.yaml

# View results
promptfoo view

…ests

github-actions · 2025-11-10T12:16:06Z

CODEOWNERS have been resolved as:

.claude/skills/bootstrap/SKILL.md                                       @DataDog/apm-core-python
.cursor/rules/iast.mdc                                                  @DataDog/apm-core-python
.cursor/rules/promptfoo-llm.mdc                                         @DataDog/apm-core-python
.promptfoo/README.md                                                    @DataDog/python-guild @DataDog/apm-core-python
.promptfoo/__init__.py                                                  @DataDog/apm-core-python
.promptfoo/local_cursor_provider.py                                     @DataDog/apm-core-python
.promptfoo/prompts/project_setup.txt                                    @DataDog/apm-core-python
.promptfoo/tests_install_project.yaml                                   @DataDog/apm-core-python
AGENTS.md                                                               @DataDog/apm-core-python
.claude/CLAUDE.md                                                       @DataDog/apm-core-python
.claude/skills/run-tests/SKILL.md                                       @DataDog/apm-core-python
.gitignore                                                              @DataDog/apm-core-python

github-actions · 2025-11-10T12:42:52Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 236 ± 3 ms.

The average import time from base is: 236 ± 1 ms.

The import time difference between this PR and base is: -0.2 ± 0.1 ms.

The difference is not statistically significant (z = -2.19).

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 1.769 ms (0.75%)

ddtrace.bootstrap.sitecustomize 1.097 ms (0.46%)

ddtrace.bootstrap.preload 1.097 ms (0.46%)

ddtrace.internal.remoteconfig.client 0.577 ms (0.24%)

ddtrace 0.672 ms (0.28%)

ddtrace.internal._unpatched 0.028 ms (0.01%)

json 0.028 ms (0.01%)

json.decoder 0.028 ms (0.01%)

re 0.028 ms (0.01%)

enum 0.028 ms (0.01%)

types 0.028 ms (0.01%)

pr-commenter · 2025-11-10T15:29:52Z

Performance SLOs

Comparing candidate avara1986/APMSP-2346 (795a1f7) with baseline main (83a032e)

📈 Performance Regressions (3 suites)

📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.408µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.5%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

✅ add_inplace_aspect

Time: ✅ 0.403µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.6%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

✅ add_inplace_noaspect

Time: ✅ 0.316µs (SLO: <10.000µs 📉 -96.8%) vs baseline: ~same

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ add_noaspect

Time: ✅ 0.277µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.4%

Memory: ✅ 37.100MB (SLO: <39.000MB -4.9%) vs baseline: +4.4%

✅ bytearray_aspect

Time: ✅ 1.343µs (SLO: <10.000µs 📉 -86.6%) vs baseline: +1.7%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.4%

✅ bytearray_extend_aspect

Time: ✅ 1.501µs (SLO: <10.000µs 📉 -85.0%) vs baseline: -1.2%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ bytearray_extend_noaspect

Time: ✅ 0.612µs (SLO: <10.000µs 📉 -93.9%) vs baseline: -0.3%

Memory: ✅ 37.120MB (SLO: <39.000MB -4.8%) vs baseline: +4.4%

✅ bytearray_noaspect

Time: ✅ 0.479µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -1.0%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ bytes_aspect

Time: ✅ 1.281µs (SLO: <10.000µs 📉 -87.2%) vs baseline: -0.3%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.9%

✅ bytes_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.6%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +5.0%

✅ bytesio_aspect

Time: ✅ 1.309µs (SLO: <10.000µs 📉 -86.9%) vs baseline: -0.8%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.9%

✅ bytesio_noaspect

Time: ✅ 0.503µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +1.1%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.5%

✅ capitalize_aspect

Time: ✅ 0.736µs (SLO: <10.000µs 📉 -92.6%) vs baseline: ~same

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.6%

✅ capitalize_noaspect

Time: ✅ 0.437µs (SLO: <10.000µs 📉 -95.6%) vs baseline: +0.7%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

✅ casefold_aspect

Time: ✅ 0.738µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.5%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.5%

✅ casefold_noaspect

Time: ✅ 0.369µs (SLO: <10.000µs 📉 -96.3%) vs baseline: ~same

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.5%

✅ decode_aspect

Time: ✅ 0.723µs (SLO: <10.000µs 📉 -92.8%) vs baseline: ~same

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +5.0%

✅ decode_noaspect

Time: ✅ 0.420µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +1.4%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

✅ encode_aspect

Time: ✅ 0.707µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -1.1%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.6%

✅ encode_noaspect

Time: ✅ 0.399µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.5%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.6%

✅ format_aspect

Time: ✅ 3.359µs (SLO: <10.000µs 📉 -66.4%) vs baseline: +1.0%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ format_map_aspect

Time: ✅ 3.600µs (SLO: <10.000µs 📉 -64.0%) vs baseline: +3.3%

Memory: ✅ 37.316MB (SLO: <39.000MB -4.3%) vs baseline: +5.2%

✅ format_map_noaspect

Time: ✅ 0.777µs (SLO: <10.000µs 📉 -92.2%) vs baseline: +1.3%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ format_noaspect

Time: ✅ 0.595µs (SLO: <10.000µs 📉 -94.0%) vs baseline: +0.4%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.6%

✅ index_aspect

Time: ✅ 0.360µs (SLO: <10.000µs 📉 -96.4%) vs baseline: +0.1%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ index_noaspect

Time: ✅ 0.280µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.8%

Memory: ✅ 37.120MB (SLO: <39.000MB -4.8%) vs baseline: +4.4%

✅ join_aspect

Time: ✅ 1.357µs (SLO: <10.000µs 📉 -86.4%) vs baseline: +0.5%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ join_noaspect

Time: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.6%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.9%

✅ ljust_aspect

Time: ✅ 2.829µs (SLO: <20.000µs 📉 -85.9%) vs baseline: 📈 +11.1%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

✅ ljust_noaspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.4%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ lower_aspect

Time: ✅ 2.345µs (SLO: <10.000µs 📉 -76.6%) vs baseline: +6.1%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.8%

✅ lower_noaspect

Time: ✅ 0.369µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.4%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ lstrip_aspect

Time: ✅ 2.264µs (SLO: <20.000µs 📉 -88.7%) vs baseline: +1.1%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.5%

✅ lstrip_noaspect

Time: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: ~same

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ modulo_aspect

Time: ✅ 0.996µs (SLO: <10.000µs 📉 -90.0%) vs baseline: -4.3%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.558µs (SLO: <10.000µs 📉 -84.4%) vs baseline: +1.2%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ modulo_aspect_for_bytes

Time: ✅ 0.978µs (SLO: <10.000µs 📉 -90.2%) vs baseline: -0.1%

Memory: ✅ 37.080MB (SLO: <39.000MB -4.9%) vs baseline: +4.2%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.207µs (SLO: <10.000µs 📉 -87.9%) vs baseline: -3.1%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ modulo_noaspect

Time: ✅ 0.629µs (SLO: <10.000µs 📉 -93.7%) vs baseline: +1.1%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ replace_aspect

Time: ✅ 5.475µs (SLO: <10.000µs 📉 -45.2%) vs baseline: 📈 +13.2%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.9%

✅ replace_noaspect

Time: ✅ 0.457µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -1.6%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ repr_aspect

Time: ✅ 0.908µs (SLO: <10.000µs 📉 -90.9%) vs baseline: -0.3%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.8%

✅ repr_noaspect

Time: ✅ 0.424µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +1.7%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.5%

✅ rstrip_aspect

Time: ✅ 1.919µs (SLO: <20.000µs 📉 -90.4%) vs baseline: +2.5%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.4%

✅ rstrip_noaspect

Time: ✅ 0.380µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.6%

Memory: ✅ 37.120MB (SLO: <39.000MB -4.8%) vs baseline: +4.5%

✅ slice_aspect

Time: ✅ 0.492µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.5%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ slice_noaspect

Time: ✅ 0.445µs (SLO: <10.000µs 📉 -95.6%) vs baseline: -1.0%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.5%

✅ stringio_aspect

Time: ✅ 1.730µs (SLO: <10.000µs 📉 -82.7%) vs baseline: 📈 +12.2%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ stringio_noaspect

Time: ✅ 0.710µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -1.2%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.6%

✅ strip_aspect

Time: ✅ 2.237µs (SLO: <20.000µs 📉 -88.8%) vs baseline: -0.2%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.8%

✅ strip_noaspect

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.1%) vs baseline: ~same

Memory: ✅ 37.100MB (SLO: <39.000MB -4.9%) vs baseline: +4.3%

✅ swapcase_aspect

Time: ✅ 2.416µs (SLO: <10.000µs 📉 -75.8%) vs baseline: +0.9%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ swapcase_noaspect

Time: ✅ 0.531µs (SLO: <10.000µs 📉 -94.7%) vs baseline: -1.1%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ title_aspect

Time: ✅ 2.340µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.4%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ title_noaspect

Time: ✅ 0.502µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.2%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

✅ translate_aspect

Time: ✅ 3.416µs (SLO: <10.000µs 📉 -65.8%) vs baseline: +6.0%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ translate_noaspect

Time: ✅ 1.038µs (SLO: <10.000µs 📉 -89.6%) vs baseline: ~same

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ upper_aspect

Time: ✅ 2.280µs (SLO: <10.000µs 📉 -77.2%) vs baseline: +3.9%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.9%

✅ upper_noaspect

Time: ✅ 0.369µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.2%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 5.119µs (SLO: <10.000µs 📉 -48.8%) vs baseline: 📈 +19.7%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.8%

✅ ospathbasename_noaspect

Time: ✅ 1.088µs (SLO: <10.000µs 📉 -89.1%) vs baseline: +0.4%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.8%

✅ ospathjoin_aspect

Time: ✅ 6.894µs (SLO: <10.000µs 📉 -31.1%) vs baseline: 📈 +11.7%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ ospathjoin_noaspect

Time: ✅ 2.305µs (SLO: <10.000µs 📉 -76.9%) vs baseline: ~same

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ ospathnormcase_aspect

Time: ✅ 3.675µs (SLO: <10.000µs 📉 -63.2%) vs baseline: +4.0%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ ospathnormcase_noaspect

Time: ✅ 0.579µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +2.5%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.5%

✅ ospathsplit_aspect

Time: ✅ 5.806µs (SLO: <10.000µs 📉 -41.9%) vs baseline: 📈 +20.2%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ ospathsplit_noaspect

Time: ✅ 1.606µs (SLO: <10.000µs 📉 -83.9%) vs baseline: -0.2%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.7%

✅ ospathsplitdrive_aspect

Time: ✅ 4.084µs (SLO: <10.000µs 📉 -59.2%) vs baseline: 📈 +11.0%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.700µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -0.2%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.7%

✅ ospathsplitext_aspect

Time: ✅ 4.553µs (SLO: <10.000µs 📉 -54.5%) vs baseline: +0.3%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.5%

✅ ospathsplitext_noaspect

Time: ✅ 1.376µs (SLO: <10.000µs 📉 -86.2%) vs baseline: -0.1%

Memory: ✅ 37.297MB (SLO: <39.000MB -4.4%) vs baseline: +4.8%

📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.349µs (SLO: <20.000µs 📉 -83.3%) vs baseline: 📈 +14.1%

Memory: ✅ 31.949MB (SLO: <34.000MB -6.0%) vs baseline: +4.7%

✅ 1-count-metrics-100-times

Time: ✅ 203.971µs (SLO: <220.000µs -7.3%) vs baseline: +3.3%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.8%

✅ 1-distribution-metric-1-times

Time: ✅ 3.313µs (SLO: <20.000µs 📉 -83.4%) vs baseline: +1.7%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.5%

✅ 1-distribution-metrics-100-times

Time: ✅ 211.154µs (SLO: <220.000µs -4.0%) vs baseline: -0.7%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.5%

✅ 1-gauge-metric-1-times

Time: ✅ 2.210µs (SLO: <20.000µs 📉 -89.0%) vs baseline: +0.8%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.4%

✅ 1-gauge-metrics-100-times

Time: ✅ 136.579µs (SLO: <150.000µs -8.9%) vs baseline: +0.3%

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +4.5%

✅ 1-rate-metric-1-times

Time: ✅ 3.135µs (SLO: <20.000µs 📉 -84.3%) vs baseline: +2.7%

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +5.0%

✅ 1-rate-metrics-100-times

Time: ✅ 215.155µs (SLO: <250.000µs 📉 -13.9%) vs baseline: +1.1%

Memory: ✅ 31.929MB (SLO: <34.000MB -6.1%) vs baseline: +4.7%

✅ 100-count-metrics-100-times

Time: ✅ 20.830ms (SLO: <22.000ms -5.3%) vs baseline: +4.6%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.6%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.222ms (SLO: <2.300ms -3.4%) vs baseline: -0.6%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.9%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.404ms (SLO: <1.550ms -9.4%) vs baseline: +0.5%

Memory: ✅ 31.949MB (SLO: <34.000MB -6.0%) vs baseline: +4.8%

✅ 100-rate-metrics-100-times

Time: ✅ 2.227ms (SLO: <2.550ms 📉 -12.7%) vs baseline: +2.4%

Memory: ✅ 31.850MB (SLO: <34.000MB -6.3%) vs baseline: +4.2%

✅ flush-1-metric

Time: ✅ 4.541µs (SLO: <20.000µs 📉 -77.3%) vs baseline: +1.3%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.7%

✅ flush-100-metrics

Time: ✅ 177.604µs (SLO: <250.000µs 📉 -29.0%) vs baseline: +0.7%

Memory: ✅ 31.890MB (SLO: <34.000MB -6.2%) vs baseline: +4.5%

✅ flush-1000-metrics

Time: ✅ 2.154ms (SLO: <2.500ms 📉 -13.8%) vs baseline: +1.2%

Memory: ✅ 32.676MB (SLO: <34.500MB -5.3%) vs baseline: +4.7%

🟡 Near SLO Breach (4 suites)

🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 20.540ms (SLO: <22.300ms -7.9%) vs baseline: +0.3%

Memory: ✅ 66.079MB (SLO: <67.000MB 🟡 -1.4%) vs baseline: +5.1%

✅ exception-replay-enabled

Time: ✅ 1.338ms (SLO: <1.450ms -7.7%) vs baseline: -0.4%

Memory: ✅ 64.157MB (SLO: <67.000MB -4.2%) vs baseline: +4.7%

✅ iast

Time: ✅ 20.495ms (SLO: <22.250ms -7.9%) vs baseline: +0.1%

Memory: ✅ 66.106MB (SLO: <67.000MB 🟡 -1.3%) vs baseline: +4.8%

✅ profiler

Time: ✅ 15.581ms (SLO: <16.550ms -5.9%) vs baseline: +0.5%

Memory: ✅ 54.033MB (SLO: <54.500MB 🟡 -0.9%) vs baseline: +4.8%

✅ resource-renaming

Time: ✅ 20.590ms (SLO: <21.750ms -5.3%) vs baseline: +0.2%

Memory: ✅ 66.121MB (SLO: <67.000MB 🟡 -1.3%) vs baseline: +4.9%

✅ span-code-origin

Time: ✅ 25.399ms (SLO: <28.200ms -9.9%) vs baseline: ~same

Memory: ✅ 67.599MB (SLO: <69.500MB -2.7%) vs baseline: +5.0%

✅ tracer

Time: ✅ 20.465ms (SLO: <21.750ms -5.9%) vs baseline: -0.2%

Memory: ✅ 66.058MB (SLO: <67.000MB 🟡 -1.4%) vs baseline: +4.8%

✅ tracer-and-profiler

Time: ✅ 22.671ms (SLO: <23.500ms -3.5%) vs baseline: ~same

Memory: ✅ 67.938MB (SLO: <68.000MB 🟡 ~same) vs baseline: +5.2%

✅ tracer-dont-create-db-spans

Time: ✅ 19.347ms (SLO: <21.500ms 📉 -10.0%) vs baseline: +0.1%

Memory: ✅ 66.112MB (SLO: <67.000MB 🟡 -1.3%) vs baseline: +5.0%

✅ tracer-minimal

Time: ✅ 16.605ms (SLO: <17.500ms -5.1%) vs baseline: -0.4%

Memory: ✅ 66.015MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.7%

✅ tracer-native

Time: ✅ 20.431ms (SLO: <21.750ms -6.1%) vs baseline: +0.1%

Memory: ✅ 67.908MB (SLO: <72.500MB -6.3%) vs baseline: +5.1%

✅ tracer-no-caches

Time: ✅ 18.477ms (SLO: <19.650ms -6.0%) vs baseline: ~same

Memory: ✅ 65.982MB (SLO: <67.000MB 🟡 -1.5%) vs baseline: +4.8%

✅ tracer-no-databases

Time: ✅ 18.815ms (SLO: <20.100ms -6.4%) vs baseline: +0.5%

Memory: ✅ 65.784MB (SLO: <67.000MB 🟡 -1.8%) vs baseline: +4.5%

✅ tracer-no-middleware

Time: ✅ 20.187ms (SLO: <21.500ms -6.1%) vs baseline: +0.4%

Memory: ✅ 66.076MB (SLO: <67.000MB 🟡 -1.4%) vs baseline: +4.9%

✅ tracer-no-templates

Time: ✅ 20.279ms (SLO: <22.000ms -7.8%) vs baseline: +0.1%

Memory: ✅ 66.079MB (SLO: <67.000MB 🟡 -1.4%) vs baseline: +4.9%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.002ms (SLO: <19.850ms -9.3%) vs baseline: +0.3%

Memory: ✅ 66.129MB (SLO: <66.500MB 🟡 -0.6%) vs baseline: +5.1%

✅ errortracking-enabled-user

Time: ✅ 18.096ms (SLO: <19.400ms -6.7%) vs baseline: +0.2%

Memory: ✅ 66.134MB (SLO: <66.500MB 🟡 -0.6%) vs baseline: +5.1%

✅ tracer-enabled

Time: ✅ 18.071ms (SLO: <19.450ms -7.1%) vs baseline: -0.3%

Memory: ✅ 65.847MB (SLO: <66.500MB 🟡 -1.0%) vs baseline: +4.6%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.596ms (SLO: <4.750ms -3.3%) vs baseline: -0.2%

Memory: ✅ 62.340MB (SLO: <65.000MB -4.1%) vs baseline: +4.9%

✅ appsec-post

Time: ✅ 6.615ms (SLO: <6.750ms 🟡 -2.0%) vs baseline: -0.3%

Memory: ✅ 62.375MB (SLO: <65.000MB -4.0%) vs baseline: +4.9%

✅ appsec-telemetry

Time: ✅ 4.581ms (SLO: <4.750ms -3.6%) vs baseline: -0.4%

Memory: ✅ 62.344MB (SLO: <65.000MB -4.1%) vs baseline: +4.9%

✅ debugger

Time: ✅ 1.857ms (SLO: <2.000ms -7.1%) vs baseline: -0.2%

Memory: ✅ 45.207MB (SLO: <47.000MB -3.8%) vs baseline: +4.4%

✅ iast-get

Time: ✅ 1.858ms (SLO: <2.000ms -7.1%) vs baseline: -0.1%

Memory: ✅ 42.081MB (SLO: <49.000MB 📉 -14.1%) vs baseline: +4.4%

✅ profiler

Time: ✅ 1.915ms (SLO: <2.100ms -8.8%) vs baseline: -0.1%

Memory: ✅ 46.653MB (SLO: <47.000MB 🟡 -0.7%) vs baseline: +4.7%

✅ resource-renaming

Time: ✅ 3.362ms (SLO: <3.650ms -7.9%) vs baseline: -0.3%

Memory: ✅ 52.576MB (SLO: <53.500MB 🟡 -1.7%) vs baseline: +4.8%

✅ tracer

Time: ✅ 3.355ms (SLO: <3.650ms -8.1%) vs baseline: -0.1%

Memory: ✅ 52.567MB (SLO: <53.500MB 🟡 -1.7%) vs baseline: +4.7%

✅ tracer-native

Time: ✅ 3.351ms (SLO: <3.650ms -8.2%) vs baseline: -0.2%

Memory: ✅ 54.338MB (SLO: <60.000MB -9.4%) vs baseline: +5.3%

🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 307.953ms (SLO: <320.950ms -4.0%) vs baseline: -0.4%

Memory: ✅ 32.676MB (SLO: <34.500MB -5.3%) vs baseline: +4.7%

✅ deep-profiled

Time: ✅ 328.096ms (SLO: <359.150ms -8.6%) vs baseline: ~same

Memory: ✅ 38.755MB (SLO: <39.000MB 🟡 -0.6%) vs baseline: +6.7%

✅ medium

Time: ✅ 6.994ms (SLO: <7.400ms -5.5%) vs baseline: -0.1%

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +4.8%

✅ shallow

Time: ✅ 0.942ms (SLO: <1.050ms 📉 -10.3%) vs baseline: +0.2%

Memory: ✅ 31.850MB (SLO: <34.000MB -6.3%) vs baseline: +4.4%

⚠️ Unstable Tests (1 suite)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.311µs (SLO: <20.000µs 📉 -33.4%) vs baseline: +0.3%

Memory: ✅ 31.595MB (SLO: <33.500MB -5.7%) vs baseline: +4.5%

✅ context_with_data_no_listeners

Time: ✅ 3.298µs (SLO: <10.000µs 📉 -67.0%) vs baseline: +1.1%

Memory: ✅ 31.536MB (SLO: <33.500MB -5.9%) vs baseline: +5.0%

✅ get_item_exists

Time: ✅ 0.582µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.3%

Memory: ✅ 31.556MB (SLO: <33.500MB -5.8%) vs baseline: +4.6%

✅ get_item_missing

Time: ✅ 0.641µs (SLO: <10.000µs 📉 -93.6%) vs baseline: +0.3%

Memory: ✅ 31.477MB (SLO: <33.500MB -6.0%) vs baseline: +4.4%

✅ set_item

Time: ✅ 24.429µs (SLO: <30.000µs 📉 -18.6%) vs baseline: +0.5%

Memory: ✅ 31.516MB (SLO: <33.500MB -5.9%) vs baseline: +4.7%

✅ All Tests Passing (16 suites)

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.070ms (SLO: <2.300ms -10.0%) vs baseline: +0.1%

Memory: ✅ 52.337MB (SLO: <53.500MB -2.2%) vs baseline: +4.9%

✅ errortracking-enabled-user

Time: ✅ 2.067ms (SLO: <2.250ms -8.1%) vs baseline: -0.3%

Memory: ✅ 52.298MB (SLO: <53.500MB -2.2%) vs baseline: +4.8%

✅ tracer-enabled

Time: ✅ 2.070ms (SLO: <2.300ms 📉 -10.0%) vs baseline: -0.1%

Memory: ✅ 52.239MB (SLO: <53.500MB -2.4%) vs baseline: +4.6%

✅ flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.958ms (SLO: <4.200ms -5.8%) vs baseline: -0.8%

Memory: ✅ 62.364MB (SLO: <66.000MB -5.5%) vs baseline: +4.9%

✅ iast-enabled

Time: ✅ 2.436ms (SLO: <2.800ms 📉 -13.0%) vs baseline: -0.3%

Memory: ✅ 58.609MB (SLO: <60.000MB -2.3%) vs baseline: +4.3%

✅ tracer-enabled

Time: ✅ 2.057ms (SLO: <2.250ms -8.6%) vs baseline: -0.3%

Memory: ✅ 52.612MB (SLO: <54.500MB -3.5%) vs baseline: +4.8%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 82.516µs (SLO: <100.000µs 📉 -17.5%) vs baseline: +0.6%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.8%

✅ b3_headers

Time: ✅ 14.223µs (SLO: <20.000µs 📉 -28.9%) vs baseline: -1.3%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.5%

✅ b3_single_headers

Time: ✅ 13.245µs (SLO: <20.000µs 📉 -33.8%) vs baseline: -1.1%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.7%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.112µs (SLO: <80.000µs 📉 -19.9%) vs baseline: +0.1%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.6%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.050µs (SLO: <80.000µs 📉 -17.4%) vs baseline: -0.2%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.4%

✅ empty_headers

Time: ✅ 1.614µs (SLO: <10.000µs 📉 -83.9%) vs baseline: ~same

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.3%

✅ full_t_id_datadog_headers

Time: ✅ 22.790µs (SLO: <30.000µs 📉 -24.0%) vs baseline: -0.9%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.5%

✅ invalid_priority_header

Time: ✅ 6.545µs (SLO: <10.000µs 📉 -34.6%) vs baseline: -0.5%

Memory: ✅ 32.008MB (SLO: <33.500MB -4.5%) vs baseline: +4.7%

✅ invalid_span_id_header

Time: ✅ 6.537µs (SLO: <10.000µs 📉 -34.6%) vs baseline: -0.3%

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.5%

✅ invalid_tags_header

Time: ✅ 6.556µs (SLO: <10.000µs 📉 -34.4%) vs baseline: ~same

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.4%

✅ invalid_trace_id_header

Time: ✅ 6.504µs (SLO: <10.000µs 📉 -35.0%) vs baseline: ~same

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.6%

✅ large_header_no_matches

Time: ✅ 27.635µs (SLO: <30.000µs -7.9%) vs baseline: -0.1%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.6%

✅ large_valid_headers_all

Time: ✅ 28.641µs (SLO: <40.000µs 📉 -28.4%) vs baseline: -0.3%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +4.7%

✅ medium_header_no_matches

Time: ✅ 9.842µs (SLO: <20.000µs 📉 -50.8%) vs baseline: -0.2%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +5.1%

✅ medium_valid_headers_all

Time: ✅ 11.239µs (SLO: <20.000µs 📉 -43.8%) vs baseline: +0.1%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.8%

✅ none_propagation_style

Time: ✅ 1.715µs (SLO: <10.000µs 📉 -82.9%) vs baseline: -0.9%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.8%

✅ tracecontext_headers

Time: ✅ 34.597µs (SLO: <40.000µs 📉 -13.5%) vs baseline: +0.3%

Memory: ✅ 31.929MB (SLO: <33.500MB -4.7%) vs baseline: +4.7%

✅ valid_headers_all

Time: ✅ 6.544µs (SLO: <10.000µs 📉 -34.6%) vs baseline: -0.8%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +4.6%

✅ valid_headers_basic

Time: ✅ 6.068µs (SLO: <10.000µs 📉 -39.3%) vs baseline: -0.4%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.7%

✅ wsgi_empty_headers

Time: ✅ 1.588µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -2.4%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.2%

✅ wsgi_invalid_priority_header

Time: ✅ 6.567µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.4%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.2%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.598µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -1.5%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.7%

✅ wsgi_invalid_tags_header

Time: ✅ 6.617µs (SLO: <10.000µs 📉 -33.8%) vs baseline: ~same

Memory: ✅ 32.008MB (SLO: <33.500MB -4.5%) vs baseline: +4.7%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.538µs (SLO: <10.000µs 📉 -34.6%) vs baseline: -0.8%

Memory: ✅ 31.909MB (SLO: <33.500MB -4.7%) vs baseline: +4.4%

✅ wsgi_large_header_no_matches

Time: ✅ 28.671µs (SLO: <40.000µs 📉 -28.3%) vs baseline: ~same

Memory: ✅ 32.008MB (SLO: <33.500MB -4.5%) vs baseline: +4.9%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.812µs (SLO: <40.000µs 📉 -25.5%) vs baseline: -0.6%

Memory: ✅ 32.027MB (SLO: <33.500MB -4.4%) vs baseline: +4.9%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.106µs (SLO: <20.000µs 📉 -49.5%) vs baseline: -0.2%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +4.8%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.522µs (SLO: <20.000µs 📉 -42.4%) vs baseline: -0.1%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +4.6%

✅ wsgi_valid_headers_all

Time: ✅ 6.591µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +0.2%

Memory: ✅ 32.027MB (SLO: <33.500MB -4.4%) vs baseline: +5.1%

✅ wsgi_valid_headers_basic

Time: ✅ 6.177µs (SLO: <10.000µs 📉 -38.2%) vs baseline: +0.5%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.7%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.115µs (SLO: <30.000µs 📉 -29.6%) vs baseline: ~same

Memory: ✅ 32.047MB (SLO: <33.500MB -4.3%) vs baseline: +4.9%

✅ with_all

Time: ✅ 28.321µs (SLO: <40.000µs 📉 -29.2%) vs baseline: -0.2%

Memory: ✅ 31.968MB (SLO: <33.500MB -4.6%) vs baseline: +4.7%

✅ with_dd_origin

Time: ✅ 24.815µs (SLO: <30.000µs 📉 -17.3%) vs baseline: -0.4%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +4.3%

✅ with_priority_and_origin

Time: ✅ 24.476µs (SLO: <40.000µs 📉 -38.8%) vs baseline: +1.0%

Memory: ✅ 32.008MB (SLO: <33.500MB -4.5%) vs baseline: +4.5%

✅ with_sampling_priority

Time: ✅ 21.041µs (SLO: <30.000µs 📉 -29.9%) vs baseline: -0.1%

Memory: ✅ 31.949MB (SLO: <33.500MB -4.6%) vs baseline: +4.7%

✅ with_tags

Time: ✅ 27.034µs (SLO: <40.000µs 📉 -32.4%) vs baseline: +1.4%

Memory: ✅ 32.008MB (SLO: <33.500MB -4.5%) vs baseline: +4.8%

✅ with_tags_invalid

Time: ✅ 28.435µs (SLO: <40.000µs 📉 -28.9%) vs baseline: +1.7%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +4.8%

✅ with_tags_max_size

Time: ✅ 27.191µs (SLO: <40.000µs 📉 -32.0%) vs baseline: +0.6%

Memory: ✅ 31.988MB (SLO: <33.500MB -4.5%) vs baseline: +4.9%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 31.947µs (SLO: <40.000µs 📉 -20.1%) vs baseline: +0.3%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ re_expand_noaspect

Time: ✅ 28.676µs (SLO: <40.000µs 📉 -28.3%) vs baseline: ~same

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +5.0%

✅ re_findall_aspect

Time: ✅ 2.891µs (SLO: <10.000µs 📉 -71.1%) vs baseline: -0.6%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.5%

✅ re_findall_noaspect

Time: ✅ 1.430µs (SLO: <10.000µs 📉 -85.7%) vs baseline: +1.1%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ re_finditer_aspect

Time: ✅ 4.423µs (SLO: <10.000µs 📉 -55.8%) vs baseline: +2.1%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.6%

✅ re_finditer_noaspect

Time: ✅ 1.411µs (SLO: <10.000µs 📉 -85.9%) vs baseline: +0.6%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ re_fullmatch_aspect

Time: ✅ 2.690µs (SLO: <10.000µs 📉 -73.1%) vs baseline: +0.8%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.5%

✅ re_fullmatch_noaspect

Time: ✅ 1.331µs (SLO: <10.000µs 📉 -86.7%) vs baseline: +0.9%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.4%

✅ re_group_aspect

Time: ✅ 2.898µs (SLO: <10.000µs 📉 -71.0%) vs baseline: -0.5%

Memory: ✅ 37.277MB (SLO: <39.000MB -4.4%) vs baseline: +4.9%

✅ re_group_noaspect

Time: ✅ 1.595µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -1.0%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

✅ re_groups_aspect

Time: ✅ 3.052µs (SLO: <10.000µs 📉 -69.5%) vs baseline: ~same

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ re_groups_noaspect

Time: ✅ 1.690µs (SLO: <10.000µs 📉 -83.1%) vs baseline: -1.2%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

✅ re_match_aspect

Time: ✅ 2.697µs (SLO: <10.000µs 📉 -73.0%) vs baseline: -1.0%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.6%

✅ re_match_noaspect

Time: ✅ 1.295µs (SLO: <10.000µs 📉 -87.0%) vs baseline: ~same

Memory: ✅ 37.100MB (SLO: <39.000MB -4.9%) vs baseline: +4.5%

✅ re_search_aspect

Time: ✅ 2.533µs (SLO: <10.000µs 📉 -74.7%) vs baseline: +1.3%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ re_search_noaspect

Time: ✅ 1.205µs (SLO: <10.000µs 📉 -87.9%) vs baseline: +0.6%

Memory: ✅ 37.179MB (SLO: <39.000MB -4.7%) vs baseline: +4.6%

✅ re_sub_aspect

Time: ✅ 3.419µs (SLO: <10.000µs 📉 -65.8%) vs baseline: +2.2%

Memory: ✅ 37.139MB (SLO: <39.000MB -4.8%) vs baseline: +4.5%

✅ re_sub_noaspect

Time: ✅ 1.536µs (SLO: <10.000µs 📉 -84.6%) vs baseline: +0.8%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.9%

✅ re_subn_aspect

Time: ✅ 3.668µs (SLO: <10.000µs 📉 -63.3%) vs baseline: +2.4%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ re_subn_noaspect

Time: ✅ 1.612µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.3%

Memory: ✅ 37.238MB (SLO: <39.000MB -4.5%) vs baseline: +4.8%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.429µs (SLO: <10.000µs 📉 -85.7%) vs baseline: +1.6%

Memory: ✅ 37.159MB (SLO: <39.000MB -4.7%) vs baseline: +4.5%

✅ rsplit_noaspect

Time: ✅ 0.580µs (SLO: <10.000µs 📉 -94.2%) vs baseline: ~same

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.5%

✅ split_aspect

Time: ✅ 1.411µs (SLO: <10.000µs 📉 -85.9%) vs baseline: +1.0%

Memory: ✅ 37.198MB (SLO: <39.000MB -4.6%) vs baseline: +4.6%

✅ split_noaspect

Time: ✅ 0.567µs (SLO: <10.000µs 📉 -94.3%) vs baseline: ~same

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.5%

✅ splitlines_aspect

Time: ✅ 1.426µs (SLO: <10.000µs 📉 -85.7%) vs baseline: +1.5%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.7%

✅ splitlines_noaspect

Time: ✅ 0.585µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.7%

Memory: ✅ 37.257MB (SLO: <39.000MB -4.5%) vs baseline: +4.7%

✅ iastpropagation - 2/2

✅ no-propagation

Time: ✅ 48.598µs (SLO: <60.000µs 📉 -19.0%) vs baseline: -0.2%

Memory: ✅ 36.884MB (SLO: <39.000MB -5.4%) vs baseline: +4.8%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.410ms (SLO: <42.000ms -3.8%) vs baseline: -0.6%

Memory: ✅ 34.406MB (SLO: <39.000MB 📉 -11.8%) vs baseline: +4.8%

✅ add-link

Time: ✅ 36.386ms (SLO: <38.550ms -5.6%) vs baseline: +0.5%

Memory: ✅ 34.229MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.6%

✅ add-metrics

Time: ✅ 217.936ms (SLO: <232.000ms -6.1%) vs baseline: -0.7%

Memory: ✅ 34.288MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +4.7%

✅ add-tags

Time: ✅ 212.604ms (SLO: <221.600ms -4.1%) vs baseline: +0.4%

Memory: ✅ 34.269MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +4.5%

✅ get-context

Time: ✅ 29.140ms (SLO: <31.300ms -6.9%) vs baseline: ~same

Memory: ✅ 34.288MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +4.6%

✅ is-recording

Time: ✅ 29.216ms (SLO: <31.000ms -5.8%) vs baseline: ~same

Memory: ✅ 34.308MB (SLO: <39.000MB 📉 -12.0%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 63.146ms (SLO: <65.850ms -4.1%) vs baseline: +0.2%

Memory: ✅ 34.347MB (SLO: <39.000MB 📉 -11.9%) vs baseline: +4.7%

✅ set-status

Time: ✅ 31.848ms (SLO: <34.150ms -6.7%) vs baseline: +0.3%

Memory: ✅ 34.249MB (SLO: <39.000MB 📉 -12.2%) vs baseline: +4.4%

✅ start

Time: ✅ 28.589ms (SLO: <30.150ms -5.2%) vs baseline: -1.2%

Memory: ✅ 34.347MB (SLO: <39.000MB 📉 -11.9%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 33.826ms (SLO: <35.350ms -4.3%) vs baseline: ~same

Memory: ✅ 34.288MB (SLO: <39.000MB 📉 -12.1%) vs baseline: +4.7%

✅ start-finish-telemetry

Time: ✅ 33.779ms (SLO: <35.450ms -4.7%) vs baseline: -0.2%

Memory: ✅ 34.308MB (SLO: <39.000MB 📉 -12.0%) vs baseline: +4.9%

✅ update-name

Time: ✅ 30.754ms (SLO: <33.400ms -7.9%) vs baseline: -0.6%

Memory: ✅ 34.406MB (SLO: <39.000MB 📉 -11.8%) vs baseline: +5.2%

✅ otelspan - 22/22

✅ add-event

Time: ✅ 40.215ms (SLO: <47.150ms 📉 -14.7%) vs baseline: ~same

Memory: ✅ 43.516MB (SLO: <47.000MB -7.4%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 318.054ms (SLO: <344.800ms -7.8%) vs baseline: +0.2%

Memory: ✅ 652.616MB (SLO: <675.000MB -3.3%) vs baseline: +5.0%

✅ add-tags

Time: ✅ 289.962ms (SLO: <314.000ms -7.7%) vs baseline: +1.0%

Memory: ✅ 653.496MB (SLO: <675.000MB -3.2%) vs baseline: +4.9%

✅ get-context

Time: ✅ 80.153ms (SLO: <92.350ms 📉 -13.2%) vs baseline: +0.4%

Memory: ✅ 39.378MB (SLO: <46.500MB 📉 -15.3%) vs baseline: +4.7%

✅ is-recording

Time: ✅ 38.082ms (SLO: <44.500ms 📉 -14.4%) vs baseline: +0.2%

Memory: ✅ 42.884MB (SLO: <47.500MB -9.7%) vs baseline: +4.5%

✅ record-exception

Time: ✅ 58.466ms (SLO: <67.650ms 📉 -13.6%) vs baseline: +0.7%

Memory: ✅ 39.694MB (SLO: <47.000MB 📉 -15.5%) vs baseline: +4.8%

✅ set-status

Time: ✅ 44.051ms (SLO: <50.400ms 📉 -12.6%) vs baseline: +0.4%

Memory: ✅ 42.938MB (SLO: <47.000MB -8.6%) vs baseline: +4.7%

✅ start

Time: ✅ 37.415ms (SLO: <43.450ms 📉 -13.9%) vs baseline: ~same

Memory: ✅ 42.882MB (SLO: <47.000MB -8.8%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 81.819ms (SLO: <88.000ms -7.0%) vs baseline: +0.2%

Memory: ✅ 34.328MB (SLO: <46.500MB 📉 -26.2%) vs baseline: +4.5%

✅ start-finish-telemetry

Time: ✅ 83.142ms (SLO: <89.000ms -6.6%) vs baseline: -0.4%

Memory: ✅ 34.328MB (SLO: <46.500MB 📉 -26.2%) vs baseline: +4.1%

✅ update-name

Time: ✅ 39.080ms (SLO: <45.150ms 📉 -13.4%) vs baseline: +0.1%

Memory: ✅ 43.372MB (SLO: <47.000MB -7.7%) vs baseline: +4.8%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 343.346ms (SLO: <354.300ms -3.1%) vs baseline: -0.2%

Memory: ✅ 37.636MB (SLO: <40.000MB -5.9%) vs baseline: +2.5%

✅ cache_on

Time: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.2%

Memory: ✅ 37.511MB (SLO: <39.000MB -3.8%) vs baseline: +4.4%

✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 155.973µs (SLO: <170.000µs -8.3%) vs baseline: +0.7%

Memory: ✅ 36.746MB (SLO: <38.500MB -4.6%) vs baseline: +4.3%

✅ import_many_cached

Time: ✅ 121.164µs (SLO: <130.000µs -6.8%) vs baseline: ~same

Memory: ✅ 37.056MB (SLO: <38.500MB -3.8%) vs baseline: +5.0%

✅ import_many_stdlib

Time: ✅ 1.610ms (SLO: <1.750ms -8.0%) vs baseline: -0.3%

Memory: ✅ 36.913MB (SLO: <38.500MB -4.1%) vs baseline: +3.7%

✅ import_many_stdlib_cached

Time: ✅ 0.973ms (SLO: <1.100ms 📉 -11.5%) vs baseline: -0.3%

Memory: ✅ 36.863MB (SLO: <38.500MB -4.3%) vs baseline: +4.1%

✅ import_many_unknown

Time: ✅ 832.801µs (SLO: <890.000µs -6.4%) vs baseline: ~same

Memory: ✅ 37.135MB (SLO: <38.500MB -3.5%) vs baseline: +4.8%

✅ import_many_unknown_cached

Time: ✅ 790.818µs (SLO: <870.000µs -9.1%) vs baseline: -0.3%

Memory: ✅ 36.871MB (SLO: <38.500MB -4.2%) vs baseline: +3.7%

✅ import_one

Time: ✅ 19.795µs (SLO: <30.000µs 📉 -34.0%) vs baseline: +0.3%

Memory: ✅ 37.038MB (SLO: <39.000MB -5.0%) vs baseline: +5.1%

✅ import_one_cache

Time: ✅ 6.314µs (SLO: <10.000µs 📉 -36.9%) vs baseline: +0.6%

Memory: ✅ 37.015MB (SLO: <38.500MB -3.9%) vs baseline: +4.9%

✅ import_one_stdlib

Time: ✅ 18.789µs (SLO: <20.000µs -6.1%) vs baseline: +0.2%

Memory: ✅ 37.041MB (SLO: <38.500MB -3.8%) vs baseline: +5.0%

✅ import_one_stdlib_cache

Time: ✅ 6.265µs (SLO: <10.000µs 📉 -37.3%) vs baseline: -1.0%

Memory: ✅ 36.752MB (SLO: <38.500MB -4.5%) vs baseline: +3.8%

✅ import_one_unknown

Time: ✅ 45.480µs (SLO: <50.000µs -9.0%) vs baseline: +0.2%

Memory: ✅ 36.755MB (SLO: <38.500MB -4.5%) vs baseline: +4.1%

✅ import_one_unknown_cache

Time: ✅ 6.279µs (SLO: <10.000µs 📉 -37.2%) vs baseline: +0.6%

Memory: ✅ 36.718MB (SLO: <38.500MB -4.6%) vs baseline: +3.8%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.337µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.3%

Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.5%

✅ high_rate_limit

Time: ✅ 2.414µs (SLO: <10.000µs 📉 -75.9%) vs baseline: +0.4%

Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.5%

✅ long_window

Time: ✅ 2.358µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +0.4%

Memory: ✅ 31.497MB (SLO: <34.000MB -7.4%) vs baseline: +4.6%

✅ low_rate_limit

Time: ✅ 2.360µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +0.5%

Memory: ✅ 31.477MB (SLO: <34.000MB -7.4%) vs baseline: +4.5%

✅ no_rate_limit

Time: ✅ 0.834µs (SLO: <10.000µs 📉 -91.7%) vs baseline: +0.9%

Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.5%

✅ short_window

Time: ✅ 2.503µs (SLO: <10.000µs 📉 -75.0%) vs baseline: +1.0%

Memory: ✅ 31.457MB (SLO: <34.000MB -7.5%) vs baseline: +4.6%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 138.103µs (SLO: <290.000µs 📉 -52.4%) vs baseline: -0.2%

Memory: ✅ 31.615MB (SLO: <34.000MB -7.0%) vs baseline: +3.7%

✅ high_match

Time: ✅ 174.599µs (SLO: <480.000µs 📉 -63.6%) vs baseline: ~same

Memory: ✅ 31.516MB (SLO: <34.000MB -7.3%) vs baseline: +4.7%

✅ low_match

Time: ✅ 99.417µs (SLO: <120.000µs 📉 -17.2%) vs baseline: -0.3%

Memory: ✅ 600.495MB (SLO: <700.000MB 📉 -14.2%) vs baseline: +4.8%

✅ very_low_match

Time: ✅ 2.679ms (SLO: <8.500ms 📉 -68.5%) vs baseline: ~same

Memory: ✅ 68.049MB (SLO: <75.000MB -9.3%) vs baseline: +5.0%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.666µs (SLO: <20.000µs 📉 -46.7%) vs baseline: +1.8%

Memory: ✅ 32.322MB (SLO: <34.000MB -4.9%) vs baseline: +4.7%

✅ all-enabled

Time: ✅ 40.732µs (SLO: <50.000µs 📉 -18.5%) vs baseline: +1.9%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.6%

✅ collectipvariant_exists

Time: ✅ 40.875µs (SLO: <50.000µs 📉 -18.2%) vs baseline: +0.5%

Memory: ✅ 32.362MB (SLO: <34.000MB -4.8%) vs baseline: +4.6%

✅ no-collectipvariant

Time: ✅ 40.959µs (SLO: <50.000µs 📉 -18.1%) vs baseline: +2.6%

Memory: ✅ 32.283MB (SLO: <34.000MB -5.0%) vs baseline: +4.3%

✅ no-useragentvariant

Time: ✅ 38.912µs (SLO: <50.000µs 📉 -22.2%) vs baseline: +1.1%

Memory: ✅ 32.381MB (SLO: <34.000MB -4.8%) vs baseline: +4.6%

✅ obfuscation-no-query

Time: ✅ 41.577µs (SLO: <50.000µs 📉 -16.8%) vs baseline: +3.4%

Memory: ✅ 32.381MB (SLO: <34.000MB -4.8%) vs baseline: +4.7%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.663µs (SLO: <90.000µs 📉 -15.9%) vs baseline: -0.1%

Memory: ✅ 32.775MB (SLO: <34.000MB -3.6%) vs baseline: +4.7%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 77.857µs (SLO: <90.000µs 📉 -13.5%) vs baseline: +1.9%

Memory: ✅ 32.716MB (SLO: <34.000MB -3.8%) vs baseline: +4.6%

✅ obfuscation-send-querystring-disabled

Time: ✅ 155.635µs (SLO: <170.000µs -8.4%) vs baseline: +1.1%

Memory: ✅ 32.814MB (SLO: <34.500MB -4.9%) vs baseline: +4.9%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 150.079µs (SLO: <160.000µs -6.2%) vs baseline: +1.2%

Memory: ✅ 32.716MB (SLO: <34.500MB -5.2%) vs baseline: +4.6%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 156.238µs (SLO: <170.000µs -8.1%) vs baseline: +1.0%

Memory: ✅ 32.696MB (SLO: <34.500MB -5.2%) vs baseline: +4.7%

✅ useragentvariant_exists_1

Time: ✅ 39.425µs (SLO: <50.000µs 📉 -21.1%) vs baseline: +0.3%

Memory: ✅ 32.322MB (SLO: <34.000MB -4.9%) vs baseline: +4.5%

✅ useragentvariant_exists_2

Time: ✅ 40.493µs (SLO: <50.000µs 📉 -19.0%) vs baseline: -0.1%

Memory: ✅ 32.342MB (SLO: <34.000MB -4.9%) vs baseline: +4.9%

✅ useragentvariant_exists_3

Time: ✅ 40.646µs (SLO: <50.000µs 📉 -18.7%) vs baseline: +1.6%

Memory: ✅ 32.303MB (SLO: <34.000MB -5.0%) vs baseline: +4.5%

✅ useragentvariant_not_exists_1

Time: ✅ 40.320µs (SLO: <50.000µs 📉 -19.4%) vs baseline: +2.6%

Memory: ✅ 32.440MB (SLO: <34.000MB -4.6%) vs baseline: +5.0%

✅ useragentvariant_not_exists_2

Time: ✅ 39.310µs (SLO: <50.000µs 📉 -21.4%) vs baseline: -0.6%

Memory: ✅ 32.303MB (SLO: <34.000MB -5.0%) vs baseline: +4.4%

✅ span - 26/26

✅ add-event

Time: ✅ 20.128ms (SLO: <22.500ms 📉 -10.5%) vs baseline: +0.4%

Memory: ✅ 48.379MB (SLO: <53.000MB -8.7%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 89.562ms (SLO: <93.500ms -4.2%) vs baseline: -0.1%

Memory: ✅ 735.814MB (SLO: <961.000MB 📉 -23.4%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 148.104ms (SLO: <155.000ms -4.4%) vs baseline: +0.7%

Memory: ✅ 735.887MB (SLO: <962.500MB 📉 -23.5%) vs baseline: +4.8%

✅ get-context

Time: ✅ 18.817ms (SLO: <20.500ms -8.2%) vs baseline: +3.2%

Memory: ✅ 47.253MB (SLO: <53.000MB 📉 -10.8%) vs baseline: +4.7%

✅ is-recording

Time: ✅ 18.718ms (SLO: <20.500ms -8.7%) vs baseline: +0.8%

Memory: ✅ 47.253MB (SLO: <53.000MB 📉 -10.8%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 38.183ms (SLO: <40.000ms -4.5%) vs baseline: +2.0%

Memory: ✅ 41.607MB (SLO: <53.000MB 📉 -21.5%) vs baseline: +4.7%

✅ set-status

Time: ✅ 20.078ms (SLO: <22.000ms -8.7%) vs baseline: +0.2%

Memory: ✅ 47.248MB (SLO: <53.000MB 📉 -10.9%) vs baseline: +4.8%

✅ start

Time: ✅ 18.347ms (SLO: <20.500ms 📉 -10.5%) vs baseline: +1.1%

Memory: ✅ 47.250MB (SLO: <53.000MB 📉 -10.8%) vs baseline: +4.5%

✅ start-finish

Time: ✅ 51.063ms (SLO: <52.500ms -2.7%) vs baseline: +0.7%

Memory: ✅ 31.929MB (SLO: <34.000MB -6.1%) vs baseline: +4.7%

✅ start-finish-telemetry

Time: ✅ 52.282ms (SLO: <54.500ms -4.1%) vs baseline: -0.1%

Memory: ✅ 31.909MB (SLO: <34.000MB -6.1%) vs baseline: +4.7%

✅ start-finish-traceid128

Time: ✅ 54.139ms (SLO: <57.000ms -5.0%) vs baseline: +0.5%

Memory: ✅ 31.870MB (SLO: <34.000MB -6.3%) vs baseline: +4.4%

✅ start-traceid128

Time: ✅ 19.277ms (SLO: <22.500ms 📉 -14.3%) vs baseline: +4.3%

Memory: ✅ 47.184MB (SLO: <53.000MB 📉 -11.0%) vs baseline: +4.7%

✅ update-name

Time: ✅ 18.790ms (SLO: <22.000ms 📉 -14.6%) vs baseline: +0.4%

Memory: ✅ 47.793MB (SLO: <53.000MB -9.8%) vs baseline: +4.5%

✅ tracer - 6/6

✅ large

Time: ✅ 28.874ms (SLO: <32.950ms 📉 -12.4%) vs baseline: -0.2%

Memory: ✅ 32.657MB (SLO: <34.500MB -5.3%) vs baseline: +4.7%

✅ medium

Time: ✅ 2.888ms (SLO: <3.200ms -9.7%) vs baseline: +0.6%

Memory: ✅ 31.693MB (SLO: <34.000MB -6.8%) vs baseline: +5.0%

✅ small

Time: ✅ 325.778µs (SLO: <370.000µs 📉 -12.0%) vs baseline: +0.1%

Memory: ✅ 31.516MB (SLO: <34.000MB -7.3%) vs baseline: +4.9%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline

brettlangdon

any way you can break this up into smaller PRs, there is a lot of AI generated content here to review, would be easier to approach as one-off improvements.

There is also stuff like the bootstrap skill which is probably showing areas where we need to improve our onboarding/dev experience. ideally no one really needs any of those steps ever.... I think I mostly have test running where you only need docker installed in order to find/run a test suite (from riot).

This would mean things like pyenv/installing all Python versions, installing deps needed to build/install native packages locally, etc are all expert level optimizations.

I am also trying to make re-building the native extensions much faster in the docker container as well, so hopefully the advanced usage of calling build_ext directly is no longer needed.

brettlangdon · 2025-11-10T15:43:25Z

.claude/skills/bootstrap/SKILL.md

+- `opentelemetry-api>=1,<2`
+- `wrapt>=1,<3`
+
+### Install Development Dependencies


this seems wrong, no one should have to install these dependencies manually

wantsui · 2025-11-10T18:29:21Z

.claude/CLAUDE.md

+- **Tracer**: Object that creates and manages spans (main entry point for manual instrumentation)
+- **Profiler**: Component collecting CPU/memory usage data at code level
+- **ddtrace-run**: CLI utility for automatic instrumentation via monkey-patching
+- **Tag**: Key-value metadata added to spans for filtering/grouping/analysis


nit: our public doc calls these "span attributes" now so it may be good to clarify with a similar definition: https://docs.datadoghq.com/tracing/trace_explorer/span_tags_attributes/#span-attributes

wantsui · 2025-11-10T19:23:22Z

.claude/skills/bootstrap/SKILL.md

+docker-compose up -d
+
+# Verify services are running
+docker-compose ps
+
+# View service logs
+docker-compose logs testagent
+docker-compose logs redis
+
+# Stop services when done
+docker-compose down


Note if this repo uses compose v2, the new command is docker compose, not docker-compose: https://docs.docker.com/compose/releases/migrate/#what-are-the-differences-between-compose-v1-and-compose-v2

avara1986 added 2 commits November 10, 2025 12:58

chore(tracer): update AI agents intructions and add basic promptfoo t…

2072853

…ests

chore(tracer): update gitignore

9ffd3be

avara1986 added the changelog/no-changelog A changelog entry is not required for this PR. label Nov 10, 2025

codestyle

2033cb2

avara1986 changed the title ~~chore(tracer): update AI agents intructions and add basic promptfoo t…~~ chore(tracer): update ai agents intructions and add basic promptfoo tests Nov 10, 2025

Merge branch 'main' into avara1986/APMSP-2346

0910924

avara1986 marked this pull request as ready for review November 10, 2025 14:44

avara1986 requested review from a team as code owners November 10, 2025 14:44

avara1986 requested review from KowalskiThomas and juanjux November 10, 2025 14:44

brettlangdon reviewed Nov 10, 2025

View reviewed changes

wantsui reviewed Nov 10, 2025

View reviewed changes

Update AGENTS.md

795a1f7

avara1986 marked this pull request as draft November 11, 2025 14:51

chore(tracer): update ai agents intructions and add basic promptfoo tests #15193

Are you sure you want to change the base?

chore(tracer): update ai agents intructions and add basic promptfoo tests #15193

Conversation

avara1986 commented Nov 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Update AI Agent Instructions and Add Promptfoo Tests

Summary

Changes Overview

📚 Enhanced AI Agent Documentation

🛠️ New Skills System

📖 IAST/AppSec Development Guide

🧪 Promptfoo Test Suite

🔧 Configuration Updates

Testing

Run Promptfoo Tests

Uh oh!

github-actions bot commented Nov 10, 2025

Uh oh!

github-actions bot commented Nov 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Nov 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Performance SLOs

✅ add_aspect

✅ add_inplace_aspect

✅ add_inplace_noaspect

✅ add_noaspect

✅ bytearray_aspect

✅ bytearray_extend_aspect

✅ bytearray_extend_noaspect

✅ bytearray_noaspect

✅ bytes_aspect

✅ bytes_noaspect

✅ bytesio_aspect

✅ bytesio_noaspect

✅ capitalize_aspect

✅ capitalize_noaspect

✅ casefold_aspect

✅ casefold_noaspect

✅ decode_aspect

✅ decode_noaspect

✅ encode_aspect

✅ encode_noaspect

✅ format_aspect

✅ format_map_aspect

✅ format_map_noaspect

✅ format_noaspect

✅ index_aspect

✅ index_noaspect

✅ join_aspect

✅ join_noaspect

✅ ljust_aspect

✅ ljust_noaspect

✅ lower_aspect

✅ lower_noaspect

✅ lstrip_aspect

✅ lstrip_noaspect

✅ modulo_aspect

✅ modulo_aspect_for_bytearray_bytearray

✅ modulo_aspect_for_bytes

✅ modulo_aspect_for_bytes_bytearray

✅ modulo_noaspect

✅ replace_aspect

✅ replace_noaspect

✅ repr_aspect

✅ repr_noaspect

✅ rstrip_aspect

✅ rstrip_noaspect

✅ slice_aspect

✅ slice_noaspect

✅ stringio_aspect

✅ stringio_noaspect

✅ strip_aspect

✅ strip_noaspect

✅ swapcase_aspect

avara1986 commented Nov 10, 2025 •

edited

Loading

github-actions bot commented Nov 10, 2025 •

edited

Loading

pr-commenter bot commented Nov 10, 2025 •

edited

Loading