Skip to content

profiler: use reqwest based exporter #1383

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
danielsn wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

profiler: use reqwest based exporter #1383

danielsn wants to merge 1 commit into from

Conversation

@danielsn
Copy link
Contributor

@danielsn danielsn commented Dec 4, 2025 •
edited
Loading

What does this PR do?

Uses reqwest to send profiles instead of hyper.

Motivation

The hyper code has to handle a lot of lower level issues and is therefore more complex.

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@danielsn danielsn force-pushed the dsn/r-and-d-exporter branch 2 times, most recently from 9837dcd to a529caa Compare December 5, 2025 03:11
@codecov-commenter
Copy link

codecov-commenter commented Dec 5, 2025 •
edited
Loading

Codecov Report

❌ Patch coverage is 88.78505% with 24 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.11%. Comparing base (6b26318) to head (0e5a4d8).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1383      +/-   ##
==========================================
+ Coverage   70.96%   71.11%   +0.14%     
==========================================
  Files         400      401       +1     
  Lines       63691    63875     +184     
==========================================
+ Hits        45199    45425     +226     
+ Misses      18492    18450      -42
Components Coverage Δ
libdd-crashtracker 58.42% <ø> (-0.28%) ⬇️
libdd-crashtracker-ffi 14.72% <ø> (-2.02%) ⬇️
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.57% <ø> (+0.75%) ⬆️
libdd-data-pipeline-ffi 79.20% <ø> (+2.61%) ⬆️
libdd-common 81.20% <ø> (+0.05%) ⬆️
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 59.98% <ø> (ø)
libdd-telemetry-ffi 21.24% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.71% <ø> (+0.10%) ⬆️
libdd-profiling 80.25% <88.78%> (+0.61%) ⬆️
libdd-profiling-ffi 62.13% <ø> (ø)
datadog-sidecar 35.86% <ø> (-0.02%) ⬇️
datdog-sidecar-ffi 10.74% <ø> (-0.09%) ⬇️
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 59.65% <ø> (ø)
libdd-trace-utils 90.03% <ø> (+0.14%) ⬆️
datadog-tracer-flare 62.06% <ø> (-1.43%) ⬇️
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pr-commenter
Copy link

pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-12-05 18:22:22

Comparing candidate commit 0e5a4d8 in PR branch dsn/r-and-d-exporter with baseline commit 6b26318 in branch main.

Found 4 performance improvements and 12 performance regressions! Performance is the same for 39 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/ 378282246310005

  • 🟥 execution_time [+3.838µs; +4.042µs] or [+5.323%; +5.605%]
  • 🟥 throughput [-737848.046op/s; -700338.681op/s] or [-5.320%; -5.050%]

scenario:credit_card/is_card_number/378282246310005

  • 🟥 execution_time [+3.981µs; +4.212µs] or [+5.771%; +6.107%]
  • 🟥 throughput [-836917.003op/s; -790326.673op/s] or [-5.772%; -5.451%]

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+6.548µs; +6.577µs] or [+14.346%; +14.409%]
  • 🟥 throughput [-2761117.249op/s; -2747479.994op/s] or [-12.602%; -12.540%]

scenario:credit_card/is_card_number/x371413321323331

  • 🟩 execution_time [-541.339ns; -527.011ns] or [-8.409%; -8.186%]
  • 🟩 throughput [+13861106.907op/s; +14273017.836op/s] or [+8.924%; +9.189%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+3.211µs; +3.249µs] or [+5.913%; +5.984%]
  • 🟥 throughput [-1040037.402op/s; -1027831.200op/s] or [-5.647%; -5.581%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+4.336µs; +4.406µs] or [+8.582%; +8.722%]
  • 🟥 throughput [-1588017.252op/s; -1563944.054op/s] or [-8.023%; -7.901%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟥 execution_time [+6.485µs; +6.523µs] or [+14.188%; +14.271%]
  • 🟥 throughput [-2734487.425op/s; -2716661.231op/s] or [-12.498%; -12.417%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟩 execution_time [-563.165ns; -548.130ns] or [-8.750%; -8.516%]
  • 🟩 throughput [+14477984.262op/s; +14911524.364op/s] or [+9.318%; +9.597%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.779ms 61.226ms ± 2.212ms 60.947ms ± 0.041ms 60.994ms 61.238ms 70.754ms 83.176ms 36.47% 8.854 79.236 3.60% 0.156ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [60.919ms; 61.532ms] or [-0.501%; +0.501%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.719µs 34.196µs ± 0.823µs 33.828µs ± 0.053µs 33.901µs 35.931µs 36.035µs 37.474µs 10.78% 1.788 1.576 2.40% 0.058µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.082µs; 34.310µs] or [-0.334%; +0.334%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.959µs 206.761µs ± 1.276µs 206.491µs ± 0.229µs 206.742µs 207.342µs 213.019µs 213.212µs 3.25% 4.310 17.931 0.62% 0.090µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4690158.020op/s 4836691.440op/s ± 29080.399op/s 4842818.791op/s ± 5383.663op/s 4848004.100op/s 4852061.180op/s 4853620.735op/s 4855345.479op/s 0.26% -4.284 17.768 0.60% 2056.295op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.590µs 18.703µs ± 0.097µs 18.672µs ± 0.035µs 18.723µs 18.905µs 19.022µs 19.188µs 2.76% 2.123 5.283 0.52% 0.007µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52115813.705op/s 53467531.285op/s ± 274551.854op/s 53554777.867op/s ± 99621.957op/s 53644635.884op/s 53720093.730op/s 53745118.452op/s 53792900.978op/s 0.44% -2.081 5.036 0.51% 19413.748op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.813µs 10.881µs ± 0.030µs 10.883µs ± 0.017µs 10.898µs 10.921µs 10.981µs 11.015µs 1.22% 0.806 2.920 0.27% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 90785607.363op/s 91901203.802op/s ± 249995.634op/s 91889393.261op/s ± 144639.660op/s 92048696.583op/s 92285112.530op/s 92423488.008op/s 92480684.950op/s 0.64% -0.772 2.798 0.27% 17677.361op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.584µs; 206.937µs] or [-0.086%; +0.086%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4832661.176op/s; 4840721.703op/s] or [-0.083%; +0.083%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.690µs; 18.717µs] or [-0.072%; +0.072%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53429481.038op/s; 53505581.531op/s] or [-0.071%; +0.071%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.877µs; 10.885µs] or [-0.038%; +0.038%] None None None
normalization/normalize_name/normalize_name/good throughput [91866556.811op/s; 91935850.792op/s] or [-0.038%; +0.038%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.004µs 5.087µs ± 0.034µs 5.086µs ± 0.030µs 5.119µs 5.130µs 5.132µs 5.134µs 0.94% -0.288 -1.178 0.67% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.082µs; 5.092µs] or [-0.093%; +0.093%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.127ms 14.181ms ± 0.031ms 14.174ms ± 0.013ms 14.189ms 14.235ms 14.309ms 14.339ms 1.16% 2.314 7.190 0.22% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.177ms; 14.185ms] or [-0.030%; +0.030%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 185.510ns 189.036ns ± 2.753ns 188.711ns ± 1.911ns 190.524ns 193.927ns 196.329ns 198.607ns 5.24% 0.883 0.427 1.45% 0.195ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [188.654ns; 189.417ns] or [-0.202%; +0.202%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.874µs 146.910µs ± 1.872µs 146.564µs ± 0.615µs 147.304µs 148.718µs 153.434µs 165.405µs 12.86% 6.107 51.501 1.27% 0.132µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.650µs; 147.169µs] or [-0.177%; +0.177%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 85.260µs 85.598µs ± 0.226µs 85.576µs ± 0.044µs 85.632µs 85.717µs 85.781µs 88.587µs 3.52% 11.599 150.958 0.26% 0.016µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [85.567µs; 85.629µs] or [-0.037%; +0.037%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.640ms 10.668ms ± 0.015ms 10.667ms ± 0.009ms 10.677ms 10.692ms 10.709ms 10.751ms 0.79% 1.424 5.379 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.666ms; 10.670ms] or [-0.019%; +0.019%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 245.531ns 257.269ns ± 14.234ns 251.010ns ± 3.529ns 260.428ns 288.383ns 300.243ns 301.782ns 20.23% 1.644 1.608 5.52% 1.006ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [255.296ns; 259.241ns] or [-0.767%; +0.767%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.893µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.919µs 3.919µs 0.16% -1.634 10.098 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255141510.705op/s 255563290.825op/s ± 185425.388op/s 255543780.379op/s ± 114752.678op/s 255670162.287op/s 255821254.719op/s 255900692.275op/s 256854064.283op/s 0.51% 1.654 10.266 0.07% 13111.555op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 79.921µs 81.647µs ± 0.651µs 81.665µs ± 0.465µs 82.099µs 82.610µs 83.086µs 83.405µs 2.13% -0.049 -0.283 0.80% 0.046µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11989708.736op/s 12248622.101op/s ± 97719.015op/s 12245168.008op/s ± 69693.186op/s 12316032.737op/s 12404517.411op/s 12473417.694op/s 12512343.223op/s 2.18% 0.090 -0.284 0.80% 6909.778op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 75.027µs 76.046µs ± 0.418µs 76.082µs ± 0.291µs 76.346µs 76.663µs 76.904µs 77.004µs 1.21% -0.142 -0.471 0.55% 0.030µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12986260.438op/s 13150341.364op/s ± 72316.508op/s 13143746.742op/s ± 50287.142op/s 13200704.706op/s 13275912.398op/s 13319347.901op/s 13328486.611op/s 1.41% 0.167 -0.464 0.55% 5113.549op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.902µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.919µs 3.920µs 0.18% -0.017 0.681 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255118546.749op/s 255574507.228op/s ± 166447.654op/s 255584393.973op/s ± 123279.014op/s 255701377.620op/s 255817889.543op/s 255865548.737op/s 256264950.878op/s 0.27% 0.022 0.691 0.06% 11769.627op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 71.717µs 73.071µs ± 0.473µs 73.097µs ± 0.313µs 73.411µs 73.747µs 73.971µs 74.675µs 2.16% -0.136 0.772 0.65% 0.033µs 1 200
credit_card/is_card_number/378282246310005 throughput 13391320.684op/s 13685925.094op/s ± 88732.837op/s 13680437.662op/s ± 58368.837op/s 13737396.675op/s 13832432.307op/s 13914676.128op/s 13943698.196op/s 1.92% 0.189 0.748 0.65% 6274.359op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.138µs 52.203µs ± 0.031µs 52.201µs ± 0.022µs 52.223µs 52.266µs 52.277µs 52.292µs 0.17% 0.409 -0.205 0.06% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19123347.885op/s 19156102.418op/s ± 11464.844op/s 19156689.601op/s ± 7917.693op/s 19164220.401op/s 19172923.997op/s 19177658.240op/s 19179955.029op/s 0.12% -0.406 -0.209 0.06% 810.687op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 5.705µs 5.904µs ± 0.051µs 5.899µs ± 0.036µs 5.939µs 5.985µs 6.007µs 6.033µs 2.27% -0.352 0.726 0.87% 0.004µs 1 200
credit_card/is_card_number/x371413321323331 throughput 165752796.065op/s 169396665.004op/s ± 1481171.432op/s 169514432.559op/s ± 1035070.698op/s 170380646.665op/s 171691154.101op/s 173702776.236op/s 175274608.937op/s 3.40% 0.421 0.879 0.87% 104734.636op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.913µs 3.916µs 3.918µs 3.919µs 0.18% -1.378 11.642 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255197337.804op/s 255645792.806op/s ± 168462.774op/s 255651554.033op/s ± 100414.767op/s 255747792.870op/s 255861284.720op/s 255915867.631op/s 256846124.461op/s 0.47% 1.402 11.820 0.07% 11912.117op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.142µs 64.371µs ± 0.146µs 64.343µs ± 0.078µs 64.430µs 64.656µs 64.829µs 65.000µs 1.02% 1.336 2.146 0.23% 0.010µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15384601.730op/s 15535041.455op/s ± 35018.588op/s 15541727.072op/s ± 18830.256op/s 15559952.961op/s 15575144.017op/s 15584430.459op/s 15590467.988op/s 0.31% -1.320 2.083 0.22% 2476.188op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.375µs 57.530µs ± 0.104µs 57.504µs ± 0.047µs 57.563µs 57.704µs 57.968µs 58.197µs 1.21% 2.557 10.957 0.18% 0.007µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17182880.558op/s 17382260.297op/s ± 31326.459op/s 17390046.807op/s ± 14090.249op/s 17399989.996op/s 17416086.108op/s 17424930.824op/s 17429090.896op/s 0.22% -2.522 10.694 0.18% 2215.115op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.893µs 3.911µs ± 0.003µs 3.911µs ± 0.001µs 3.913µs 3.916µs 3.917µs 3.919µs 0.20% -1.259 10.084 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255149718.602op/s 255660158.671op/s ± 171501.487op/s 255667836.986op/s ± 85474.796op/s 255747332.438op/s 255878969.428op/s 255999783.531op/s 256840345.450op/s 0.46% 1.280 10.238 0.07% 12126.986op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.565µs 54.890µs ± 0.231µs 54.798µs ± 0.111µs 55.020µs 55.343µs 55.553µs 55.656µs 1.56% 1.108 0.619 0.42% 0.016µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17967647.042op/s 18218497.318op/s ± 76386.950op/s 18248839.379op/s ± 37002.808op/s 18275076.451op/s 18304368.521op/s 18312832.567op/s 18326835.986op/s 0.43% -1.091 0.567 0.42% 5401.373op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.141µs 52.210µs ± 0.039µs 52.204µs ± 0.024µs 52.230µs 52.269µs 52.291µs 52.493µs 0.55% 2.132 12.532 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19050142.058op/s 19153458.870op/s ± 14233.147op/s 19155536.171op/s ± 8983.204op/s 19163185.126op/s 19170872.161op/s 19175876.097op/s 19178598.602op/s 0.12% -2.110 12.327 0.07% 1006.435op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 5.746µs 5.881µs ± 0.054µs 5.878µs ± 0.042µs 5.925µs 5.963µs 6.004µs 6.031µs 2.61% 0.083 -0.399 0.91% 0.004µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 165810873.341op/s 170065521.523op/s ± 1555842.090op/s 170135393.050op/s ± 1210378.351op/s 171190450.099op/s 172470457.819op/s 173413734.115op/s 174046630.335op/s 2.30% -0.040 -0.412 0.91% 110014.649op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.913µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255537592.650op/s; 255588989.001op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [81.557µs; 81.737µs] or [-0.111%; +0.111%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12235079.185op/s; 12262165.017op/s] or [-0.111%; +0.111%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [75.988µs; 76.104µs] or [-0.076%; +0.076%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13140318.991op/s; 13160363.737op/s] or [-0.076%; +0.076%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255551439.184op/s; 255597575.272op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [73.005µs; 73.136µs] or [-0.090%; +0.090%] None None None
credit_card/is_card_number/378282246310005 throughput [13673627.576op/s; 13698222.612op/s] or [-0.090%; +0.090%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.198µs; 52.207µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19154513.501op/s; 19157691.335op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 execution_time [5.897µs; 5.911µs] or [-0.121%; +0.121%] None None None
credit_card/is_card_number/x371413321323331 throughput [169191388.889op/s; 169601941.120op/s] or [-0.121%; +0.121%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.911µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255622445.486op/s; 255669140.126op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.351µs; 64.391µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15530188.215op/s; 15539894.694op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.516µs; 57.545µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17377918.751op/s; 17386601.843op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255636390.215op/s; 255683927.128op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.858µs; 54.922µs] or [-0.058%; +0.058%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18207910.822op/s; 18229083.815op/s] or [-0.058%; +0.058%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.205µs; 52.215µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19151486.292op/s; 19155431.447op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [5.873µs; 5.888µs] or [-0.127%; +0.127%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [169849896.772op/s; 170281146.273op/s] or [-0.127%; +0.127%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.186µs 3.272µs ± 1.405µs 3.024µs ± 0.030µs 3.062µs 3.688µs 13.751µs 14.804µs 389.57% 7.190 53.661 42.85% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.077µs; 3.467µs] or [-5.953%; +5.953%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.176µs 533.985µs ± 0.429µs 533.932µs ± 0.316µs 534.292µs 534.723µs 534.922µs 535.555µs 0.30% 0.477 -0.038 0.08% 0.030µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1867223.085op/s 1872711.465op/s ± 1503.297op/s 1872896.847op/s ± 1110.446op/s 1873869.667op/s 1874891.191op/s 1875412.510op/s 1875554.944op/s 0.14% -0.473 -0.047 0.08% 106.299op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 381.318µs 381.928µs ± 0.377µs 381.882µs ± 0.209µs 382.096µs 382.459µs 382.808µs 385.201µs 0.87% 3.492 26.873 0.10% 0.027µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2596044.621op/s 2618300.502op/s ± 2577.792op/s 2618607.552op/s ± 1433.691op/s 2619806.156op/s 2621276.371op/s 2622395.965op/s 2622485.763op/s 0.15% -3.443 26.317 0.10% 182.277op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 188.657µs 189.307µs ± 0.284µs 189.324µs ± 0.182µs 189.493µs 189.690µs 189.772µs 190.848µs 0.80% 0.583 3.144 0.15% 0.020µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5239773.373op/s 5282450.344op/s ± 7926.474op/s 5281940.862op/s ± 5069.360op/s 5287756.131op/s 5294829.694op/s 5297875.954op/s 5300611.976op/s 0.35% -0.561 3.033 0.15% 560.486op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.860µs 36.968µs ± 0.049µs 36.961µs ± 0.030µs 36.996µs 37.059µs 37.080µs 37.111µs 0.41% 0.396 -0.004 0.13% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26945968.946op/s 27050533.984op/s ± 35878.979op/s 27055304.582op/s ± 22176.824op/s 27075503.623op/s 27105018.697op/s 27125930.628op/s 27129684.149op/s 0.27% -0.388 -0.010 0.13% 2537.027op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.014µs 45.183µs ± 0.120µs 45.173µs ± 0.044µs 45.211µs 45.291µs 45.365µs 46.596µs 3.15% 8.259 94.398 0.26% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21461192.114op/s 22132413.712op/s ± 57530.288op/s 22137143.373op/s ± 21578.143op/s 22159629.128op/s 22180163.809op/s 22193452.729op/s 22215452.549op/s 0.35% -8.037 90.908 0.26% 4068.006op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [533.926µs; 534.045µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1872503.123op/s; 1872919.808op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.875µs; 381.980µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2617943.245op/s; 2618657.759op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [189.267µs; 189.346µs] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5281351.811op/s; 5283548.877op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.961µs; 36.975µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27045561.502op/s; 27055506.465op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.166µs; 45.200µs] or [-0.037%; +0.037%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22124440.567op/s; 22140386.856op/s] or [-0.036%; +0.036%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.421µs 2.449µs ± 0.017µs 2.445µs ± 0.010µs 2.456µs 2.486µs 2.492µs 2.495µs 2.04% 0.881 -0.039 0.71% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.447µs; 2.451µs] or [-0.098%; +0.098%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.467µs 25.233µs ± 8.989µs 17.968µs ± 0.308µs 33.189µs 40.277µs 50.454µs 59.296µs 230.02% 0.850 0.173 35.54% 0.636µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.987µs; 26.478µs] or [-4.937%; +4.937%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.114ms 6.378ms ± 0.089ms 6.408ms ± 0.021ms 6.426ms 6.461ms 6.497ms 6.596ms 2.93% -1.459 1.301 1.40% 0.006ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.366ms; 6.391ms] or [-0.194%; +0.194%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0e5a4d8 1764957999 dsn/r-and-d-exporter
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 159.200µs 160.241µs ± 1.177µs 160.146µs ± 0.188µs 160.349µs 160.599µs 160.817µs 176.349µs 10.12% 12.913 174.384 0.73% 0.083µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [160.078µs; 160.404µs] or [-0.102%; +0.102%] None None None

Baseline

Omitted due to size.

@danielsn danielsn force-pushed the dsn/r-and-d-exporter branch from a529caa to 0c12dc1 Compare December 5, 2025 03:36
@dd-octo-sts
Copy link

dd-octo-sts bot commented Dec 5, 2025 •
edited
Loading

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.44 MB 7.44 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 86.25 MB 88.31 MB +2.39% (+2.06 MB) ⚠️
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 58.31 MB 58.91 MB +1.02% (+612.77 KB) ⚠️
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.43 MB 8.45 MB +.25% (+21.92 KB) 🔍
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.04 MB 102.19 MB +2.15% (+2.15 MB) ⚠️
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.54 MB 9.61 MB +.73% (+71.54 KB) 🔍
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.69 MB 19.74 MB +.25% (+52.00 KB) 🔍
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 139.73 MB 148.05 MB +5.95% (+8.32 MB) 🚨
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 742.46 MB 816.66 MB +9.99% (+74.19 MB) 🚨
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.37 MB 6.38 MB +.13% (+9.00 KB) 🔍
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.73 MB 19.76 MB +.15% (+32.00 KB) 🔍
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.75 MB 38.81 MB +.16% (+65.92 KB) 🔍
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.80 MB 16.85 MB +.27% (+47.50 KB) 🔍
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 142.34 MB 150.73 MB +5.89% (+8.39 MB) 🚨
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 730.71 MB 802.85 MB +9.87% (+72.13 MB) 🚨
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.88 MB 4.90 MB +.41% (+21.00 KB) 🔍
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 20.97 MB 21.01 MB +.22% (+48.00 KB) 🔍
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.51 MB 36.60 MB +.23% (+87.31 KB) 🔍
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 74.59 MB 76.58 MB +2.66% (+1.98 MB) ⚠️
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.86 MB 8.87 MB +.13% (+12.00 KB) 🔍
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 59.67 MB 60.43 MB +1.27% (+779.45 KB) ⚠️
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.49 MB 9.49 MB +.07% (+7.19 KB) 🔍
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 94.25 MB 97.01 MB +2.92% (+2.76 MB) ⚠️
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.29 MB 10.31 MB +.13% (+13.98 KB) 🔍

@danielsn danielsn force-pushed the dsn/r-and-d-exporter branch from 0c12dc1 to 8fc6fa9 Compare December 5, 2025 18:01
@danielsn danielsn force-pushed the dsn/r-and-d-exporter branch from 8fc6fa9 to 0e5a4d8 Compare December 5, 2025 18:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@danielsn @codecov-commenter