Skip to content

dsn/r and d sample #1386

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
danielsn wants to merge 12 commits into
base: main
Choose a base branch
from
Draft

dsn/r and d sample #1386

danielsn wants to merge 12 commits into from
+3,457 −317

Conversation

@danielsn
Copy link
Contributor

@danielsn danielsn commented Dec 5, 2025

  • profiling: Initial C++ API
  • profiling: Add OwnedSample class

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-12-08 04:07:17

Comparing candidate commit 5b5862f in PR branch dsn/r-and-d-sample with baseline commit e6671fc in branch main.

Found 5 performance improvements and 4 performance regressions! Performance is the same for 46 metrics, 2 unstable metrics.

scenario:benching serializing traces from their internal representation to msgpack

  • 🟥 execution_time [+706.849µs; +718.091µs] or [+4.965%; +5.044%]

scenario:credit_card/is_card_number/ 3782-8224-6310-005

  • 🟩 throughput [+493652.041op/s; +557771.208op/s] or [+4.034%; +4.558%]

scenario:credit_card/is_card_number/x371413321323331

  • 🟩 execution_time [-405.702ns; -403.259ns] or [-6.300%; -6.262%]
  • 🟩 throughput [+10377912.799op/s; +10438705.395op/s] or [+6.683%; +6.722%]

scenario:credit_card/is_card_number_no_luhn/ 3782-8224-6310-005

  • 🟥 execution_time [+3.525µs; +3.690µs] or [+5.661%; +5.927%]
  • 🟥 throughput [-902289.084op/s; -859566.183op/s] or [-5.618%; -5.352%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟩 execution_time [-400.298ns; -398.422ns] or [-6.218%; -6.189%]
  • 🟩 throughput [+10250254.787op/s; +10299465.753op/s] or [+6.598%; +6.630%]

scenario:sql/obfuscate_sql_string

  • 🟥 execution_time [+5.649µs; +5.709µs] or [+6.664%; +6.735%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.358µs 161.321µs ± 0.331µs 161.278µs ± 0.176µs 161.453µs 161.837µs 162.127µs 163.679µs 1.49% 2.041 12.347 0.20% 0.023µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.275µs; 161.367µs] or [-0.028%; +0.028%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.653ms 10.686ms ± 0.013ms 10.684ms ± 0.008ms 10.693ms 10.705ms 10.730ms 10.747ms 0.58% 1.024 3.002 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.684ms; 10.688ms] or [-0.017%; +0.017%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.726µs 25.650µs ± 9.630µs 18.577µs ± 0.699µs 33.142µs 43.635µs 44.290µs 75.666µs 307.32% 1.355 2.819 37.45% 0.681µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.316µs; 26.985µs] or [-5.203%; +5.203%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 204.284µs 204.932µs ± 0.440µs 204.859µs ± 0.254µs 205.138µs 205.616µs 205.897µs 208.120µs 1.59% 2.253 12.467 0.21% 0.031µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4804925.854op/s 4879681.218op/s ± 10433.987op/s 4881417.184op/s ± 6052.344op/s 4886198.458op/s 4892340.381op/s 4893855.178op/s 4895155.040op/s 0.28% -2.193 11.917 0.21% 737.794op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.587µs 18.689µs ± 0.139µs 18.643µs ± 0.024µs 18.710µs 18.853µs 18.993µs 20.208µs 8.40% 6.951 70.507 0.74% 0.010µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 49484958.041op/s 53509088.808op/s ± 378124.263op/s 53640411.063op/s ± 70134.161op/s 53688917.766op/s 53743366.694op/s 53773465.943op/s 53801926.838op/s 0.30% -6.437 62.601 0.70% 26737.423op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.699µs 10.826µs ± 0.058µs 10.817µs ± 0.034µs 10.859µs 10.946µs 10.981µs 11.016µs 1.84% 0.686 0.540 0.53% 0.004µs 1 200
normalization/normalize_name/normalize_name/good throughput 90780601.442op/s 92369010.908op/s ± 492298.062op/s 92448915.806op/s ± 295211.709op/s 92701321.902op/s 93060616.573op/s 93355244.048op/s 93463252.047op/s 1.10% -0.653 0.487 0.53% 34810.730op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [204.871µs; 204.993µs] or [-0.030%; +0.030%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4878235.168op/s; 4881127.268op/s] or [-0.030%; +0.030%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.670µs; 18.709µs] or [-0.103%; +0.103%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53456684.422op/s; 53561493.194op/s] or [-0.098%; +0.098%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.818µs; 10.834µs] or [-0.074%; +0.074%] None None None
normalization/normalize_name/normalize_name/good throughput [92300783.131op/s; 92437238.685op/s] or [-0.074%; +0.074%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.391µs 146.396µs ± 1.762µs 146.096µs ± 0.531µs 146.720µs 147.945µs 152.426µs 163.037µs 11.60% 5.633 44.247 1.20% 0.125µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.152µs; 146.640µs] or [-0.167%; +0.167%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 243.862ns 256.969ns ± 13.962ns 251.663ns ± 3.955ns 258.874ns 293.033ns 293.417ns 298.670ns 18.68% 1.774 1.950 5.42% 0.987ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [255.034ns; 258.904ns] or [-0.753%; +0.753%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.390µs 2.435µs ± 0.018µs 2.430µs ± 0.006µs 2.437µs 2.477µs 2.499µs 2.503µs 3.03% 1.669 2.906 0.76% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.433µs; 2.438µs] or [-0.105%; +0.105%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.961µs 5.030µs ± 0.061µs 5.014µs ± 0.043µs 5.084µs 5.130µs 5.133µs 5.135µs 2.41% 0.532 -1.295 1.20% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.022µs; 5.039µs] or [-0.167%; +0.167%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.110ms 6.392ms ± 0.069ms 6.405ms ± 0.014ms 6.419ms 6.448ms 6.497ms 6.672ms 4.16% -1.871 6.723 1.08% 0.005ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.382ms; 6.401ms] or [-0.150%; +0.150%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.902ms 14.950ms ± 0.026ms 14.946ms ± 0.010ms 14.957ms 14.988ms 15.049ms 15.096ms 1.00% 2.260 8.225 0.17% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.947ms; 14.954ms] or [-0.024%; +0.024%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 90.014µs 90.444µs ± 0.173µs 90.428µs ± 0.084µs 90.515µs 90.629µs 91.147µs 91.836µs 1.56% 3.593 24.235 0.19% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [90.420µs; 90.468µs] or [-0.027%; +0.027%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.892µs 3.912µs ± 0.006µs 3.911µs ± 0.002µs 3.913µs 3.915µs 3.918µs 3.975µs 1.63% 7.292 66.246 0.16% 0.000µs 1 200
credit_card/is_card_number/ throughput 251585124.028op/s 255646637.454op/s ± 416026.096op/s 255683623.473op/s ± 111522.153op/s 255791752.518op/s 255917853.915op/s 255964779.954op/s 256949623.102op/s 0.50% -7.217 65.427 0.16% 29417.487op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.064µs 78.356µs ± 0.874µs 78.259µs ± 0.542µs 78.783µs 80.057µs 80.633µs 81.474µs 4.11% 0.844 0.547 1.11% 0.062µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12273809.160op/s 12763786.601op/s ± 141033.432op/s 12778145.001op/s ± 89100.940op/s 12872386.793op/s 12958660.105op/s 12969323.799op/s 12976181.147op/s 1.55% -0.784 0.391 1.10% 9972.570op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 70.612µs 70.805µs ± 0.231µs 70.722µs ± 0.046µs 70.836µs 71.214µs 71.801µs 72.120µs 1.98% 3.179 12.101 0.32% 0.016µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13865788.734op/s 14123462.769op/s ± 45523.903op/s 14139887.802op/s ± 9227.029op/s 14147625.138op/s 14154810.908op/s 14157568.747op/s 14161880.466op/s 0.16% -3.141 11.803 0.32% 3219.026op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.911µs ± 0.002µs 3.911µs ± 0.001µs 3.913µs 3.915µs 3.916µs 3.917µs 0.16% -1.953 15.278 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255273794.872op/s 255679134.667op/s ± 162814.614op/s 255690513.890op/s ± 97350.536op/s 255774935.668op/s 255883775.735op/s 255939785.676op/s 256922540.215op/s 0.48% 1.978 15.510 0.06% 11512.732op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 67.412µs 67.666µs ± 0.188µs 67.614µs ± 0.090µs 67.761µs 68.101µs 68.235µs 68.340µs 1.07% 1.324 1.718 0.28% 0.013µs 1 200
credit_card/is_card_number/378282246310005 throughput 14632759.268op/s 14778484.163op/s ± 40946.042op/s 14789924.364op/s ± 19731.538op/s 14806755.953op/s 14827118.430op/s 14833132.516op/s 14834081.302op/s 0.30% -1.308 1.665 0.28% 2895.322op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 44.856µs 45.210µs ± 0.141µs 45.214µs ± 0.092µs 45.300µs 45.430µs 45.511µs 45.610µs 0.88% -0.091 -0.111 0.31% 0.010µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21925066.247op/s 22119355.251op/s ± 69031.474op/s 22117271.453op/s ± 45267.209op/s 22166275.678op/s 22235861.393op/s 22277607.684op/s 22293613.111op/s 0.80% 0.109 -0.109 0.31% 4881.262op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.028µs 6.035µs ± 0.004µs 6.034µs ± 0.003µs 6.037µs 6.044µs 6.049µs 6.050µs 0.26% 1.049 1.208 0.07% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 165286502.756op/s 165703354.832op/s ± 118416.548op/s 165719654.355op/s ± 69805.641op/s 165786229.575op/s 165856724.654op/s 165890850.626op/s 165904776.265op/s 0.11% -1.045 1.196 0.07% 8373.314op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.892µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.919µs 3.920µs 0.18% -1.621 10.217 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255103847.818op/s 255564908.553op/s ± 197474.343op/s 255561613.386op/s ± 134684.933op/s 255680382.980op/s 255845294.543op/s 255950119.835op/s 256942109.546op/s 0.54% 1.643 10.399 0.08% 13963.545op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.269µs 65.875µs ± 0.064µs 65.873µs ± 0.029µs 65.903µs 65.961µs 66.018µs 66.049µs 0.27% -3.936 39.405 0.10% 0.005µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15140178.128op/s 15180176.417op/s ± 14763.971op/s 15180707.598op/s ± 6656.601op/s 15186833.395op/s 15195512.995op/s 15201497.523op/s 15321144.288op/s 0.93% 4.012 40.258 0.10% 1043.970op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 52.944µs 53.003µs ± 0.028µs 53.004µs ± 0.020µs 53.021µs 53.053µs 53.068µs 53.100µs 0.18% 0.293 -0.054 0.05% 0.002µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18832341.048op/s 18866924.092op/s ± 9988.360op/s 18866361.278op/s ± 7018.249op/s 18874519.399op/s 18882531.393op/s 18886351.608op/s 18887796.595op/s 0.11% -0.290 -0.058 0.05% 706.284op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.890µs 3.912µs ± 0.004µs 3.912µs ± 0.002µs 3.914µs 3.919µs 3.922µs 3.925µs 0.33% -0.396 7.424 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254786209.260op/s 255613521.125op/s ± 235235.176op/s 255634480.884op/s ± 125815.808op/s 255757097.776op/s 255887789.661op/s 255947433.086op/s 257081814.754op/s 0.57% 0.422 7.556 0.09% 16633.639op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 49.736µs 49.812µs ± 0.040µs 49.805µs ± 0.026µs 49.837µs 49.888µs 49.919µs 49.934µs 0.26% 0.658 0.007 0.08% 0.003µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 20026476.796op/s 20075384.919op/s ± 16175.030op/s 20078381.607op/s ± 10596.010op/s 20088099.810op/s 20096414.905op/s 20101911.294op/s 20106162.539op/s 0.14% -0.655 0.000 0.08% 1143.747op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 44.764µs 45.181µs ± 0.164µs 45.181µs ± 0.106µs 45.283µs 45.435µs 45.566µs 45.647µs 1.03% -0.009 -0.019 0.36% 0.012µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21907207.975op/s 22133656.519op/s ± 80141.653op/s 22133157.868op/s ± 51907.012op/s 22190212.452op/s 22281845.005op/s 22321180.192op/s 22339438.306op/s 0.93% 0.030 -0.021 0.36% 5666.871op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.027µs 6.038µs ± 0.005µs 6.037µs ± 0.004µs 6.043µs 6.047µs 6.049µs 6.052µs 0.25% 0.338 -0.753 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 165244108.030op/s 165619767.261op/s ± 146215.478op/s 165650354.589op/s ± 101301.916op/s 165722157.053op/s 165848209.425op/s 165869218.204op/s 165915208.617op/s 0.16% -0.335 -0.755 0.09% 10338.996op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.911µs; 3.913µs] or [-0.023%; +0.023%] None None None
credit_card/is_card_number/ throughput [255588980.238op/s; 255704294.670op/s] or [-0.023%; +0.023%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.235µs; 78.477µs] or [-0.155%; +0.155%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12744240.723op/s; 12783332.478op/s] or [-0.153%; +0.153%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [70.773µs; 70.837µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14117153.594op/s; 14129771.944op/s] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.911µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255656570.127op/s; 255701699.206op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [67.640µs; 67.693µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number/378282246310005 throughput [14772809.435op/s; 14784158.890op/s] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.190µs; 45.229µs] or [-0.043%; +0.043%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [22109788.152op/s; 22128922.349op/s] or [-0.043%; +0.043%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.034µs; 6.035µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/x371413321323331 throughput [165686943.437op/s; 165719766.227op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255537540.509op/s; 255592276.598op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.867µs; 65.884µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15178130.273op/s; 15182222.561op/s] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [52.999µs; 53.007µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18865539.801op/s; 18868308.382op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255580919.792op/s; 255646122.458op/s] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [49.807µs; 49.818µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [20073143.216op/s; 20077626.623op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.158µs; 45.203µs] or [-0.050%; +0.050%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [22122549.657op/s; 22144763.382op/s] or [-0.050%; +0.050%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.037µs; 6.039µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165599503.202op/s; 165640031.320op/s] or [-0.012%; +0.012%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.531µs 34.199µs ± 1.167µs 33.671µs ± 0.053µs 33.749µs 36.694µs 36.721µs 38.200µs 13.45% 1.739 1.176 3.40% 0.083µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.037µs; 34.361µs] or [-0.473%; +0.473%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 186.515ns 189.794ns ± 2.439ns 189.646ns ± 1.674ns 191.227ns 194.534ns 196.618ns 199.135ns 5.00% 0.897 0.753 1.28% 0.172ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [189.456ns; 190.132ns] or [-0.178%; +0.178%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.824ms 61.471ms ± 2.479ms 61.181ms ± 0.102ms 61.269ms 61.405ms 80.439ms 82.829ms 35.38% 7.971 61.933 4.02% 0.175ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.127ms; 61.814ms] or [-0.559%; +0.559%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.921µs 534.804µs ± 0.877µs 534.681µs ± 0.318µs 535.079µs 535.494µs 535.833µs 545.471µs 2.02% 9.074 107.671 0.16% 0.062µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1833278.425op/s 1869850.407op/s ± 3022.070op/s 1870273.125op/s ± 1113.562op/s 1871256.610op/s 1872306.474op/s 1872642.381op/s 1872935.846op/s 0.14% -8.940 105.497 0.16% 213.693op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 379.984µs 380.898µs ± 0.340µs 380.906µs ± 0.228µs 381.103µs 381.494µs 381.770µs 381.784µs 0.23% 0.173 -0.187 0.09% 0.024µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2619278.826op/s 2625374.190op/s ± 2340.393op/s 2625319.932op/s ± 1569.458op/s 2627116.982op/s 2629032.681op/s 2629878.707op/s 2631687.045op/s 0.24% -0.168 -0.189 0.09% 165.491op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.890µs 190.361µs ± 0.210µs 190.342µs ± 0.134µs 190.486µs 190.723µs 190.953µs 191.209µs 0.46% 0.707 1.177 0.11% 0.015µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5229889.867op/s 5253187.566op/s ± 5779.250op/s 5253710.433op/s ± 3695.179op/s 5256947.106op/s 5260709.680op/s 5264964.098op/s 5266214.573op/s 0.24% -0.698 1.155 0.11% 408.655op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.131µs 37.376µs ± 0.071µs 37.384µs ± 0.045µs 37.430µs 37.466µs 37.494µs 37.511µs 0.34% -0.795 0.423 0.19% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26658533.200op/s 26755437.727op/s ± 50686.883op/s 26749062.171op/s ± 32068.796op/s 26780625.053op/s 26851844.360op/s 26891493.572op/s 26931431.151op/s 0.68% 0.805 0.446 0.19% 3584.104op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.832µs 45.926µs ± 0.109µs 45.911µs ± 0.025µs 45.938µs 46.013µs 46.129µs 47.298µs 3.02% 10.063 122.575 0.24% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21142692.029op/s 21774425.013op/s ± 50628.606op/s 21781417.426op/s ± 12090.071op/s 21792135.594op/s 21807995.502op/s 21813550.901op/s 21818626.125op/s 0.17% -9.897 119.708 0.23% 3579.983op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.682µs; 534.925µs] or [-0.023%; +0.023%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1869431.577op/s; 1870269.237op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.851µs; 380.945µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2625049.834op/s; 2625698.546op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.332µs; 190.390µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5252386.618op/s; 5253988.515op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.366µs; 37.386µs] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26748413.013op/s; 26762462.442op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.911µs; 45.941µs] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21767408.375op/s; 21781441.651op/s] or [-0.032%; +0.032%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5b5862f 1765087248 dsn/r-and-d-sample
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.216µs 3.204µs ± 1.420µs 3.004µs ± 0.024µs 3.027µs 3.646µs 13.816µs 14.867µs 394.85% 7.381 55.518 44.20% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.007µs; 3.401µs] or [-6.142%; +6.142%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Dec 8, 2025

Codecov Report

❌ Patch coverage is 70.80103% with 452 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.14%. Comparing base (6b26318) to head (5b5862f).
⚠️ Report is 2 commits behind head on main.

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1386      +/-   ##
==========================================
+ Coverage   70.96%   71.14%   +0.17%     
==========================================
  Files         400      409       +9     
  Lines       63691    65642    +1951     
==========================================
+ Hits        45199    46699    +1500     
- Misses      18492    18943     +451
Components Coverage Δ
libdd-crashtracker 58.74% <ø> (+0.03%) ⬆️
libdd-crashtracker-ffi 16.38% <ø> (-0.36%) ⬇️
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 85.96% <ø> (+0.14%) ⬆️
libdd-data-pipeline-ffi 77.42% <ø> (+0.83%) ⬆️
libdd-common 81.15% <ø> (ø)
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 60.02% <ø> (+0.03%) ⬆️
libdd-telemetry-ffi 21.24% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 78.89% <70.80%> (-0.75%) ⬇️
libdd-profiling-ffi 62.13% <ø> (ø)
datadog-sidecar 36.57% <ø> (+0.69%) ⬆️
datdog-sidecar-ffi 14.32% <ø> (+3.49%) ⬆️
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 59.65% <ø> (ø)
libdd-trace-utils 90.03% <ø> (+0.14%) ⬆️
datadog-tracer-flare 61.06% <ø> (-2.44%) ⬇️
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Dec 8, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.44 MB 7.44 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 86.25 MB 86.25 MB +0% (+1.27 KB) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 58.31 MB 58.27 MB --.07% (-44.43 KB) 💪
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.43 MB 8.43 MB --.04% (-4.01 KB) 💪
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.04 MB 99.91 MB --.12% (-130.70 KB) 💪
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.54 MB 9.53 MB --.04% (-4.29 KB) 💪
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.69 MB 19.69 MB +0% (+1.50 KB) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 139.73 MB 140.05 MB +.22% (+320.00 KB) 🔍
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 742.46 MB 745.18 MB +.36% (+2.71 MB) 🔍
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.37 MB 6.35 MB --.22% (-14.50 KB) 💪
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.73 MB 19.69 MB --.19% (-40.00 KB) 💪
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.75 MB 38.68 MB --.19% (-75.99 KB) 💪
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.80 MB 16.80 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 142.34 MB 142.69 MB +.24% (+352.00 KB) 🔍
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 730.71 MB 733.68 MB +.40% (+2.96 MB) 🔍
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.88 MB 4.88 MB --.09% (-5.00 KB) 💪
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 20.97 MB 20.94 MB --.11% (-24.00 KB) 💪
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.51 MB 36.46 MB --.13% (-49.83 KB) 💪
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 74.59 MB 74.60 MB +.01% (+9.50 KB) 🔍
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.86 MB 8.86 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 59.67 MB 59.58 MB --.15% (-92.16 KB) 💪
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.49 MB 9.47 MB --.12% (-12.35 KB) 💪
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 94.25 MB 94.19 MB --.05% (-57.68 KB) 💪
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.29 MB 10.28 MB --.10% (-11.13 KB) 💪

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ci-build

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@danielsn @codecov-commenter