Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Paullgdc/trace exporter/export public send collection #992

Draft
wants to merge 9 commits into
base: main
Choose a base branch
from
Draft

Paullgdc/trace exporter/export public send collection #992

wants to merge 9 commits into from

Conversation

paullegranddc
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Apr 2, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-04-02 13:32:16

Comparing candidate commit 929be65 in PR branch paullgdc/trace_exporter/export_public_send_collection with baseline commit 9b6500c in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 66.857µs 67.142µs ± 0.256µs 67.103µs ± 0.064µs 67.172µs 67.394µs 67.640µs 70.190µs 4.60% 8.720 99.099 0.38% 0.018µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [67.107µs; 67.178µs] or [-0.053%; +0.053%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.299µs 2.360µs ± 0.018µs 2.359µs ± 0.009µs 2.372µs 2.387µs 2.398µs 2.402µs 1.84% -0.765 1.830 0.78% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.358µs; 2.363µs] or [-0.108%; +0.108%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 54.539ms 55.463ms ± 0.385ms 55.461ms ± 0.127ms 55.583ms 56.119ms 56.555ms 57.137ms 3.02% 0.576 2.337 0.69% 0.027ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [55.410ms; 55.516ms] or [-0.096%; +0.096%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.555µs 25.922µs ± 11.181µs 17.864µs ± 0.250µs 35.079µs 45.561µs 47.492µs 86.700µs 385.32% 1.669 4.948 43.02% 0.791µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.373µs; 27.472µs] or [-5.978%; +5.978%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.214µs 3.176µs ± 1.406µs 2.986µs ± 0.028µs 3.011µs 3.634µs 13.784µs 14.823µs 396.44% 7.393 55.648 44.15% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.981µs; 3.371µs] or [-6.134%; +6.134%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.695µs 33.645µs ± 1.281µs 32.864µs ± 0.115µs 34.966µs 35.908µs 36.275µs 36.367µs 10.66% 0.970 -0.911 3.80% 0.091µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.467µs; 33.822µs] or [-0.528%; +0.528%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.023ms 6.036ms ± 0.006ms 6.035ms ± 0.003ms 6.038ms 6.043ms 6.048ms 6.089ms 0.88% 4.023 35.171 0.09% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.035ms; 6.037ms] or [-0.013%; +0.013%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 244.749ns 255.449ns ± 12.406ns 248.946ns ± 2.975ns 258.896ns 281.051ns 296.127ns 298.126ns 19.76% 1.701 2.314 4.84% 0.877ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [253.730ns; 257.169ns] or [-0.673%; +0.673%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.895µs 3.915µs ± 0.003µs 3.915µs ± 0.001µs 3.916µs 3.919µs 3.921µs 3.922µs 0.20% -1.333 10.769 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254949309.491op/s 255455418.896op/s ± 185513.881op/s 255456776.714op/s ± 77798.324op/s 255537429.853op/s 255727222.589op/s 255836392.170op/s 256730793.095op/s 0.50% 1.357 10.930 0.07% 13117.812op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.999µs 82.499µs ± 0.270µs 82.457µs ± 0.202µs 82.686µs 82.959µs 83.252µs 83.342µs 1.07% 0.508 -0.088 0.33% 0.019µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11998683.685op/s 12121550.196op/s ± 39641.762op/s 12127600.095op/s ± 29697.921op/s 12152897.198op/s 12178019.957op/s 12186784.654op/s 12195331.627op/s 0.56% -0.492 -0.118 0.33% 2803.096op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 76.318µs 77.082µs ± 0.364µs 77.047µs ± 0.218µs 77.261µs 77.700µs 78.107µs 78.357µs 1.70% 0.626 0.512 0.47% 0.026µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12762021.481op/s 12973456.689op/s ± 61035.972op/s 12979160.029op/s ± 36779.942op/s 13015914.885op/s 13059967.897op/s 13085506.191op/s 13103113.642op/s 0.96% -0.597 0.452 0.47% 4315.895op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.896µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.918µs 3.920µs 3.923µs 0.24% -1.188 6.021 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254876355.053op/s 255502045.003op/s ± 193614.670op/s 255491237.393op/s ± 97161.528op/s 255591706.051op/s 255824967.374op/s 255994806.028op/s 256650444.605op/s 0.45% 1.203 6.098 0.08% 13690.625op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 72.917µs 73.707µs ± 0.444µs 73.657µs ± 0.292µs 73.953µs 74.520µs 74.914µs 75.567µs 2.59% 0.799 1.134 0.60% 0.031µs 1 200
credit_card/is_card_number/378282246310005 throughput 13233307.691op/s 13567780.348op/s ± 81435.007op/s 13576511.346op/s ± 53892.119op/s 13626536.633op/s 13691771.772op/s 13705174.486op/s 13714189.830op/s 1.01% -0.754 0.999 0.60% 5758.325op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.959µs 52.149µs ± 0.068µs 52.144µs ± 0.048µs 52.200µs 52.252µs 52.304µs 52.349µs 0.39% -0.004 -0.125 0.13% 0.005µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19102476.129op/s 19175832.110op/s ± 24959.101op/s 19177725.073op/s ± 17690.103op/s 19192522.121op/s 19217852.522op/s 19229129.670op/s 19245789.583op/s 0.35% 0.011 -0.125 0.13% 1764.875op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.476µs 6.632µs ± 0.067µs 6.628µs ± 0.045µs 6.677µs 6.746µs 6.782µs 6.797µs 2.55% 0.212 -0.532 1.00% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 147117123.059op/s 150806874.066op/s ± 1510208.590op/s 150872123.419op/s ± 1018320.899op/s 151774524.633op/s 153043763.497op/s 153991602.543op/s 154427297.674op/s 2.36% -0.169 -0.542 1.00% 106787.874op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.897µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.917µs 3.919µs 3.928µs 0.36% -0.822 9.850 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254612409.386op/s 255516489.595op/s ± 176416.765op/s 255517940.438op/s ± 81279.986op/s 255586358.078op/s 255835478.655op/s 255931908.401op/s 256618544.666op/s 0.43% 0.845 9.905 0.07% 12474.549op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.799µs 64.054µs ± 0.218µs 63.964µs ± 0.059µs 64.077µs 64.539µs 64.597µs 64.984µs 1.60% 1.769 2.775 0.34% 0.015µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15388344.476op/s 15612089.585op/s ± 52725.827op/s 15633808.021op/s ± 14451.791op/s 15644294.968op/s 15655137.160op/s 15669497.193op/s 15674142.367op/s 0.26% -1.753 2.685 0.34% 3728.279op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.739µs 57.867µs ± 0.050µs 57.864µs ± 0.024µs 57.888µs 57.953µs 58.009µs 58.080µs 0.37% 0.695 2.081 0.09% 0.004µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17217486.916op/s 17281111.594op/s ± 14918.021op/s 17281787.590op/s ± 7226.110op/s 17289421.036op/s 17304300.134op/s 17312763.360op/s 17319215.670op/s 0.22% -0.686 2.060 0.09% 1054.863op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.898µs 3.913µs ± 0.003µs 3.913µs ± 0.001µs 3.915µs 3.917µs 3.919µs 3.929µs 0.40% -0.397 6.327 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254519488.416op/s 255545299.003op/s ± 196795.383op/s 255527328.033op/s ± 95070.396op/s 255616634.335op/s 255905329.613op/s 256023639.256op/s 256567155.550op/s 0.41% 0.415 6.320 0.08% 13915.535op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.547µs 54.700µs ± 0.117µs 54.669µs ± 0.023µs 54.696µs 55.054µs 55.128µs 55.182µs 0.94% 2.739 6.866 0.21% 0.008µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 18121941.056op/s 18281509.116op/s ± 38903.128op/s 18291967.997op/s ± 7848.669op/s 18299658.254op/s 18309284.913op/s 18319690.440op/s 18332751.460op/s 0.22% -2.731 6.826 0.21% 2750.867op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.938µs 52.145µs ± 0.073µs 52.156µs ± 0.050µs 52.201µs 52.253µs 52.281µs 52.290µs 0.26% -0.366 -0.328 0.14% 0.005µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19124260.280op/s 19177192.606op/s ± 27023.994op/s 19173345.216op/s ± 18400.922op/s 19196031.221op/s 19219577.062op/s 19247624.109op/s 19253623.266op/s 0.42% 0.372 -0.320 0.14% 1910.885op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.449µs 6.627µs ± 0.067µs 6.634µs ± 0.042µs 6.673µs 6.731µs 6.779µs 6.796µs 2.44% -0.126 -0.203 1.00% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 147139158.949op/s 150906217.062op/s ± 1517773.705op/s 150729285.058op/s ± 959642.590op/s 151801872.973op/s 153461837.230op/s 154422788.053op/s 155069264.442op/s 2.88% 0.180 -0.189 1.00% 107322.808op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255429708.457op/s; 255481129.336op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.461µs; 82.536µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12116056.229op/s; 12127044.162op/s] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [77.032µs; 77.133µs] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12964997.690op/s; 12981915.688op/s] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/37828224631 execution_time [3.913µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255475211.872op/s; 255528878.135op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [73.645µs; 73.768µs] or [-0.084%; +0.084%] None None None
credit_card/is_card_number/378282246310005 throughput [13556494.239op/s; 13579066.457op/s] or [-0.083%; +0.083%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.140µs; 52.158µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19172373.018op/s; 19179291.201op/s] or [-0.018%; +0.018%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.622µs; 6.641µs] or [-0.139%; +0.139%] None None None
credit_card/is_card_number/x371413321323331 throughput [150597573.680op/s; 151016174.452op/s] or [-0.139%; +0.139%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.913µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255492039.929op/s; 255540939.262op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.023µs; 64.084µs] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15604782.292op/s; 15619396.877op/s] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.860µs; 57.874µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17279044.099op/s; 17283179.088op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255518025.056op/s; 255572572.950op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.684µs; 54.717µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18276117.516op/s; 18286900.715op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.135µs; 52.156µs] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19173447.341op/s; 19180937.872op/s] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.618µs; 6.637µs] or [-0.139%; +0.139%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [150695868.224op/s; 151116565.900op/s] or [-0.139%; +0.139%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.915µs 4.978µs ± 0.046µs 4.963µs ± 0.029µs 5.012µs 5.053µs 5.055µs 5.061µs 1.97% 0.555 -1.210 0.92% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [4.971µs; 4.984µs] or [-0.128%; +0.128%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 503.743µs 505.167µs ± 1.114µs 505.009µs ± 0.346µs 505.430µs 505.947µs 511.712µs 514.061µs 1.79% 5.858 41.463 0.22% 0.079µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1945294.220op/s 1979552.375op/s ± 4309.709op/s 1980161.750op/s ± 1355.974op/s 1981357.081op/s 1982896.428op/s 1983707.609op/s 1985139.685op/s 0.25% -5.798 40.842 0.22% 304.742op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 453.675µs 454.981µs ± 0.481µs 454.971µs ± 0.344µs 455.342µs 455.708µs 455.994µs 456.510µs 0.34% 0.022 0.118 0.11% 0.034µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2190531.799op/s 2197897.038op/s ± 2325.324op/s 2197941.562op/s ± 1661.773op/s 2199339.077op/s 2201485.974op/s 2203830.539op/s 2204223.513op/s 0.29% -0.016 0.117 0.11% 164.425op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 177.230µs 177.648µs ± 0.127µs 177.646µs ± 0.072µs 177.714µs 177.842µs 177.975µs 178.085µs 0.25% 0.062 0.930 0.07% 0.009µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5615282.992op/s 5629123.570op/s ± 4019.048op/s 5629162.577op/s ± 2287.450op/s 5631443.646op/s 5636305.445op/s 5639087.985op/s 5642387.154op/s 0.23% -0.056 0.929 0.07% 284.190op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.705µs 37.820µs ± 0.050µs 37.817µs ± 0.033µs 37.855µs 37.904µs 37.939µs 37.974µs 0.41% 0.324 -0.177 0.13% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26333799.506op/s 26441042.372op/s ± 35028.135op/s 26442952.320op/s ± 23124.218op/s 26465120.076op/s 26494518.956op/s 26507863.066op/s 26521538.411op/s 0.30% -0.318 -0.184 0.13% 2476.863op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.229µs 48.322µs ± 0.118µs 48.310µs ± 0.026µs 48.335µs 48.381µs 48.440µs 49.886µs 3.26% 11.852 154.994 0.24% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20045608.315op/s 20694788.965op/s ± 48985.154op/s 20699830.697op/s ± 11177.090op/s 20711044.276op/s 20720368.825op/s 20729622.017op/s 20734261.459op/s 0.17% -11.731 152.833 0.24% 3463.773op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [505.013µs; 505.321µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1978955.091op/s; 1980149.659op/s] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [454.914µs; 455.048µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2197574.771op/s; 2198219.306op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [177.630µs; 177.665µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5628566.569op/s; 5629680.572op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.813µs; 37.827µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26436187.809op/s; 26445896.934op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.305µs; 48.338µs] or [-0.034%; +0.034%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20688000.094op/s; 20701577.836op/s] or [-0.033%; +0.033%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.707µs 209.118µs ± 0.142µs 209.133µs ± 0.089µs 209.220µs 209.322µs 209.369µs 209.536µs 0.19% -0.487 0.194 0.07% 0.010µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4772443.909op/s 4781984.726op/s ± 3249.981op/s 4781636.285op/s ± 2038.945op/s 4783955.889op/s 4788066.893op/s 4791132.476op/s 4791408.047op/s 0.20% 0.491 0.197 0.07% 229.808op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.627µs 18.677µs ± 0.021µs 18.674µs ± 0.010µs 18.686µs 18.713µs 18.745µs 18.751µs 0.41% 0.851 1.633 0.11% 0.001µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53330995.206op/s 53540609.444op/s ± 59556.967op/s 53551448.082op/s ± 27693.285op/s 53575707.423op/s 53614801.957op/s 53680805.493op/s 53686609.422op/s 0.25% -0.842 1.617 0.11% 4211.314op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.954µs 11.017µs ± 0.078µs 11.005µs ± 0.013µs 11.024µs 11.051µs 11.090µs 11.800µs 7.23% 8.713 81.020 0.70% 0.005µs 1 200
normalization/normalize_name/normalize_name/good throughput 84746709.167op/s 90776011.949op/s ± 602858.196op/s 90871147.997op/s ± 109688.900op/s 90956572.292op/s 91074340.519op/s 91229338.334op/s 91294212.230op/s 0.47% -8.562 79.015 0.66% 42628.512op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [209.099µs; 209.138µs] or [-0.009%; +0.009%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4781534.310op/s; 4782435.142op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.675µs; 18.680µs] or [-0.015%; +0.015%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53532355.421op/s; 53548863.467op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_name/normalize_name/good execution_time [11.006µs; 11.027µs] or [-0.098%; +0.098%] None None None
normalization/normalize_name/normalize_name/good throughput [90692461.601op/s; 90859562.296op/s] or [-0.092%; +0.092%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 929be65 1743599939 paullgdc/trace_exporter/export_public_send_collection
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 147.353µs 148.274µs ± 0.457µs 148.219µs ± 0.140µs 148.381µs 148.699µs 149.674µs 152.906µs 3.16% 5.740 53.261 0.31% 0.032µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [148.211µs; 148.337µs] or [-0.043%; +0.043%] None None None

Baseline

Omitted due to size.

@r1viollet
Copy link
Contributor

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.77 MB 7.77 MB +0% (+24 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 23.93 MB 23.93 MB +0% (+1.30 KB) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 77.46 MB 77.46 MB +0% (+408 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 22.49 MB 22.49 MB +0% (+552 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 7.64 MB 7.64 MB +0% (+24 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 71.69 MB 71.69 MB +0% (+1.85 KB) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 16.82 MB 16.82 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 61.57 KB 61.57 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 112.70 MB 112.72 MB +.01% (+16.00 KB) 🔍
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 629.28 MB 629.30 MB +0% (+21.06 KB) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 5.03 MB 5.03 MB --.01% (-1.00 KB) 💪
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 61.57 KB 61.57 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 16.02 MB 16.02 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 26.64 MB 26.64 MB -0% (-122 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 14.22 MB 14.22 MB -0% (-512 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 62.51 KB 62.51 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 114.66 MB 114.67 MB +0% (+8.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 621.40 MB 621.42 MB +0% (+21.02 KB) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 3.80 MB 3.80 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 62.51 KB 62.51 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 16.64 MB 16.64 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 24.54 MB 24.54 MB +0% (+186 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 66.76 MB 66.76 MB -0% (-880 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.22 MB 8.22 MB +0% (+24 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 23.09 MB 23.09 MB -0% (-160 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 67.66 MB 67.67 MB +0% (+672 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 8.10 MB 8.10 MB +0% (+16 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 20.71 MB 20.71 MB +0% (+312 B) 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
data-pipeline mini-agent
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@paullegranddc @r1viollet