[crashtracker] Make sure bin_tests contribute to code coverage

[gleocadie]

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

[codecov-commenter]

Codecov Report

❌ Patch coverage is 64.00000% with 9 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.23%. Comparing base (c4d5ab8) to head (c8cc8e6).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #1374   +/-   ##
=======================================
  Coverage   71.22%   71.23%           
=======================================
  Files         395      395           
  Lines       63292    63317   +25     
=======================================
+ Hits        45079    45103   +24     
- Misses      18213    18214    +1     

Components	Coverage Δ
libdd-crashtracker	59.91% <ø> (+0.01%)	⬆️
libdd-crashtracker-ffi	15.31% <ø> (ø)
libdd-alloc	98.73% <ø> (ø)
libdd-data-pipeline	86.00% <ø> (ø)
libdd-data-pipeline-ffi	77.63% <ø> (ø)
libdd-common	80.93% <ø> (ø)
libdd-common-ffi	73.90% <ø> (ø)
libdd-telemetry	60.02% <ø> (ø)
libdd-telemetry-ffi	21.24% <ø> (ø)
libdd-dogstatsd-client	83.75% <ø> (ø)
datadog-ipc	82.71% <ø> (+0.10%)	⬆️
libdd-profiling	79.75% <ø> (+0.02%)	⬆️
libdd-profiling-ffi	62.13% <ø> (ø)
datadog-sidecar	36.98% <ø> (ø)
datdog-sidecar-ffi	16.40% <ø> (ø)
spawn-worker	55.18% <ø> (ø)
libdd-tinybytes	92.44% <ø> (ø)
libdd-trace-normalization	98.24% <ø> (ø)
datadog-trace-obfuscation	94.17% <ø> (ø)
libdd-trace-protobuf	59.65% <ø> (ø)
libdd-trace-utils	90.06% <ø> (ø)
datadog-tracer-flare	62.06% <ø> (ø)
libdd-log	75.57% <ø> (ø)

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[pr-commenter]

Benchmarks

Comparison

Benchmark execution time: 2025-11-28 09:34:34

Comparing candidate commit c8cc8e6 in PR branch gleocadie/make-bin_tests-contributing-to-code-coverage with baseline commit 5079362 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	206.048µs	206.593µs ± 0.414µs	206.443µs ± 0.167µs	206.708µs	207.491µs	207.653µs	208.268µs	0.88%	1.387	1.415	0.20%	0.029µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	4801513.852op/s	4840463.823op/s ± 9664.014op/s	4843959.694op/s ± 3909.900op/s	4846972.879op/s	4850565.801op/s	4852218.551op/s	4853229.168op/s	0.19%	-1.378	1.381	0.20%	683.349op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	18.171µs	18.257µs ± 0.063µs	18.251µs ± 0.026µs	18.274µs	18.338µs	18.513µs	18.575µs	1.78%	2.500	8.640	0.34%	0.004µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	53835143.220op/s	54774898.630op/s ± 187472.234op/s	54792804.943op/s ± 77529.170op/s	54876661.827op/s	54993028.979op/s	55033279.711op/s	55034144.293op/s	0.44%	-2.455	8.414	0.34%	13256.289op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	10.580µs	10.739µs ± 0.073µs	10.728µs ± 0.048µs	10.788µs	10.874µs	10.908µs	10.925µs	1.83%	0.390	-0.350	0.68%	0.005µs	1	200
normalization/normalize_name/normalize_name/good	throughput	91535694.344op/s	93119372.744op/s ± 634687.267op/s	93211513.059op/s ± 415920.309op/s	93535509.137op/s	94058821.613op/s	94312020.328op/s	94520776.030op/s	1.40%	-0.359	-0.372	0.68%	44879.167op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[206.535µs; 206.650µs] or [-0.028%; +0.028%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[4839124.484op/s; 4841803.163op/s] or [-0.028%; +0.028%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[18.248µs; 18.265µs] or [-0.048%; +0.048%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[54748916.782op/s; 54800880.479op/s] or [-0.047%; +0.047%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[10.729µs; 10.750µs] or [-0.095%; +0.095%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[93031411.193op/s; 93207334.295op/s] or [-0.094%; +0.094%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
receiver_entry_point/report/2597	execution_time	6.118ms	6.399ms ± 0.075ms	6.414ms ± 0.019ms	6.432ms	6.486ms	6.523ms	6.573ms	2.49%	-1.694	3.167	1.18%	0.005ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
receiver_entry_point/report/2597	execution_time	[6.388ms; 6.409ms] or [-0.163%; +0.163%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	33.015µs	33.663µs ± 1.210µs	33.098µs ± 0.037µs	33.191µs	36.291µs	36.359µs	37.072µs	12.01%	1.713	0.976	3.59%	0.086µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[33.495µs; 33.831µs] or [-0.498%; +0.498%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	86.472µs	86.777µs ± 0.151µs	86.756µs ± 0.048µs	86.804µs	86.923µs	87.278µs	88.283µs	1.76%	5.920	51.682	0.17%	0.011µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[86.756µs; 86.798µs] or [-0.024%; +0.024%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	10.608ms	10.641ms ± 0.016ms	10.640ms ± 0.008ms	10.648ms	10.670ms	10.680ms	10.724ms	0.79%	1.586	6.162	0.15%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[10.639ms; 10.644ms] or [-0.020%; +0.020%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	18.086µs	25.977µs ± 9.432µs	18.377µs ± 0.182µs	33.963µs	42.554µs	43.920µs	65.169µs	254.62%	0.943	0.640	36.22%	0.667µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[24.670µs; 27.284µs] or [-5.032%; +5.032%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching serializing traces from their internal representation to msgpack	execution_time	14.857ms	14.911ms ± 0.033ms	14.908ms ± 0.017ms	14.925ms	14.954ms	15.007ms	15.158ms	1.67%	2.689	15.835	0.22%	0.002ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching serializing traces from their internal representation to msgpack	execution_time	[14.907ms; 14.916ms] or [-0.030%; +0.030%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
single_flag_killswitch/rules-based	execution_time	189.699ns	192.579ns ± 2.222ns	192.223ns ± 1.512ns	193.845ns	196.862ns	199.660ns	204.185ns	6.22%	1.434	3.532	1.15%	0.157ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
single_flag_killswitch/rules-based	execution_time	[192.271ns; 192.887ns] or [-0.160%; +0.160%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	533.848µs	534.789µs ± 0.593µs	534.755µs ± 0.341µs	535.042µs	535.640µs	535.788µs	540.108µs	1.00%	3.702	30.556	0.11%	0.042µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1851480.144op/s	1869900.235op/s ± 2064.863op/s	1870016.681op/s ± 1190.785op/s	1871296.055op/s	1872336.137op/s	1872591.406op/s	1873191.337op/s	0.17%	-3.640	29.828	0.11%	146.008op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	380.210µs	381.207µs ± 0.367µs	381.231µs ± 0.245µs	381.457µs	381.761µs	382.087µs	382.389µs	0.30%	0.238	0.272	0.10%	0.026µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2615140.664op/s	2623249.455op/s ± 2525.004op/s	2623080.048op/s ± 1688.616op/s	2624988.469op/s	2627189.062op/s	2628240.308op/s	2630125.758op/s	0.27%	-0.232	0.264	0.10%	178.545op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	193.875µs	194.354µs ± 0.184µs	194.344µs ± 0.132µs	194.485µs	194.660µs	194.834µs	194.907µs	0.29%	0.230	-0.006	0.09%	0.013µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5130664.204op/s	5145243.297op/s ± 4882.253op/s	5145514.830op/s ± 3487.733op/s	5148621.392op/s	5153053.416op/s	5155688.930op/s	5157970.791op/s	0.24%	-0.225	-0.010	0.09%	345.227op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	36.963µs	37.167µs ± 0.077µs	37.161µs ± 0.050µs	37.216µs	37.294µs	37.372µs	37.408µs	0.67%	0.297	0.483	0.21%	0.005µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	26731921.567op/s	26905914.857op/s ± 55520.899op/s	26909869.306op/s ± 36097.530op/s	26943244.292op/s	26992100.590op/s	27029923.038op/s	27053800.257op/s	0.53%	-0.282	0.469	0.21%	3925.920op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	44.887µs	45.072µs ± 0.153µs	45.070µs ± 0.099µs	45.162µs	45.270µs	45.322µs	46.377µs	2.90%	3.107	24.473	0.34%	0.011µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	21562226.429op/s	22186885.385op/s ± 74604.261op/s	22187822.882op/s ± 48516.460op/s	22245658.662op/s	22274752.965op/s	22276004.583op/s	22278126.568op/s	0.41%	-2.941	22.655	0.34%	5275.318op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[534.706µs; 534.871µs] or [-0.015%; +0.015%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1869614.065op/s; 1870186.405op/s] or [-0.015%; +0.015%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[381.156µs; 381.258µs] or [-0.013%; +0.013%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2622899.514op/s; 2623599.396op/s] or [-0.013%; +0.013%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[194.329µs; 194.380µs] or [-0.013%; +0.013%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5144566.663op/s; 5145919.930op/s] or [-0.013%; +0.013%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[37.156µs; 37.177µs] or [-0.029%; +0.029%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[26898220.194op/s; 26913609.520op/s] or [-0.029%; +0.029%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[45.051µs; 45.093µs] or [-0.047%; +0.047%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[22176545.952op/s; 22197224.818op/s] or [-0.047%; +0.047%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
ip_address/quantize_peer_ip_address_benchmark	execution_time	5.008µs	5.079µs ± 0.042µs	5.090µs ± 0.038µs	5.113µs	5.132µs	5.136µs	5.138µs	0.94%	-0.204	-1.477	0.82%	0.003µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark	execution_time	[5.074µs; 5.085µs] or [-0.113%; +0.113%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	243.127ns	252.850ns ± 13.598ns	247.795ns ± 3.389ns	252.968ns	288.984ns	294.404ns	298.550ns	20.48%	2.120	3.252	5.36%	0.962ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[250.965ns; 254.734ns] or [-0.745%; +0.745%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	60.853ms	61.373ms ± 1.885ms	61.132ms ± 0.146ms	61.246ms	61.600ms	68.387ms	81.071ms	32.62%	8.837	81.436	3.06%	0.133ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[61.112ms; 61.635ms] or [-0.426%; +0.426%]	None	None	None

Group 13

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	3.895µs	3.916µs ± 0.003µs	3.916µs ± 0.002µs	3.918µs	3.921µs	3.922µs	3.926µs	0.25%	-1.306	8.655	0.08%	0.000µs	1	200
credit_card/is_card_number/	throughput	254698336.984op/s	255354811.367op/s ± 210054.393op/s	255346868.486op/s ± 131981.797op/s	255485724.735op/s	255661230.205op/s	255736611.862op/s	256757598.719op/s	0.55%	1.328	8.814	0.08%	14853.089op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	77.959µs	79.456µs ± 0.666µs	79.427µs ± 0.500µs	79.893µs	80.688µs	81.012µs	81.176µs	2.20%	0.349	-0.493	0.84%	0.047µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	12318909.585op/s	12586419.825op/s ± 105192.856op/s	12590198.559op/s ± 79197.200op/s	12671746.555op/s	12741841.092op/s	12773478.067op/s	12827278.858op/s	1.88%	-0.314	-0.521	0.83%	7438.258op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	71.463µs	71.758µs ± 0.314µs	71.649µs ± 0.071µs	71.745µs	72.499µs	73.016µs	73.376µs	2.41%	2.696	7.964	0.44%	0.022µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	13628466.206op/s	13935931.596op/s ± 60270.356op/s	13956935.184op/s ± 13842.833op/s	13967820.935op/s	13978692.280op/s	13990363.871op/s	13993293.015op/s	0.26%	-2.661	7.727	0.43%	4261.758op/s	1	200
credit_card/is_card_number/37828224631	execution_time	3.897µs	3.916µs ± 0.004µs	3.915µs ± 0.002µs	3.918µs	3.920µs	3.923µs	3.941µs	0.65%	1.508	13.874	0.09%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	253767185.796op/s	255393562.824op/s ± 240905.779op/s	255408262.458op/s ± 144737.124op/s	255548889.190op/s	255651622.553op/s	255728496.869op/s	256606512.500op/s	0.47%	-1.470	13.722	0.09%	17034.611op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	68.221µs	68.495µs ± 0.327µs	68.339µs ± 0.061µs	68.573µs	69.305µs	69.423µs	69.804µs	2.14%	1.835	2.556	0.48%	0.023µs	1	200
credit_card/is_card_number/378282246310005	throughput	14325892.218op/s	14600025.498op/s ± 69177.143op/s	14632938.706op/s ± 13057.742op/s	14641601.606op/s	14649996.997op/s	14652546.016op/s	14658291.298op/s	0.17%	-1.818	2.474	0.47%	4891.563op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	45.399µs	45.698µs ± 0.098µs	45.691µs ± 0.072µs	45.776µs	45.854µs	45.888µs	45.936µs	0.54%	-0.094	-0.271	0.21%	0.007µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	21769639.047op/s	21882704.058op/s ± 46759.082op/s	21886142.800op/s ± 34495.026op/s	21916052.413op/s	21957339.004op/s	21990224.251op/s	22027098.561op/s	0.64%	0.105	-0.262	0.21%	3306.366op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	6.558µs	6.614µs ± 0.020µs	6.616µs ± 0.016µs	6.631µs	6.639µs	6.642µs	6.647µs	0.46%	-0.654	-0.205	0.30%	0.001µs	1	200
credit_card/is_card_number/x371413321323331	throughput	150453689.519op/s	151206814.162op/s ± 451154.849op/s	151142429.856op/s ± 354533.171op/s	151503605.753op/s	152059789.792op/s	152384123.909op/s	152491834.577op/s	0.89%	0.666	-0.180	0.30%	31901.465op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	3.898µs	3.914µs ± 0.003µs	3.914µs ± 0.001µs	3.916µs	3.919µs	3.921µs	3.924µs	0.25%	-0.525	6.577	0.07%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	254856925.378op/s	255466565.768op/s ± 175067.803op/s	255491453.171op/s ± 96599.370op/s	255577556.118op/s	255680339.430op/s	255725640.072op/s	256544083.997op/s	0.41%	0.542	6.669	0.07%	12379.163op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	65.582µs	65.720µs ± 0.053µs	65.719µs ± 0.039µs	65.759µs	65.794µs	65.847µs	65.872µs	0.23%	0.094	-0.248	0.08%	0.004µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	15181053.410op/s	15216012.720op/s ± 12219.827op/s	15216410.929op/s ± 9119.990op/s	15224756.969op/s	15235133.145op/s	15241798.089op/s	15247981.511op/s	0.21%	-0.090	-0.250	0.08%	864.072op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	53.355µs	53.429µs ± 0.037µs	53.427µs ± 0.022µs	53.448µs	53.503µs	53.524µs	53.563µs	0.25%	0.599	0.696	0.07%	0.003µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	18669667.054op/s	18716326.207op/s ± 12896.889op/s	18717100.092op/s ± 7642.359op/s	18724810.990op/s	18736775.004op/s	18741283.092op/s	18742255.112op/s	0.13%	-0.595	0.687	0.07%	911.948op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	3.894µs	3.914µs ± 0.003µs	3.914µs ± 0.002µs	3.916µs	3.918µs	3.919µs	3.922µs	0.20%	-1.743	13.486	0.07%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	254991266.923op/s	255494633.491op/s ± 173179.100op/s	255492079.749op/s ± 105152.310op/s	255595228.393op/s	255721536.687op/s	255782171.515op/s	256775996.962op/s	0.50%	1.768	13.698	0.07%	12245.612op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	50.143µs	50.209µs ± 0.029µs	50.208µs ± 0.019µs	50.227µs	50.262µs	50.271µs	50.293µs	0.17%	0.224	-0.185	0.06%	0.002µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	19883482.791op/s	19916809.557op/s ± 11383.970op/s	19917260.711op/s ± 7475.760op/s	19924249.995op/s	19934539.954op/s	19940515.034op/s	19942935.285op/s	0.13%	-0.221	-0.187	0.06%	804.968op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	45.472µs	45.715µs ± 0.085µs	45.716µs ± 0.060µs	45.772µs	45.853µs	45.890µs	45.914µs	0.43%	-0.136	-0.156	0.19%	0.006µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	21780042.062op/s	21874866.818op/s ± 40865.241op/s	21874263.989op/s ± 28750.185op/s	21903631.079op/s	21938883.160op/s	21977462.337op/s	21991742.954op/s	0.54%	0.147	-0.148	0.19%	2889.609op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	6.551µs	6.619µs ± 0.019µs	6.619µs ± 0.014µs	6.634µs	6.642µs	6.647µs	6.649µs	0.46%	-0.710	0.137	0.28%	0.001µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	150387732.973op/s	151085309.167op/s ± 423837.400op/s	151075999.645op/s ± 324921.989op/s	151332332.166op/s	151794979.168op/s	152214093.427op/s	152639826.606op/s	1.04%	0.724	0.176	0.28%	29969.830op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[3.916µs; 3.917µs] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/	throughput	[255325699.848op/s; 255383922.886op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[79.364µs; 79.549µs] or [-0.116%; +0.116%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[12571841.107op/s; 12600998.543op/s] or [-0.116%; +0.116%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[71.715µs; 71.802µs] or [-0.061%; +0.061%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[13927578.704op/s; 13944284.488op/s] or [-0.060%; +0.060%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[3.915µs; 3.916µs] or [-0.013%; +0.013%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[255360175.600op/s; 255426950.048op/s] or [-0.013%; +0.013%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[68.449µs; 68.540µs] or [-0.066%; +0.066%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[14590438.211op/s; 14609612.785op/s] or [-0.066%; +0.066%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[45.685µs; 45.712µs] or [-0.030%; +0.030%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[21876223.699op/s; 21889184.417op/s] or [-0.030%; +0.030%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[6.611µs; 6.616µs] or [-0.041%; +0.041%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[151144288.439op/s; 151269339.885op/s] or [-0.041%; +0.041%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[3.914µs; 3.915µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[255442303.054op/s; 255490828.481op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[65.713µs; 65.728µs] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[15214319.169op/s; 15217706.270op/s] or [-0.011%; +0.011%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[53.424µs; 53.434µs] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[18714538.822op/s; 18718113.592op/s] or [-0.010%; +0.010%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[3.914µs; 3.914µs] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[255470632.533op/s; 255518634.448op/s] or [-0.009%; +0.009%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[50.205µs; 50.213µs] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[19915231.848op/s; 19918387.266op/s] or [-0.008%; +0.008%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[45.703µs; 45.727µs] or [-0.026%; +0.026%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[21869203.289op/s; 21880530.348op/s] or [-0.026%; +0.026%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[6.616µs; 6.621µs] or [-0.039%; +0.039%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[151026569.380op/s; 151144048.954op/s] or [-0.039%; +0.039%]	None	None	None

Group 14

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sdk_test_data/rules-based	execution_time	144.966µs	146.843µs ± 1.690µs	146.523µs ± 0.533µs	147.108µs	148.592µs	153.448µs	161.950µs	10.53%	4.934	35.392	1.15%	0.120µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sdk_test_data/rules-based	execution_time	[146.609µs; 147.077µs] or [-0.160%; +0.160%]	None	None	None

Group 15

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.218µs	3.243µs ± 1.434µs	3.014µs ± 0.027µs	3.042µs	3.763µs	14.205µs	14.713µs	388.09%	7.252	54.063	44.10%	0.101µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[3.045µs; 3.442µs] or [-6.127%; +6.127%]	None	None	None

Group 16

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	159.876µs	160.818µs ± 0.282µs	160.806µs ± 0.119µs	160.935µs	161.202µs	161.376µs	163.037µs	1.39%	2.225	18.861	0.17%	0.020µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[160.779µs; 160.857µs] or [-0.024%; +0.024%]	None	None	None

Group 17

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	c8cc8e6	1764321574	gleocadie/make-bin_tests-contributing-to-code-coverage

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.332µs	2.425µs ± 0.024µs	2.429µs ± 0.011µs	2.438µs	2.458µs	2.467µs	2.471µs	1.74%	-1.305	2.630	0.98%	0.002µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.421µs; 2.428µs] or [-0.137%; +0.137%]	None	None	None

Baseline

Omitted due to size.

[dd-octo-sts]

Artifact Size Benchmark Report

aarch64-alpine-linux-musl

Artifact	Baseline	Commit	Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so	7.38 MB	7.38 MB	0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a	85.96 MB	85.96 MB	0% (0 B) 👌

aarch64-apple-darwin

Artifact	Baseline	Commit	Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a	57.99 MB	57.99 MB	0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib	8.43 MB	8.43 MB	0% (0 B) 👌

aarch64-unknown-linux-gnu

Artifact	Baseline	Commit	Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a	99.69 MB	99.69 MB	0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so	9.53 MB	9.53 MB	0% (0 B) 👌

libdatadog-x64-windows

Artifact	Baseline	Commit	Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll	19.57 MB	19.57 MB	0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib	69.82 KB	69.82 KB	0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb	138.53 MB	138.52 MB	-0% (-8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib	735.63 MB	735.63 MB	0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll	6.34 MB	6.34 MB	0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib	69.82 KB	69.82 KB	0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb	19.67 MB	19.67 MB	0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib	38.64 MB	38.64 MB	0% (0 B) 👌

libdatadog-x86-windows

Artifact	Baseline	Commit	Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll	16.70 MB	16.70 MB	0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib	70.90 KB	70.90 KB	0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb	141.08 MB	141.07 MB	--.01% (-16.00 KB) 💪
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib	724.37 MB	724.37 MB	0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll	4.87 MB	4.87 MB	0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib	70.90 KB	70.90 KB	0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb	20.90 MB	20.90 MB	0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib	36.39 MB	36.39 MB	0% (0 B) 👌

x86_64-alpine-linux-musl

Artifact	Baseline	Commit	Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a	74.31 MB	74.31 MB	0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so	8.85 MB	8.85 MB	0% (0 B) 👌

x86_64-apple-darwin

Artifact	Baseline	Commit	Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a	59.35 MB	59.35 MB	0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib	9.47 MB	9.47 MB	0% (0 B) 👌

x86_64-unknown-linux-gnu

Artifact	Baseline	Commit	Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a	93.92 MB	93.92 MB	0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so	10.28 MB	10.28 MB	0% (0 B) 👌