-
Notifications
You must be signed in to change notification settings - Fork 468
chore(profiling): improve typing in tests #15249
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
chore(profiling): improve typing in tests #15249
Conversation
|
|
Bootstrap import analysisComparison of import times between this PR and base. SummaryThe average import time from this PR is: 248 ± 4 ms. The average import time from base is: 253 ± 3 ms. The import time difference between this PR and base is: -4.4 ± 0.1 ms. Import time breakdownThe following import paths have grown:
|
Performance SLOsComparing candidate kowalski/chore-profiling-improve-typing-in-tests (065c823) with baseline main (73f2611) 📈 Performance Regressions (2 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 0.401µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.8% Memory: ✅ 39.459MB (SLO: <41.500MB -4.9%) vs baseline: +4.9% ✅ add_inplace_aspectTime: ✅ 0.409µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +1.1% Memory: ✅ 39.440MB (SLO: <41.500MB -5.0%) vs baseline: +4.8% ✅ add_inplace_noaspectTime: ✅ 0.321µs (SLO: <10.000µs 📉 -96.8%) vs baseline: +1.0% Memory: ✅ 39.479MB (SLO: <41.500MB -4.9%) vs baseline: +4.8% ✅ add_noaspectTime: ✅ 0.276µs (SLO: <10.000µs 📉 -97.2%) vs baseline: ~same Memory: ✅ 39.499MB (SLO: <41.500MB -4.8%) vs baseline: +4.8% ✅ bytearray_aspectTime: ✅ 1.318µs (SLO: <10.000µs 📉 -86.8%) vs baseline: -0.7% Memory: ✅ 39.577MB (SLO: <41.500MB -4.6%) vs baseline: +5.1% ✅ bytearray_extend_aspectTime: ✅ 1.552µs (SLO: <10.000µs 📉 -84.5%) vs baseline: +1.4% Memory: ✅ 39.538MB (SLO: <41.500MB -4.7%) vs baseline: +4.8% ✅ bytearray_extend_noaspectTime: ✅ 0.613µs (SLO: <10.000µs 📉 -93.9%) vs baseline: ~same Memory: ✅ 39.361MB (SLO: <41.500MB -5.2%) vs baseline: +4.7% ✅ bytearray_noaspectTime: ✅ 0.481µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -0.1% Memory: ✅ 39.440MB (SLO: <41.500MB -5.0%) vs baseline: +4.5% ✅ bytes_aspectTime: ✅ 1.301µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +1.1% Memory: ✅ 39.479MB (SLO: <41.500MB -4.9%) vs baseline: +4.8% ✅ bytes_noaspectTime: ✅ 0.494µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.2% Memory: ✅ 39.479MB (SLO: <41.500MB -4.9%) vs baseline: +4.7% ✅ bytesio_aspectTime: ✅ 1.310µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +1.6% Memory: ✅ 39.459MB (SLO: <41.500MB -4.9%) vs baseline: +4.8% ✅ bytesio_noaspectTime: ✅ 0.499µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.5% Memory: ✅ 39.518MB (SLO: <41.500MB -4.8%) vs baseline: +5.1% ✅ capitalize_aspectTime: ✅ 0.738µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.2% Memory: ✅ 39.459MB (SLO: <41.500MB -4.9%) vs baseline: +4.6% ✅ capitalize_noaspectTime: ✅ 0.430µs (SLO: <10.000µs 📉 -95.7%) vs baseline: -1.5% Memory: ✅ 39.459MB (SLO: <41.500MB -4.9%) vs baseline: +5.0% ✅ casefold_aspectTime: ✅ 0.735µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -0.1% Memory: ✅ 39.518MB (SLO: <41.500MB -4.8%) vs baseline: +5.0% ✅ casefold_noaspectTime: ✅ 0.367µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -1.0% Memory: ✅ 39.499MB (SLO: <41.500MB -4.8%) vs baseline: +4.9% ✅ decode_aspectTime: ✅ 0.726µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -0.7% Memory: ✅ 39.459MB (SLO: <41.500MB -4.9%) vs baseline: +4.6% ✅ decode_noaspectTime: ✅ 0.417µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.4% Memory: ✅ 39.499MB (SLO: <41.500MB -4.8%) vs baseline: +5.0% ✅ encode_aspectTime: ✅ 0.704µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -0.2% Memory: ✅ 39.440MB (SLO: <41.500MB -5.0%) vs baseline: +4.5% ✅ encode_noaspectTime: ✅ 0.402µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +0.6% Memory: ✅ 39.440MB (SLO: <41.500MB -5.0%) vs baseline: +4.5% ✅ format_aspectTime: ✅ 3.337µs (SLO: <10.000µs 📉 -66.6%) vs baseline: +0.2% Memory: ✅ 39.440MB (SLO: <41.500MB -5.0%) vs baseline: +4.4% ✅ format_map_aspectTime: ✅ 3.461µs (SLO: <10.000µs 📉 -65.4%) vs baseline: -1.2% Memory: ✅ 39.459MB (SLO: <41.500MB -4.9%) vs baseline: +4.7% ✅ format_map_noaspectTime: ✅ 0.781µs (SLO: <10.000µs 📉 -92.2%) vs baseline: +1.6% Memory: ✅ 39.420MB (SLO: <41.500MB -5.0%) vs baseline: +4.8% ✅ format_noaspectTime: ✅ 0.597µs (SLO: <10.000µs 📉 -94.0%) vs baseline: +0.3% Memory: ✅ 39.479MB (SLO: <41.500MB -4.9%) vs baseline: +5.0% ✅ index_aspectTime: ✅ 0.359µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.5% Memory: ✅ 39.420MB (SLO: <41.500MB -5.0%) vs baseline: +4.8% ✅ index_noaspectTime: ✅ 0.279µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +1.9% Memory: ✅ 39.479MB (SLO: <41.500MB -4.9%) vs baseline: +4.7% ✅ join_aspectTime: ✅ 1.397µs (SLO: <10.000µs 📉 -86.0%) vs baseline: +0.9% Memory: ✅ 39.538MB (SLO: <41.500MB -4.7%) vs baseline: +5.3% ✅ join_noaspectTime: ✅ 0.489µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.1% Memory: ✅ 39.440MB (SLO: <41.500MB -5.0%) vs baseline: +4.6% ✅ ljust_aspectTime: ✅ 2.531µs (SLO: <20.000µs 📉 -87.3%) vs baseline: +1.6% Memory: ✅ 39.577MB (SLO: <41.500MB -4.6%) vs baseline: +3.9% ✅ ljust_noaspectTime: ✅ 0.402µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.9% Memory: ✅ 39.400MB (SLO: <41.500MB -5.1%) vs baseline: +4.7% ✅ lower_aspectTime: ✅ 2.194µs (SLO: <10.000µs 📉 -78.1%) vs baseline: -0.6% Memory: ✅ 39.577MB (SLO: <41.500MB -4.6%) vs baseline: +4.0% ✅ lower_noaspectTime: ✅ 0.366µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -1.1% Memory: ✅ 39.577MB (SLO: <41.500MB -4.6%) vs baseline: +5.2% ✅ lstrip_aspectTime: ✅ 2.239µs (SLO: <20.000µs 📉 -88.8%) vs baseline: +1.2% Memory: ✅ 39.558MB (SLO: <41.500MB -4.7%) vs baseline: +5.2% ✅ lstrip_noaspectTime: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.1% Memory: ✅ 39.538MB (SLO: <41.500MB -4.7%) vs baseline: +5.0% ✅ modulo_aspectTime: ✅ 1.031µs (SLO: <10.000µs 📉 -89.7%) vs baseline: -1.8% Memory: ✅ 39.459MB (SLO: <41.500MB -4.9%) vs baseline: +5.2% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 1.572µs (SLO: <10.000µs 📉 -84.3%) vs baseline: +0.9% Memory: ✅ 39.499MB (SLO: <41.500MB -4.8%) vs baseline: +5.0% ✅ modulo_aspect_for_bytesTime: ✅ 0.980µs (SLO: <10.000µs 📉 -90.2%) vs baseline: +0.7% Memory: ✅ 39.538MB (SLO: <41.500MB -4.7%) vs baseline: +5.1% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 1.254µs (SLO: <10.000µs 📉 -87.5%) vs baseline: +0.3% Memory: ✅ 39.400MB (SLO: <41.500MB -5.1%) vs baseline: +4.8% ✅ modulo_noaspectTime: ✅ 0.629µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.2% Memory: ✅ 39.499MB (SLO: <41.500MB -4.8%) vs baseline: +4.9% ✅ replace_aspectTime: ✅ 5.406µs (SLO: <10.000µs 📉 -45.9%) vs baseline: 📈 +10.9% Memory: ✅ 39.558MB (SLO: <41.500MB -4.7%) vs baseline: +5.0% ✅ replace_noaspectTime: ✅ 0.461µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -1.4% Memory: ✅ 39.518MB (SLO: <41.500MB -4.8%) vs baseline: +5.1% ✅ repr_aspectTime: ✅ 0.909µs (SLO: <10.000µs 📉 -90.9%) vs baseline: +0.5% Memory: ✅ 39.577MB (SLO: <41.500MB -4.6%) vs baseline: +5.2% ✅ repr_noaspectTime: ✅ 0.411µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.1% Memory: ✅ 39.440MB (SLO: <41.500MB -5.0%) vs baseline: +4.8% ✅ rstrip_aspectTime: ✅ 1.894µs (SLO: <20.000µs 📉 -90.5%) vs baseline: +0.6% Memory: ✅ 39.420MB (SLO: <41.500MB -5.0%) vs baseline: +4.6% ✅ rstrip_noaspectTime: ✅ 0.379µs (SLO: <10.000µs 📉 -96.2%) vs baseline: ~same Memory: ✅ 39.400MB (SLO: <41.500MB -5.1%) vs baseline: +4.8% ✅ slice_aspectTime: ✅ 0.498µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.4% Memory: ✅ 39.518MB (SLO: <41.500MB -4.8%) vs baseline: +4.9% ✅ slice_noaspectTime: ✅ 0.446µs (SLO: <10.000µs 📉 -95.5%) vs baseline: -0.3% Memory: ✅ 39.538MB (SLO: <41.500MB -4.7%) vs baseline: +4.9% ✅ stringio_aspectTime: ✅ 1.527µs (SLO: <10.000µs 📉 -84.7%) vs baseline: +0.5% Memory: ✅ 39.400MB (SLO: <41.500MB -5.1%) vs baseline: +4.5% ✅ stringio_noaspectTime: ✅ 0.717µs (SLO: <10.000µs 📉 -92.8%) vs baseline: ~same Memory: ✅ 39.459MB (SLO: <41.500MB -4.9%) vs baseline: +4.8% ✅ strip_aspectTime: ✅ 2.553µs (SLO: <20.000µs 📉 -87.2%) vs baseline: 📈 +16.5% Memory: ✅ 39.479MB (SLO: <41.500MB -4.9%) vs baseline: +4.0% ✅ strip_noaspectTime: ✅ 0.385µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +1.1% Memory: ✅ 39.381MB (SLO: <41.500MB -5.1%) vs baseline: +4.6% ✅ swapcase_aspectTime: ✅ 2.388µs (SLO: <10.000µs 📉 -76.1%) vs baseline: -0.6% Memory: ✅ 39.440MB (SLO: <41.500MB -5.0%) vs baseline: +4.6% ✅ swapcase_noaspectTime: ✅ 0.531µs (SLO: <10.000µs 📉 -94.7%) vs baseline: -0.5% Memory: ✅ 39.459MB (SLO: <41.500MB -4.9%) vs baseline: +4.8% ✅ title_aspectTime: ✅ 2.372µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +1.6% Memory: ✅ 39.361MB (SLO: <41.500MB -5.2%) vs baseline: +3.4% ✅ title_noaspectTime: ✅ 0.503µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +1.2% Memory: ✅ 39.518MB (SLO: <41.500MB -4.8%) vs baseline: +4.9% ✅ translate_aspectTime: ✅ 3.245µs (SLO: <10.000µs 📉 -67.6%) vs baseline: +0.7% Memory: ✅ 39.459MB (SLO: <41.500MB -4.9%) vs baseline: +4.8% ✅ translate_noaspectTime: ✅ 1.042µs (SLO: <10.000µs 📉 -89.6%) vs baseline: +0.2% Memory: ✅ 39.400MB (SLO: <41.500MB -5.1%) vs baseline: +4.6% ✅ upper_aspectTime: ✅ 2.201µs (SLO: <10.000µs 📉 -78.0%) vs baseline: -1.6% Memory: ✅ 39.518MB (SLO: <41.500MB -4.8%) vs baseline: +4.0% ✅ upper_noaspectTime: ✅ 0.367µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.6% Memory: ✅ 39.538MB (SLO: <41.500MB -4.7%) vs baseline: +5.0% 📈 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 2.945µs (SLO: <20.000µs 📉 -85.3%) vs baseline: -0.8% Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +5.0% ✅ 1-count-metrics-100-timesTime: ✅ 198.954µs (SLO: <220.000µs -9.6%) vs baseline: -1.3% Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +4.9% ✅ 1-distribution-metric-1-timesTime: ✅ 3.389µs (SLO: <20.000µs 📉 -83.1%) vs baseline: +1.2% Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +4.8% ✅ 1-distribution-metrics-100-timesTime: ✅ 217.588µs (SLO: <220.000µs 🟡 -1.1%) vs baseline: -0.2% Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.6% ✅ 1-gauge-metric-1-timesTime: ✅ 2.465µs (SLO: <20.000µs 📉 -87.7%) vs baseline: 📈 +13.5% Memory: ✅ 34.465MB (SLO: <35.500MB -2.9%) vs baseline: +4.4% ✅ 1-gauge-metrics-100-timesTime: ✅ 137.165µs (SLO: <150.000µs -8.6%) vs baseline: +0.8% Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.9% ✅ 1-rate-metric-1-timesTime: ✅ 3.398µs (SLO: <20.000µs 📉 -83.0%) vs baseline: +8.3% Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.7% ✅ 1-rate-metrics-100-timesTime: ✅ 211.830µs (SLO: <250.000µs 📉 -15.3%) vs baseline: -1.9% Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +5.1% ✅ 100-count-metrics-100-timesTime: ✅ 19.978ms (SLO: <22.000ms -9.2%) vs baseline: +0.6% Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +4.7% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.242ms (SLO: <2.300ms -2.5%) vs baseline: -1.5% Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +5.3% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.412ms (SLO: <1.550ms -8.9%) vs baseline: +0.4% Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.9% ✅ 100-rate-metrics-100-timesTime: ✅ 2.178ms (SLO: <2.550ms 📉 -14.6%) vs baseline: +0.2% Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +5.2% ✅ flush-1-metricTime: ✅ 4.862µs (SLO: <20.000µs 📉 -75.7%) vs baseline: +5.9% Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.7% ✅ flush-100-metricsTime: ✅ 175.134µs (SLO: <250.000µs 📉 -29.9%) vs baseline: -0.1% Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +5.0% ✅ flush-1000-metricsTime: ✅ 2.119ms (SLO: <2.500ms 📉 -15.3%) vs baseline: -0.2% Memory: ✅ 35.291MB (SLO: <36.500MB -3.3%) vs baseline: +4.7% 🟡 Near SLO Breach (3 suites)🟡 flasksimple - 18/18✅ appsec-getTime: ✅ 4.582ms (SLO: <4.750ms -3.5%) vs baseline: -0.2% Memory: ✅ 64.067MB (SLO: <66.500MB -3.7%) vs baseline: +4.9% ✅ appsec-postTime: ✅ 6.620ms (SLO: <6.750ms 🟡 -1.9%) vs baseline: -0.2% Memory: ✅ 64.084MB (SLO: <66.500MB -3.6%) vs baseline: +4.7% ✅ appsec-telemetryTime: ✅ 4.585ms (SLO: <4.750ms -3.5%) vs baseline: ~same Memory: ✅ 64.092MB (SLO: <66.500MB -3.6%) vs baseline: +4.9% ✅ debuggerTime: ✅ 1.859ms (SLO: <2.000ms -7.0%) vs baseline: +0.5% Memory: ✅ 47.878MB (SLO: <49.500MB -3.3%) vs baseline: +4.8% ✅ iast-getTime: ✅ 1.859ms (SLO: <2.000ms -7.1%) vs baseline: +0.2% Memory: ✅ 44.447MB (SLO: <49.000MB -9.3%) vs baseline: +5.0% ✅ profilerTime: ✅ 1.929ms (SLO: <2.100ms -8.2%) vs baseline: +0.2% Memory: ✅ 48.681MB (SLO: <50.000MB -2.6%) vs baseline: +4.8% ✅ resource-renamingTime: ✅ 3.372ms (SLO: <3.650ms -7.6%) vs baseline: ~same Memory: ✅ 54.300MB (SLO: <56.000MB -3.0%) vs baseline: +4.8% ✅ tracerTime: ✅ 3.362ms (SLO: <3.650ms -7.9%) vs baseline: +0.1% Memory: ✅ 54.305MB (SLO: <56.500MB -3.9%) vs baseline: +4.8% ✅ tracer-nativeTime: ✅ 3.362ms (SLO: <3.650ms -7.9%) vs baseline: ~same Memory: ✅ 54.342MB (SLO: <60.000MB -9.4%) vs baseline: +4.8% 🟡 otelspan - 22/22✅ add-eventTime: ✅ 38.603ms (SLO: <47.150ms 📉 -18.1%) vs baseline: +0.4% Memory: ✅ 39.018MB (SLO: <47.000MB 📉 -17.0%) vs baseline: +5.0% ✅ add-metricsTime: ✅ 257.283ms (SLO: <344.800ms 📉 -25.4%) vs baseline: -0.3% Memory: ✅ 43.293MB (SLO: <47.500MB -8.9%) vs baseline: +4.9% ✅ add-tagsTime: ✅ 317.104ms (SLO: <321.000ms 🟡 -1.2%) vs baseline: +0.9% Memory: ✅ 43.313MB (SLO: <47.500MB -8.8%) vs baseline: +4.8% ✅ get-contextTime: ✅ 78.926ms (SLO: <92.350ms 📉 -14.5%) vs baseline: -0.1% Memory: ✅ 39.293MB (SLO: <46.500MB 📉 -15.5%) vs baseline: +5.0% ✅ is-recordingTime: ✅ 36.259ms (SLO: <44.500ms 📉 -18.5%) vs baseline: +0.7% Memory: ✅ 38.770MB (SLO: <47.500MB 📉 -18.4%) vs baseline: +5.1% ✅ record-exceptionTime: ✅ 56.983ms (SLO: <67.650ms 📉 -15.8%) vs baseline: +0.2% Memory: ✅ 39.400MB (SLO: <47.000MB 📉 -16.2%) vs baseline: +5.0% ✅ set-statusTime: ✅ 42.611ms (SLO: <50.400ms 📉 -15.5%) vs baseline: +0.9% Memory: ✅ 38.752MB (SLO: <47.000MB 📉 -17.5%) vs baseline: +4.8% ✅ startTime: ✅ 35.319ms (SLO: <43.450ms 📉 -18.7%) vs baseline: +0.2% Memory: ✅ 38.823MB (SLO: <47.000MB 📉 -17.4%) vs baseline: +4.7% ✅ start-finishTime: ✅ 81.927ms (SLO: <88.000ms -6.9%) vs baseline: +0.2% Memory: ✅ 36.569MB (SLO: <46.500MB 📉 -21.4%) vs baseline: +4.5% ✅ start-finish-telemetryTime: ✅ 83.670ms (SLO: <89.000ms -6.0%) vs baseline: ~same Memory: ✅ 36.589MB (SLO: <46.500MB 📉 -21.3%) vs baseline: +4.7% ✅ update-nameTime: ✅ 36.866ms (SLO: <45.150ms 📉 -18.3%) vs baseline: +0.5% Memory: ✅ 38.828MB (SLO: <47.000MB 📉 -17.4%) vs baseline: +4.4% 🟡 packagespackageforrootmodulemapping - 4/4✅ cache_offTime: ✅ 340.550ms (SLO: <354.300ms -3.9%) vs baseline: -0.6% Memory: ✅ 40.859MB (SLO: <41.500MB 🟡 -1.5%) vs baseline: +5.3% ✅ cache_onTime: ✅ 0.382µs (SLO: <10.000µs 📉 -96.2%) vs baseline: ~same Memory: ✅ 39.250MB (SLO: <41.000MB -4.3%) vs baseline: +5.0%
|
4027a65 to
8a1358d
Compare
8a1358d to
065c823
Compare
Description
As title says!