Skip to content

NO-ISSUE: Automated - Update synthetic test data #29716

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

openshift-bot
Copy link
Contributor

@openshift-bot openshift-bot commented Apr 25, 2025

disruptions Information

There were (392) added jobs and (0) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 773 jobs increased and 825 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
azure-network-liveness-new-connections 4.20 4.19 amd64 ovn gcp ha 498 4m40.2s 1679.05% 10m0.15s 1366.28%
openshift-api-http2-localhost-reused-connections 4.19 amd64 ovn azure ha 298 4m13s 197.65% 4m29.06s 212.06%
openshift-api-http2-localhost-reused-connections 4.19 amd64 ovn vsphere ha 364 3m51.7s 194.78% 4m29.37s 227.06%
kube-api-http2-localhost-new-connections 4.19 amd64 ovn vsphere ha 364 3m23s 195.06% 3m50.85s 229.79%
kube-api-http1-localhost-reused-connections 4.19 amd64 ovn vsphere ha 364 3m23s 195.06% 3m49.85s 228.36%
gcp-network-liveness-new-connections 4.20 4.19 amd64 ovn gcp ha 498 2m6.05s 8032.26% 6m58.06s 3749.54%
cache-oauth-api-new-connections 4.19 ppc64le ovn libvirt ha 357 3m56.4s 68.08% 10m20.32s 112.81%
oauth-api-new-connections 4.19 ppc64le ovn libvirt ha 357 3m57.8s 67.11% 10m20.88s 112.21%
cache-kube-api-new-connections 4.19 ppc64le ovn libvirt ha 357 3m57s 67.20% 10m21.2s 111.13%
openshift-api-new-connections 4.19 ppc64le ovn libvirt ha 357 3m56.8s 67.05% 10m21.2s 112.45%
kube-api-new-connections 4.19 ppc64le ovn libvirt ha 357 3m56.2s 67.28% 10m19.44s 111.85%
cache-openshift-api-new-connections 4.19 ppc64le ovn libvirt ha 357 3m57s 66.55% 10m21.32s 112.56%
kube-api-reused-connections 4.19 ppc64le ovn libvirt ha 357 3m37.2s 75.37% 9m25.44s 116.08%
cache-oauth-api-reused-connections 4.19 ppc64le ovn libvirt ha 357 3m37s 75.35% 9m25.2s 114.57%
ingress-to-console-new-connections 4.19 ppc64le ovn libvirt ha 357 3m54.6s 65.21% 10m16.44s 108.67%
ingress-to-oauth-server-new-connections 4.19 ppc64le ovn libvirt ha 357 3m55s 64.85% 10m17.44s 108.88%
cache-kube-api-new-connections 4.19 s390x ovn libvirt ha 121 4m19s 55.09% 9m52s 52.88%
kube-api-new-connections 4.19 s390x ovn libvirt ha 121 4m19s 55.09% 9m52.6s 52.32%
cache-oauth-api-new-connections 4.19 s390x ovn libvirt ha 121 4m19s 55.09% 9m51.8s 53.00%
cache-openshift-api-new-connections 4.19 s390x ovn libvirt ha 121 4m19s 55.09% 9m52s 52.88%
openshift-api-reused-connections 4.19 ppc64le ovn libvirt ha 357 3m36s 73.91% 9m27.76s 116.36%
oauth-api-reused-connections 4.19 ppc64le ovn libvirt ha 357 3m37.4s 73.02% 9m25.32s 115.96%
cache-openshift-api-reused-connections 4.19 ppc64le ovn libvirt ha 357 3m36.4s 73.47% 9m25.76s 116.20%
ingress-to-oauth-server-reused-connections 4.19 s390x ovn libvirt ha 121 4m11s 57.47% 9m45.4s 77.85%
ingress-to-console-reused-connections 4.19 s390x ovn libvirt ha 121 4m11s 57.47% 9m43.6s 69.38%
cache-kube-api-reused-connections 4.19 ppc64le ovn libvirt ha 357 3m36s 73.15% 9m25.44s 115.33%
ingress-to-console-new-connections 4.19 s390x ovn libvirt ha 121 4m19s 54.35% 9m51.6s 53.25%
metrics-api-new-connections 4.19 s390x ovn libvirt ha 121 4m19s 54.35% 9m51.6s 53.30%
ingress-to-oauth-server-new-connections 4.19 s390x ovn libvirt ha 121 4m19s 54.35% 9m51.6s 53.07%
cache-kube-api-reused-connections 4.19 s390x ovn libvirt ha 121 4m13s 56.37% 9m46.6s 78.21%
openshift-api-new-connections 4.19 s390x ovn libvirt ha 121 4m19s 54.35% 9m53.6s 52.58%
oauth-api-new-connections 4.19 s390x ovn libvirt ha 121 4m19s 54.35% 9m53.4s 52.19%
openshift-api-reused-connections 4.19 s390x ovn libvirt ha 121 4m13s 56.37% 9m46.8s 78.27%
metrics-api-new-connections 4.19 ppc64le ovn libvirt ha 357 3m53.8s 63.78% 10m17.44s 108.57%
oauth-api-reused-connections 4.19 s390x ovn libvirt ha 121 4m13s 55.60% 9m46.6s 78.21%
ingress-to-console-reused-connections 4.19 ppc64le ovn libvirt ha 357 3m36s 70.89% 9m30.92s 114.89%
cache-openshift-api-reused-connections 4.19 s390x ovn libvirt ha 121 4m11s 55.13% 9m46.4s 78.15%
cache-oauth-api-reused-connections 4.19 s390x ovn libvirt ha 121 4m11s 55.13% 9m46.4s 78.15%
metrics-api-reused-connections 4.19 s390x ovn libvirt ha 121 4m9s 54.28% 9m46.6s 78.21%
kube-api-reused-connections 4.19 s390x ovn libvirt ha 121 4m9s 53.89% 9m46.8s 78.27%
ingress-to-oauth-server-reused-connections 4.19 ppc64le ovn libvirt ha 357 3m32.8s 68.49% 9m26.08s 114.16%
metrics-api-reused-connections 4.19 ppc64le ovn libvirt ha 357 3m29.8s 65.78% 9m27.96s 117.34%
azure-network-liveness-new-connections 4.19 4.19 amd64 ovn aws ha 684 8.85s 105.81% 4m29.51s 412.57%
azure-network-liveness-new-connections 4.19 4.18 amd64 ovn gcp ha 760 6.05s 202.50% 10m29.15s 2568.15%
gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn aws ha 684 6s 200.00% 2m44.34s 335.68%
oauth-api-new-connections 4.20 4.19 amd64 ovn azure ha 1055 8s 60.00% 19s 124.06%
oauth-api-reused-connections 4.20 4.19 amd64 ovn azure ha 1055 7s 40.00% 15s 87.50%
openshift-api-new-connections 4.20 4.19 amd64 ovn azure ha 1055 7s 40.00% 17s 112.50%
kube-api-new-connections 4.20 4.19 amd64 ovn azure ha 1055 5s 66.67% 14.92s 148.67%
kube-api-reused-connections 4.20 4.19 amd64 ovn azure ha 1055 5s 66.67% 9s 50.00%
image-registry-new-connections 4.19 4.19 amd64 ovn aws ha 684 2s 100.00% 4s 33.33%
cache-openshift-api-reused-connections 4.19 4.19 amd64 ovn azure ha 480 2s 100.00% 3s 50.00%
kube-api-new-connections 4.20 4.20 amd64 ovn azure ha 414 3s 50.00% 25.48s 433.05%
cache-openshift-api-reused-connections 4.20 4.19 amd64 ovn azure ha 1055 2s 100.00% 3s 50.00%
cache-oauth-api-reused-connections 4.20 amd64 ovn azure ha 177 1s 1900.00% 2s 100.00%
image-registry-new-connections 4.19 4.19 amd64 ovn gcp ha 1103 2.9s 45.00% 5s 66.67%
cache-oauth-api-new-connections 4.20 4.19 amd64 ovn gcp ha 498 1s 81.82% 3s 200.00%
kube-api-new-connections 4.19 amd64 ovn azure ha 207 0s 0.00% 4.82s 45.18%
metrics-api-reused-connections 4.19 amd64 ovn azure ha 299 1s 0.00% 3s 50.00%
oauth-api-new-connections 4.19 4.19 amd64 ovn azure ha 480 5s 0.00% 28.21s 136.26%
gcp-network-liveness-new-connections 4.19 amd64 ovn vsphere ha 139 4.1s 0.00% 4m57.28s 1266.80%
kube-api-http1-internal-lb-new-connections 4.19 amd64 ovn metal ha 204 0s 0.00% 31.1s 65.43%
kube-api-http1-service-network-reused-connections 4.19 amd64 ovn vsphere ha 139 0s 0.00% 1s 47.06%
openshift-api-http2-internal-lb-reused-connections 4.19 amd64 ovn metal ha 204 0s 0.00% 18.46s 1746.00%
image-registry-new-connections 4.19 4.18 amd64 ovn gcp ha 760 2s 0.00% 5.41s 42.74%
oauth-api-new-connections 4.19 4.18 amd64 ovn gcp ha 760 0s 0.00% 2.41s 141.00%
azure-network-liveness-new-connections 4.19 amd64 ovn azure ha 207 0s 0.00% 15.28s 187.22%
service-load-balancer-with-pdb-reused-connections 4.19 amd64 ovn gcp ha 299 0s 0.00% 1s 156.41%
image-registry-reused-connections 4.19 amd64 ovn gcp ha 369 0s 0.00% 1s 156.41%
azure-network-liveness-reused-connections 4.19 amd64 ovn aws ha 191 0s 0.00% 200ms 150.00%
cache-oauth-api-reused-connections 4.19 amd64 ovn gcp ha 299 0s 0.00% 1s 156.41%
openshift-api-new-connections 4.19 4.18 amd64 ovn gcp ha 760 1s 0.00% 3s 200.00%
gcp-network-liveness-new-connections 4.19 amd64 ovn azure ha 207 0s 0.00% 8.7s 265.55%
azure-network-liveness-new-connections 4.19 amd64 ovn aws ha 616 2.25s 0.00% 7m0.75s 2048.88%
image-registry-new-connections 4.19 4.19 amd64 ovn azure ha 480 0s 0.00% 24.26s 2326.00%
ingress-to-oauth-server-new-connections 4.19 amd64 ovn gcp ha 299 1s 0.00% 3s 50.00%
oauth-api-new-connections 4.19 amd64 ovn gcp ha 299 1s 0.00% 3.02s 202.00%
ingress-to-oauth-server-new-connections 4.19 4.18 amd64 ovn gcp ha 760 1s 0.00% 5s 150.00%
cache-openshift-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1103 1s 0.00% 4s 100.00%
openshift-api-reused-connections 4.19 amd64 ovn aws ha 191 1s 0.00% 2s 100.00%
azure-network-liveness-new-connections 4.19 amd64 ovn gcp ha 299 13.2s 0.00% 3m8.02s 602.09%
ci-cluster-network-liveness-new-connections 4.19 amd64 ovn azure ha 207 0s 0.00% 11s 41.75%
kube-api-new-connections 4.19 4.18 amd64 ovn gcp ha 760 1s 0.00% 3s 67.60%
kube-api-http1-internal-lb-reused-connections 4.19 amd64 ovn azure ha 298 0s 0.00% 1s 63.93%
kube-api-http2-localhost-new-connections 4.19 amd64 ovn aws ha 614 1m21.35s 0.00% 2m58.09s 107.37%
image-registry-new-connections 4.19 amd64 ovn gcp ha 299 1s 0.00% 3.02s 51.00%
cache-openshift-api-reused-connections 4.19 amd64 ovn azure ha 207 1s 0.00% 2s 36.99%
oauth-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1103 1s 0.00% 4s 100.00%
azure-network-liveness-new-connections 4.19 4.18 amd64 ovn azure ha 1014 8s 0.00% 7m48.76s 11677.89%
host-to-service-new-connections 4.19 heterogeneous ovn aws ha 268 0s 0.00% 330ms 371.43%
host-to-pod-reused-connections 4.19 4.19 amd64 ovn aws single 391 0s 0.00% 3.1s 31.91%
gcp-network-liveness-new-connections 4.19 4.18 amd64 ovn azure ha 1014 3.35s 0.00% 5m8.35s 30735.00%
azure-network-liveness-new-connections 4.19 amd64 ovn metal single 111 0s 0.00% 8.6s 1094.44%
openshift-api-http2-internal-lb-new-connections 4.19 4.18 amd64 ovn gcp ha 760 5s 0.00% 7s 40.00%
host-to-service-new-connections 4.19 amd64 ovn metal ha 207 1s 0.00% 12m4.58s 72358.00%
openshift-api-http2-internal-lb-reused-connections 4.19 amd64 ovn vsphere ha 139 0s 0.00% 1s 47.06%
kube-api-http1-service-network-reused-connections 4.19 amd64 ovn gcp ha 299 0s 0.00% 1s 69.49%
kube-api-http2-service-network-reused-connections 4.19 arm64 ovn aws ha 265 0s 0.00% 1s 35.14%
openshift-api-http2-localhost-reused-connections 4.19 amd64 ovn aws ha 614 1m33s 0.00% 3m24.35s 106.66%
cache-kube-api-new-connections 4.19 4.18 amd64 ovn gcp ha 760 0s 0.00% 3s 50.00%
kube-api-http1-service-network-reused-connections 4.19 amd64 ovn azure ha 205 0s 0.00% 960ms 57.38%
kube-api-http1-service-network-reused-connections 4.19 arm64 ovn aws ha 265 0s 0.00% 1s 3233.33%
kube-api-http2-service-network-reused-connections 4.19 amd64 ovn azure ha 205 0s 0.00% 960ms 57.38%
gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn gcp ha 1103 2.9s 0.00% 3m38.46s 6287.72%
kube-api-http2-service-network-reused-connections 4.19 heterogeneous ovn aws ha 263 0s 0.00% 380ms 280.00%
metrics-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1103 1s 0.00% 4s 300.00%
azure-network-liveness-new-connections 4.19 amd64 ovn vsphere ha 139 8.2s 0.00% 7m49.58s 908.76%
openshift-api-new-connections 4.19 amd64 ovn azure ha 207 0s 0.00% 10.52s 70.78%
cache-kube-api-new-connections 4.19 4.19 amd64 ovn azure ha 480 0s 0.00% 21.47s 2047.00%
kube-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1103 1s 0.00% 3s 200.00%
gcp-network-liveness-new-connections 4.19 amd64 ovn gcp ha 299 5.1s 0.00% 1m52.52s 1660.88%
kube-api-http2-localhost-reused-connections 4.19 amd64 ovn aws ha 614 1m22s 0.00% 2m58.09s 107.37%
gcp-network-liveness-new-connections 4.19 amd64 ovn aws external 767 0s 0.00% 2m15s 525.58%
metrics-api-new-connections 4.19 amd64 ovn vsphere ha 494 0s 0.00% 6s 823.08%
openshift-api-reused-connections 4.19 4.19 amd64 ovn aws ha 684 1s 0.00% 3s 50.00%
service-load-balancer-with-pdb-reused-connections 4.19 4.18 amd64 ovn azure ha 1014 3s 0.00% 4s 33.33%
openshift-api-http2-internal-lb-new-connections 4.19 amd64 ovn azure ha 298 0s 0.00% 5.12s 91.04%
ingress-to-console-new-connections 4.19 4.18 amd64 ovn gcp ha 760 2s 0.00% 4s 43.37%
cache-openshift-api-new-connections 4.19 4.18 amd64 ovn gcp ha 760 0s 0.00% 2.41s 141.00%
gcp-network-liveness-new-connections 4.19 amd64 ovn aws ha 191 1s 0.00% 2m16.5s 7238.71%
openshift-api-http2-service-network-reused-connections 4.19 heterogeneous ovn aws ha 263 0s 0.00% 1s 900.00%
azure-network-liveness-new-connections 4.19 heterogeneous ovn aws ha 268 0s 0.00% 4.32s 332.00%
ingress-to-console-new-connections 4.19 4.19 amd64 ovn gcp ha 1103 2s 0.00% 5s 66.67%
host-to-host-new-connections 4.19 4.19 amd64 ovn aws ha 684 1.85s 0.00% 54.36s 5336.00%
azure-network-liveness-new-connections 4.19 amd64 ovn aws external 767 0s 0.00% 3m35.52s 456.32%
metrics-api-new-connections 4.19 4.18 amd64 ovn gcp ha 760 0s 0.00% 3s 200.00%
metrics-api-reused-connections 4.19 amd64 ovn metal ha 182 0s 0.00% 32.52s 8457.89%
ingress-to-oauth-server-new-connections 4.19 4.19 amd64 ovn azure ha 480 0s 0.00% 27.47s 5744.68%
azure-network-liveness-new-connections 4.19 4.19 amd64 ovn gcp ha 1103 10s 0.00% 6m52.84s 3223.99%
kube-api-http1-internal-lb-new-connections 4.19 4.19 amd64 ovn azure ha 480 0s 0.00% 1s 376.19%
kube-api-http2-service-network-reused-connections 4.19 amd64 ovn metal ha 204 0s 0.00% 25.22s 2422.00%
openshift-api-new-connections 4.19 4.19 amd64 ovn aws ha 684 0s 0.00% 1.17s 36.05%
kube-api-http1-service-network-reused-connections 4.19 heterogeneous ovn aws ha 263 0s 0.00% 380ms 280.00%
ingress-to-console-new-connections 4.19 amd64 ovn metal ha 221 0s 0.00% 54.6s 5360.00%
kube-api-http2-service-network-reused-connections 4.19 4.18 amd64 ovn aws ha 936 0s 0.00% 1s 35.14%
oauth-api-reused-connections 4.19 amd64 ovn metal ha 207 0s 0.00% 30.08s 572.93%
cache-oauth-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1103 1s 0.00% 3s 50.00%
openshift-api-new-connections 4.19 4.19 amd64 ovn azure ha 480 5s 0.00% 27.21s 95.19%
gcp-network-liveness-new-connections 4.19 4.18 amd64 ovn gcp ha 760 5.05s 0.00% 5m40.82s 4275.10%
openshift-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1103 1s 0.00% 4s 100.00%
kube-api-new-connections 4.19 4.19 amd64 ovn azure ha 480 3s 0.00% 23.26s 287.67%
cache-oauth-api-new-connections 4.19 4.18 amd64 ovn gcp ha 760 1s 0.00% 3s 67.60%
cache-kube-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1103 1s 0.00% 3s 50.00%
service-load-balancer-with-pdb-new-connections 4.19 4.19 amd64 ovn azure ha 480 0s 0.00% 33.21s 3221.00%
azure-network-liveness-reused-connections 4.20 4.19 amd64 ovn gcp ha 498 150ms 0.00% 2s 545.16%
cache-openshift-api-new-connections 4.20 4.19 amd64 ovn gcp ha 498 1s 0.00% 3s 200.00%
oauth-api-new-connections 4.20 4.19 amd64 ovn gcp ha 498 1s 0.00% 3s 200.00%
kube-api-http2-localhost-reused-connections 4.20 ppc64le ovn libvirt ha 206 0s 0.00% 45.6s 71.04%
metrics-api-new-connections 4.20 4.20 amd64 ovn aws ha 491 0s 0.00% 5.1s 8400.00%
openshift-api-new-connections 4.20 4.19 amd64 ovn gcp ha 498 1s 0.00% 2s 100.00%
openshift-api-http2-localhost-new-connections 4.20 ppc64le ovn libvirt ha 206 0s 0.00% 58.9s 80.23%
metrics-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1055 0s 0.00% 3s 200.00%
oauth-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1055 1s 0.00% 4s 300.00%
ingress-to-oauth-server-reused-connections 4.20 amd64 ovn metal ha 127 1s 0.00% 43.6s 4260.00%
kube-api-http1-internal-lb-new-connections 4.20 4.20 amd64 ovn aws single 313 28s 0.00% 48.68s 45.14%
kube-api-reused-connections 4.20 4.19 amd64 ovn aws ha 962 0s 0.00% 1s 150.00%
openshift-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1055 1s 0.00% 3s 200.00%
kube-api-http1-localhost-reused-connections 4.20 4.20 amd64 ovn aws single 313 28s 0.00% 48.56s 45.17%
service-load-balancer-with-pdb-new-connections 4.20 heterogeneous ovn aws ha 161 0s 0.00% 1.4s 40.00%
kube-api-http2-internal-lb-reused-connections 4.20 4.20 amd64 ovn aws single 313 28s 0.00% 48.68s 45.14%
metrics-api-new-connections 4.20 4.20 amd64 ovn azure ha 414 0s 0.00% 28.83s 3596.15%
kube-api-http1-localhost-reused-connections 4.20 ppc64le ovn libvirt ha 206 0s 0.00% 45.6s 71.04%
ingress-to-console-reused-connections 4.20 amd64 ovn metal ha 119 1s 0.00% 7.1s 330.30%
kube-api-http1-internal-lb-reused-connections 4.20 4.20 amd64 ovn aws single 313 28s 0.00% 48.68s 45.14%
image-registry-reused-connections 4.20 4.20 amd64 ovn gcp ha 1055 1s 0.00% 2s 100.00%
ingress-to-oauth-server-new-connections 4.20 4.19 amd64 ovn aws ha 962 1s 0.00% 4.39s 46.33%
kube-api-http2-internal-lb-new-connections 4.20 4.20 amd64 ovn aws single 313 28s 0.00% 48.68s 45.14%
kube-api-http2-localhost-reused-connections 4.20 4.20 amd64 ovn aws single 313 28s 0.00% 48.56s 45.17%
kube-api-http1-localhost-new-connections 4.20 ppc64le ovn libvirt ha 206 0s 0.00% 45.6s 71.04%
kube-api-http2-localhost-new-connections 4.20 4.20 amd64 ovn aws single 313 28s 0.00% 48.56s 45.17%
kube-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1055 1s 0.00% 2.46s 146.00%
image-registry-reused-connections 4.20 4.19 amd64 ovn gcp ha 498 1s 0.00% 2s 100.00%
kube-api-http1-service-network-reused-connections 4.20 amd64 ovn azure ha 177 0s 0.00% 1s 63.93%
service-load-balancer-with-pdb-new-connections 4.20 4.19 amd64 ovn azure ha 1055 0s 0.00% 3s 200.00%
kube-api-http1-service-network-reused-connections 4.20 4.19 amd64 ovn azure ha 1055 1s 0.00% 2s 100.00%
cache-openshift-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1055 1s 0.00% 2s 100.00%
oauth-api-new-connections 4.20 4.20 amd64 ovn azure ha 414 6s 0.00% 26.61s 203.08%
openshift-api-new-connections 4.20 4.20 amd64 ovn aws ha 491 0s 0.00% 10.6s 47.63%
service-load-balancer-with-pdb-reused-connections 4.20 4.20 amd64 ovn azure ha 414 3s 0.00% 4s 33.33%
ingress-to-oauth-server-new-connections 4.20 4.20 amd64 ovn gcp ha 1055 1s 0.00% 3.46s 33.08%
kube-api-new-connections 4.20 4.19 amd64 ovn gcp ha 498 1s 0.00% 3s 200.00%
ingress-to-console-new-connections 4.20 amd64 ovn aws external 469 6s 0.00% 1h8m12.76s 74449.36%
cache-kube-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1055 1s 0.00% 2s 100.00%
kube-api-http1-localhost-new-connections 4.20 4.20 amd64 ovn aws single 313 28s 0.00% 48.56s 45.17%
openshift-api-http2-internal-lb-new-connections 4.20 amd64 ovn azure ha 177 0s 0.00% 3.88s 536.07%
image-registry-new-connections 4.20 4.20 amd64 ovn azure ha 414 0s 0.00% 31.48s 3935.90%
kube-api-reused-connections 4.20 amd64 ovn azure ha 177 1s 0.00% 2.24s 183.54%
kube-api-http2-localhost-new-connections 4.20 ppc64le ovn libvirt ha 206 0s 0.00% 45.6s 71.04%
ingress-to-console-new-connections 4.20 4.20 amd64 ovn azure ha 414 0s 0.00% 29.87s 3729.49%
ingress-to-oauth-server-new-connections 4.20 4.20 amd64 ovn azure ha 414 0s 0.00% 32.61s 3161.00%
cache-kube-api-reused-connections 4.20 amd64 ovn azure ha 177 1s 0.00% 1s 63.93%
ci-cluster-network-liveness-new-connections 4.20 4.19 amd64 ovn azure ha 1055 0s 0.00% 3s 50.00%
service-load-balancer-with-pdb-new-connections 4.20 4.20 amd64 ovn azure ha 414 0s 0.00% 28.74s 2774.00%
metrics-api-new-connections 4.20 4.19 amd64 ovn gcp ha 498 1s 0.00% 2s 100.00%
cache-kube-api-new-connections 4.20 4.19 amd64 ovn gcp ha 498 1s 0.00% 2.03s 103.00%
kube-api-http2-service-network-reused-connections 4.20 4.20 amd64 ovn aws ha 491 0s 0.00% 1s 1566.67%
host-to-host-new-connections 4.20 4.19 amd64 ovn gcp ha 498 0s 0.00% 1s 222.58%
ingress-to-console-reused-connections 4.20 amd64 ovn aws external 469 6s 0.00% 1h7m44.56s 73935.70%
openshift-api-http2-localhost-reused-connections 4.20 ppc64le ovn libvirt ha 206 0s 0.00% 58.9s 80.23%
host-to-host-new-connections 4.20 4.20 amd64 ovn aws ha 491 4s 0.00% 46.3s 4530.00%
cache-oauth-api-new-connections 4.20 4.20 amd64 ovn gcp ha 1055 1s 0.00% 3s 200.00%
openshift-api-new-connections 4.20 4.20 amd64 ovn azure ha 414 5s 0.00% 28.96s 327.14%
service-load-balancer-with-pdb-reused-connections 4.20 4.19 amd64 ovn gcp ha 498 3s 0.00% 4s 33.33%
kube-api-http2-localhost-reused-connections 4.20 amd64 ovn azure ha 177 1m15s 0.00% 3m37.6s 212.73%
ci-cluster-network-liveness-new-connections 4.20 4.19 amd64 ovn gcp ha 498 0s 0.00% 16s 201.32%

alerts Information

There were (9267) added jobs and (2184) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 147 jobs increased and 326 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
TargetDown openshift-console Warning 4.19 4.18 amd64 ovn azure ha 179 2h35m6.8s 64.15% 2h39m26.08s 53.71%
TargetDown openshift-console Warning 4.19 4.18 amd64 ovn aws ha 199 2h26m14.8s 65.52% 2h28m58.48s 57.05%
TargetDown openshift-console Warning 4.19 4.18 amd64 ovn gcp ha 218 2h23m39.5s 59.15% 2h25m39.62s 57.12%
NodeSystemSaturation openshift-monitoring Warning 4.20 arm64 ovn aws ha 107 29m54s 653.78% 41m25.32s 163.63%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.20 amd64 ovn aws ha 203 26m56s 502.99% 31m23.6s 251.42%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.19 amd64 ovn aws ha 322 26m22.5s 389.94% 30m17.7s 224.76%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.18 amd64 ovn aws ha 199 23m54s 705.62% 27m55.16s 432.47%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 arm64 ovn aws ha 107 20m21.6s 4262.86% 29m52.2s 1902.01%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 amd64 ovn aws ha 232 19m26s 13780.95% 27m21s 701.74%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 arm64 ovn aws ha 107 20m14.2s 1993.45% 28m48.64s 1727.32%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.19 amd64 ovn aws ha 290 21m54s 639.03% 23m59.08s 341.44%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn aws ha 260 19m27.4s 957.43% 29m39.8s 503.73%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 arm64 ovn aws ha 112 17m38.4s 3680.00% 27m42.8s 1727.25%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.20 amd64 ovn aws ha 203 13m56s 2885.71% 18m53.6s 1854.48%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.19 amd64 ovn aws ha 322 13m26s 2778.57% 17m26s 1703.45%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn metal ha 261 14m22s 852.49% 41m40.8s 335.33%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 amd64 ovn gcp ha 134 18m18s 164.20% 32m45.6s 213.91%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn gcp ha 142 12m23.1s 877.76% 15m3.4s 179.52%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.19 amd64 ovn gcp ha 215 12m16s 566.06% 15m53.8s 255.90%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.20 amd64 ovn gcp ha 276 11m35s 872.03% 14m4.5s 72.59%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.18 amd64 ovn gcp ha 218 15m0.5s 199.67% 18m45.8s 191.66%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn aws ha 260 10m26s 2135.71% 14m44.02s 409.23%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 amd64 ovn aws ha 232 10m9.5s 2076.79% 12m16.7s 1170.17%
NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn aws single 100 16m26s 133.65% 17m27.2s 51.73%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.19 amd64 ovn gcp ha 193 15m9.2s 155.39% 18m28.4s 166.44%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn gcp ha 142 16m22.6s 111.77% 26m19.1s 100.60%
NodeSystemSaturation openshift-monitoring Warning 4.19 4.19 amd64 ovn gcp ha 215 10m1.8s 587.77% 18m23s 430.29%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 amd64 ovn vsphere ha 160 8m30.5s 12054.76% 23m45.2s 1619.18%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn gcp ha 142 10m17.2s 307.12% 27m43.28s 284.73%
NodeSystemSaturation openshift-monitoring Warning 4.20 4.20 amd64 ovn gcp ha 276 8m8.5s 1644.64% 19m38s 43.19%
NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn metal ha 238 10m30.4s 249.83% 44m11.42s 220.86%
NodeSystemSaturation openshift-monitoring Warning 4.19 4.19 amd64 ovn aws single 188 12m56s 138.04% 16m7.7s 167.76%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn aws single 114 14m36.5s 105.37% 16m48.2s 74.24%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn metal ha 261 8m56s 454.29% 13m56s 185.38%
NodeSystemSaturation openshift-monitoring Warning 4.20 4.20 amd64 ovn aws single 171 12m56s 129.59% 14m26s 86.16%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.18 amd64 ovn gcp ha 218 10m26s 203.88% 17m20.9s 151.77%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.19 amd64 ovn gcp ha 193 10m8.8s 195.10% 16m30.8s 246.87%
NodeSystemSaturation openshift-monitoring Warning 4.19 4.18 amd64 ovn gcp ha 218 12m39.5s 101.99% 23m35.6s 41.05%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.19 amd64 ovn gcp ha 215 9m56s 150.95% 13m56s 144.09%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.20 amd64 ovn gcp ha 276 10m3.5s 126.88% 13m41s 49.35%
KubeletPlegDurationHigh kube-system Warning 4.20 amd64 ovn gcp ha 134 2m28s 32.14% 4m18.1s 37.58%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn metal ha 261 4m26s 0.00% 23m38s 1098.65%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 arm64 ovn aws ha 112 25m52.9s 0.00% 35m49.48s 1724.69%
KubeJobFailed openshift-insights Warning 4.19 arm64 ovn aws ha 112 39m7.1s 0.00% 3h31m23.74s 30.51%
NodeSystemSaturation openshift-monitoring Warning 4.19 arm64 ovn aws ha 112 35m46.8s 0.00% 51m49.66s 2012.54%
NodeClockNotSynchronising openshift-monitoring Critical 4.19 amd64 ovn metal ha 261 0s 0.00% 4h34m30s 167.50%
NodeSystemSaturation openshift-monitoring Warning 4.19 4.18 amd64 ovn azure ha 179 2m59s 0.00% 5m56s 1171.43%
SystemMemoryExceedsReservation openshift-machine-config-operator Warning 4.19 amd64 ovn aws ha 260 0s 0.00% 10m0.8s 86.54%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn azure ha 117 34s 0.00% 4m41.44s 9951.43%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn vsphere ha 159 17m1s 0.00% 32m22.04s 892.36%
NodeSystemSaturation openshift-monitoring Warning 4.19 4.19 amd64 ovn aws ha 322 14m56s 0.00% 29m20.12s 191.85%
KubeletPlegDurationHigh kube-system Warning 4.19 amd64 ovn metal ha 261 1m28s 0.00% 9m10s 922.30%
etcdHighCommitDurations openshift-etcd Warning 4.19 4.18 amd64 ovn azure ha 179 1m59.2s 0.00% 23m24.76s 266.01%
KubeJobFailed openshift-insights Warning 4.19 amd64 ovn gcp ha 142 2h22m35.5s 0.00% 4h17m3.2s 52.83%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn vsphere ha 159 5m4.8s 0.00% 26m14.6s 3486.79%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn aws ha 260 13m1.5s 0.00% 30m48.6s 3154.58%
NodeSystemSaturation openshift-monitoring Warning 4.20 4.19 amd64 ovn aws ha 290 9m42.5s 0.00% 24m0.82s 487.61%
NodeSystemSaturation openshift-monitoring Warning 4.20 4.20 amd64 ovn azure ha 197 2m26s 0.00% 2m59.04s 539.43%
SystemMemoryExceedsReservation openshift-machine-config-operator Warning 4.20 amd64 ovn gcp ha 134 0s 0.00% 13m13.5s 1387.07%
NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn aws ha 232 16m56s 0.00% 32m16.08s 1923.49%
NodeSystemSaturation openshift-monitoring Warning 4.20 4.19 amd64 ovn azure ha 265 1m27.6s 0.00% 6m24.72s 1274.00%
SystemMemoryExceedsReservation openshift-machine-config-operator Warning 4.20 arm64 ovn aws ha 107 11m30.4s 0.00% 16m9.52s 414.28%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 amd64 ovn metal ha 238 7m26.8s 0.00% 21m3.8s 1245.04%
etcdHighCommitDurations openshift-etcd Warning 4.20 4.19 amd64 ovn azure ha 265 2m52s 0.00% 13m1.52s 60.74%
NodeSystemSaturation openshift-monitoring Warning 4.20 4.20 amd64 ovn aws ha 203 25m21s 0.00% 36m22.24s 3945.68%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.20 amd64 ovn metal ha 238 10m30.5s 0.00% 12m25.26s 151.78%
NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn gcp ha 134 11m22s 0.00% 27m20.88s 245.01%
NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn azure ha 111 0s 0.00% 2m49s 1729.00%
SystemMemoryExceedsReservation openshift-machine-config-operator Warning 4.20 amd64 ovn aws ha 232 0s 0.00% 17m18.18s 266.07%
NodeSystemSaturation openshift-monitoring Warning 4.20 amd64 ovn vsphere ha 160 16m26s 0.00% 32m20.24s 882.20%
KubeletPlegDurationHigh kube-system Warning 4.20 amd64 ovn metal ha 238 2m32.5s 0.00% 7m28s 434.61%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 amd64 ovn gcp ha 134 11m8.5s 0.00% 15m46.76s 1407.58%
IngressControllerUnavailable openshift-ingress-operator Warning 4.20 4.20 amd64 ovn aws single 171 0s 0.00% 27m50.4s 11065.78%
/cc @dgoodwin, @neisw, @DennisPeriquet

@openshift-ci-robot openshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Apr 25, 2025
@openshift-ci-robot
Copy link

@openshift-bot: This pull request explicitly references no jira issue.

In response to this:

disruptions Information

There were (162) added jobs and (0) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, disruptions had 402 jobs increased and 1074 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
openshift-api-http2-localhost-reused-connections 4.19 amd64 ovn azure ha 155 4m13.5s 198.24% 4m29.92s 213.06%
openshift-api-http2-localhost-new-connections 4.19 amd64 ovn vsphere ha 203 3m48.8s 193.33% 4m25.9s 225.54%
gcp-network-liveness-new-connections 4.20 4.19 amd64 ovn gcp ha 315 7.3s 370.97% 20.58s 89.50%
ingress-to-oauth-server-new-connections 4.20 4.20 amd64 ovn gcp ha 487 2s 100.00% 5s 92.31%
kube-api-reused-connections 4.20 4.19 amd64 ovn azure ha 710 4s 33.33% 8s 33.33%
image-registry-new-connections 4.20 4.20 amd64 ovn aws ha 227 2.7s 35.00% 6.74s 34.80%
kube-api-http1-service-network-reused-connections 4.19 amd64 ovn azure ha 155 0s 0.00% 1s 63.93%
oauth-api-new-connections 4.19 4.18 amd64 ovn gcp ha 736 1s 0.00% 2.65s 165.00%
cache-openshift-api-new-connections 4.19 4.18 amd64 ovn gcp ha 736 1s 0.00% 2.65s 165.00%
gcp-network-liveness-new-connections 4.19 amd64 ovn gcp ha 293 1s 0.00% 18.4s 187.95%
cache-oauth-api-reused-connections 4.19 amd64 ovn gcp ha 364 0s 0.00% 1s 156.41%
cache-oauth-api-new-connections 4.19 amd64 ovn gcp ha 293 400ms 0.00% 2s 100.00%
metrics-api-reused-connections 4.19 amd64 ovn metal ha 183 0s 0.00% 5.58s 1368.42%
image-registry-reused-connections 4.19 4.19 arm64 ovn aws ha 109 0s 0.00% 920ms 666.67%
cache-oauth-api-new-connections 4.19 4.18 amd64 ovn gcp ha 736 1s 0.00% 2.65s 48.04%
cache-openshift-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1217 1s 0.00% 3s 50.00%
azure-network-liveness-new-connections 4.19 4.19 amd64 ovn gcp ha 1217 0s 0.00% 21s 69.08%
host-to-service-new-connections 4.19 s390x ovn libvirt ha 145 0s 0.00% 1s 75.44%
openshift-api-http2-internal-lb-new-connections 4.19 4.18 amd64 ovn gcp ha 382 5s 0.00% 7s 40.00%
azure-network-liveness-new-connections 4.19 4.18 amd64 ovn azure ha 1087 0s 0.00% 12s 201.51%
oauth-api-reused-connections 4.19 amd64 ovn metal ha 227 0s 0.00% 19.5s 336.24%
metrics-api-new-connections 4.19 4.18 amd64 ovn gcp ha 736 1s 0.00% 3s 200.00%
oauth-api-new-connections 4.19 amd64 ovn gcp ha 293 1s 0.00% 4s 300.00%
kube-api-http2-localhost-new-connections 4.19 amd64 ovn aws ha 280 1m22.15s 0.00% 2m53.47s 101.99%
ingress-to-oauth-server-new-connections 4.19 amd64 ovn gcp ha 293 1s 0.00% 3s 50.00%
kube-api-http1-internal-lb-reused-connections 4.19 amd64 ovn azure ha 155 0s 0.00% 1s 63.93%
gcp-network-liveness-new-connections 4.19 4.19 amd64 ovn gcp ha 1217 0s 0.00% 8.84s 158.48%
gcp-network-liveness-new-connections 4.19 4.18 amd64 ovn azure ha 1087 0s 0.00% 8.14s 714.00%
kube-api-http2-service-network-reused-connections 4.19 amd64 ovn azure ha 129 0s 0.00% 1s 63.93%
gcp-network-liveness-new-connections 4.19 amd64 ovn aws ha 189 0s 0.00% 16.32s 777.42%
kube-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1217 1s 0.00% 2.84s 184.00%
oauth-api-reused-connections 4.19 amd64 ovn gcp ha 364 0s 0.00% 1s 92.31%
image-registry-new-connections 4.19 4.19 amd64 ovn gcp ha 1217 2s 0.00% 5s 66.67%
image-registry-new-connections 4.19 amd64 ovn gcp ha 293 1s 0.00% 3.08s 54.00%
ingress-to-oauth-server-new-connections 4.19 4.18 amd64 ovn gcp ha 736 1.25s 0.00% 4s 100.00%
cache-kube-api-new-connections 4.19 amd64 ovn gcp ha 293 1s 0.00% 3.08s 50.98%
ingress-to-console-new-connections 4.19 4.19 amd64 ovn gcp ha 1217 2s 0.00% 4.84s 61.33%
host-to-service-new-connections 4.19 heterogeneous ovn aws ha 279 0s 0.00% 220ms 214.29%
openshift-api-reused-connections 4.19 amd64 ovn metal ha 206 0s 0.00% 4m35.5s 7325.88%
openshift-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1217 1s 0.00% 3s 50.00%
metrics-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1217 1s 0.00% 3.84s 284.00%
host-to-service-reused-connections 4.19 4.19 amd64 ovn aws single 410 0s 0.00% 3.91s 30.33%
openshift-api-new-connections 4.19 4.18 amd64 ovn gcp ha 736 1s 0.00% 3s 200.00%
ci-cluster-network-liveness-new-connections 4.19 amd64 ovn aws ha 189 0s 0.00% 11.24s 293.01%
cache-oauth-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1217 1s 0.00% 2.84s 42.00%
kube-api-http2-service-network-reused-connections 4.19 4.18 amd64 ovn aws ha 554 0s 0.00% 1s 35.14%
service-load-balancer-with-pdb-reused-connections 4.19 amd64 ovn gcp ha 293 0s 0.00% 1s 156.41%
host-to-host-new-connections 4.19 amd64 ovn gcp ha 293 0s 0.00% 1s 92.31%
oauth-api-new-connections 4.19 4.19 amd64 ovn gcp ha 1217 1s 0.00% 4s 100.00%
host-to-host-new-connections 4.19 amd64 ovn metal ha 205 0s 0.00% 28m29.76s 10243.38%
oauth-api-new-connections 4.20 4.19 amd64 ovn gcp ha 315 1s 0.00% 1.86s 86.00%
ingress-to-oauth-server-new-connections 4.20 4.20 amd64 ovn azure ha 158 0s 0.00% 3.15s 215.00%
cache-kube-api-new-connections 4.20 4.20 amd64 ovn gcp ha 487 1s 0.00% 2.14s 114.00%
openshift-api-new-connections 4.20 4.20 amd64 ovn gcp ha 487 1s 0.00% 4s 300.00%
image-registry-reused-connections 4.20 4.20 amd64 ovn gcp ha 487 1s 0.00% 2s 100.00%
kube-api-new-connections 4.20 4.20 amd64 ovn gcp ha 487 1s 0.00% 3s 200.00%
kube-api-new-connections 4.20 4.19 amd64 ovn gcp ha 315 1s 0.00% 1.86s 86.00%
metrics-api-new-connections 4.20 4.20 amd64 ovn aws ha 227 0s 0.00% 3.96s 6500.00%
metrics-api-new-connections 4.20 4.20 amd64 ovn gcp ha 487 1s 0.00% 4s 300.00%
metrics-api-new-connections 4.20 4.20 amd64 ovn azure ha 158 0s 0.00% 3.15s 303.85%
oauth-api-new-connections 4.20 4.20 amd64 ovn gcp ha 487 1s 0.00% 4s 300.00%
ingress-to-console-new-connections 4.20 4.20 amd64 ovn aws ha 227 2s 0.00% 5.74s 41.38%
kube-api-reused-connections 4.20 4.19 amd64 ovn aws ha 583 0s 0.00% 1s 150.00%
ingress-to-console-reused-connections 4.20 amd64 ovn aws external 173 1.2s 0.00% 12.52s 128.05%
cache-oauth-api-new-connections 4.20 4.20 amd64 ovn gcp ha 487 1s 0.00% 4.14s 314.00%
cache-openshift-api-new-connections 4.20 4.20 amd64 ovn gcp ha 487 1s 0.00% 3.14s 214.00%
openshift-api-new-connections 4.20 4.19 amd64 ovn aws ha 583 0s 0.00% 7.36s 75.24%
oauth-api-reused-connections 4.20 4.19 amd64 ovn azure ha 710 6s 0.00% 12s 50.00%
image-registry-new-connections 4.20 amd64 ovn aws ha 138 0s 0.00% 12s 631.71%
host-to-host-new-connections 4.20 4.19 amd64 ovn gcp ha 315 0s 0.00% 860ms 177.42%
ci-cluster-network-liveness-new-connections 4.20 4.19 amd64 ovn azure ha 710 0s 0.00% 2.91s 45.50%
ingress-to-console-new-connections 4.20 amd64 ovn aws external 173 1.2s 0.00% 12.8s 133.15%
ingress-to-console-new-connections 4.20 4.20 amd64 ovn azure ha 158 0s 0.00% 9.15s 1073.08%

alerts Information

There were (4486) added jobs and (2116) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 97 jobs increased and 398 jobs decreased.

Click To Show Table
Name Release From Arch Network Platform Topology Job Results P95 P95 % Increase P99 P99 % Increase
KubeDeploymentReplicasMismatch openshift-console Warning 4.19 4.19 amd64 ovn aws ha 108 34m12.2s 495.70% 1h20m54.5s 56.73%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn gcp ha 255 25m4.4s 224.22% 33m6.32s 152.33%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn gcp ha 255 14m33s 475.86% 50m55.64s 606.80%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn gcp ha 255 12m58s 923.68% 16m11.8s 200.68%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.20 4.19 amd64 ovn aws ha 160 11m56s 302.70% 22m15.2s 309.57%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.18 amd64 ovn aws ha 161 10m28s 252.81% 19m48s 277.62%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn aws ha 127 9m19s 406.34% 14m47.68s 201.11%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.19 amd64 ovn aws ha 108 11m26s 112.38% 17m13.36s 84.63%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn aws ha 127 4m28s 857.14% 5m48.72s 100.88%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.19 amd64 ovn gcp ha 276 5m28s 196.83% 9m49s 119.78%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.19 amd64 ovn aws ha 108 3m26s 635.71% 4m23.9s 355.00%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 4.19 amd64 ovn gcp ha 276 5m26s 37.26% 8m3.5s 41.17%
KubeletPlegDurationHigh kube-system Warning 4.19 amd64 ovn gcp ha 255 4m28s 45.65% 6m41.8s 35.93%
NodeSystemSaturation openshift-monitoring Warning 4.19 4.19 amd64 ovn gcp ha 276 2m35.5s 77.71% 13m35s 291.83%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn metal ha 214 2m37.8s 63.19% 10m34.76s 116.69%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn metal ha 214 2m24.7s 59.89% 21m53.58s 128.66%
KubeDeploymentReplicasMismatch openshift-console Warning 4.19 amd64 ovn aws ha 127 0s 0.00% 1h53m55.92s 126.27%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn azure ha 157 28s 0.00% 2m10.32s 4554.29%
ExtremelyHighIndividualControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn metal ha 214 0s 0.00% 12m48.2s 549.37%
etcdHighCommitDurations openshift-etcd Warning 4.19 4.18 amd64 ovn azure ha 264 1m28s 0.00% 13m12.4s 106.46%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn vsphere ha 166 21s 0.00% 14m41.5s 350.43%
SystemMemoryExceedsReservation openshift-machine-config-operator Warning 4.19 amd64 ovn aws ha 127 0s 0.00% 10m13.4s 90.45%
KubeDeploymentRolloutStuck openshift-console Warning 4.19 amd64 ovn aws ha 127 0s 0.00% 1h46m42.32s 120.70%
HighOverallControlPlaneCPU openshift-kube-apiserver Warning 4.19 amd64 ovn vsphere ha 166 0s 0.00% 1m38.5s 124.37%
NodeClockNotSynchronising openshift-monitoring Critical 4.19 amd64 ovn metal ha 214 0s 0.00% 4h50m51.8s 183.45%
NodeSystemSaturation openshift-monitoring Warning 4.19 4.18 amd64 ovn azure ha 264 0s 0.00% 1m0.56s 116.29%
NodeSystemSaturation openshift-monitoring Warning 4.19 4.19 amd64 ovn aws ha 108 2m25s 0.00% 13m11.2s 31.19%
KubeletPlegDurationHigh kube-system Warning 4.19 amd64 ovn azure ha 157 40s 0.00% 4m37.6s 87.57%
NodeSystemSaturation openshift-monitoring Warning 4.19 amd64 ovn aws ha 127 1m35s 0.00% 4m20.8s 359.15%
KubeletPlegDurationHigh kube-system Warning 4.20 4.19 amd64 ovn azure ha 266 0s 0.00% 2m38.5s 132.40%
NodeSystemSaturation openshift-monitoring Warning 4.20 4.19 amd64 ovn azure ha 266 0s 0.00% 1m8.5s 144.64%
NodeSystemSaturation openshift-monitoring Warning 4.20 4.19 amd64 ovn aws ha 160 5m0.6s 0.00% 19m31.68s 377.85%
etcdHighCommitDurations openshift-etcd Warning 4.20 4.19 amd64 ovn azure ha 266 2m57.5s 0.00% 23m52.1s 194.55%
/cc @dgoodwin, @neisw, @DennisPeriquet

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci bot requested review from p0lyn0mial and sjenning April 25, 2025 01:04
@openshift-bot openshift-bot force-pushed the no-issue--automated---update-synthetic-test-data branch from f772356 to 02436c5 Compare May 2, 2025 01:03
Copy link

openshift-trt bot commented May 2, 2025

Job Failure Risk Analysis for sha: 02436c5

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-aws-disruptive Medium
[sig-arch] events should not repeat pathologically for ns/openshift-kube-apiserver-operator
Potential external regression detected for High Risk Test analysis
---
[sig-node] static pods should start after being created
Potential external regression detected for High Risk Test analysis
---
[bz-openshift-apiserver] clusteroperator/openshift-apiserver should not change condition/Available
This test has passed 97.44% of 3165 runs on release 4.20 [Overall] in the last week.

Open Bugs
CI: API is broken in periodic-ci-openshift-release-master-nightly-4.19-e2e-aws-ovn-single-node-techpreview-serial
pull-ci-openshift-origin-main-e2e-gcp-disruptive Medium
[bz-Etcd] clusteroperator/etcd should not change condition/Available
Potential external regression detected for High Risk Test analysis
---
[sig-node] static pods should start after being created
Potential external regression detected for High Risk Test analysis
pull-ci-openshift-origin-main-e2e-gcp-ovn-etcd-scaling Low
[bz-kube-storage-version-migrator] clusteroperator/kube-storage-version-migrator should not change condition/Available
This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:gcp SecurityMode:default Topology:ha Upgrade:none] in the last week.

Open Bugs
[CI] e2e-openstack-ovn-etcd-scaling job permanent fails at many openshift-test tests
etcd-scaling jobs failing ~60% of the time
---
[bz-Cloud Compute] clusteroperator/control-plane-machine-set should not change condition/Degraded
This test has passed 0.00% of 1 runs on release 4.20 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:rare Network:ovn NetworkStack:ipv4 Owner:eng Platform:gcp SecurityMode:default Topology:ha Upgrade:none] in the last week.

Open Bugs
etcd-scaling jobs failing ~60% of the time

@openshift-bot openshift-bot force-pushed the no-issue--automated---update-synthetic-test-data branch from 02436c5 to c7c91df Compare May 9, 2025 01:03
@neisw
Copy link
Contributor

neisw commented May 12, 2025

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label May 12, 2025
Copy link
Contributor

openshift-ci bot commented May 12, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: neisw, openshift-bot

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label May 12, 2025
@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 21ad7e1 and 2 for PR HEAD c7c91df in total

Copy link

openshift-trt bot commented May 12, 2025

Job Failure Risk Analysis for sha: c7c91df

Job Name Failure Risk
pull-ci-openshift-origin-main-e2e-aws-disruptive Medium
[sig-node] static pods should start after being created
Potential external regression detected for High Risk Test analysis
pull-ci-openshift-origin-main-e2e-gcp-disruptive Medium
[sig-node] static pods should start after being created
Potential external regression detected for High Risk Test analysis
---
[bz-Etcd] clusteroperator/etcd should not change condition/Available
Potential external regression detected for High Risk Test analysis

Copy link
Contributor

openshift-ci bot commented May 13, 2025

@openshift-bot: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-aws-ovn-serial 02436c5 link true /test e2e-aws-ovn-serial
ci/prow/e2e-aws-ovn-etcd-scaling c7c91df link false /test e2e-aws-ovn-etcd-scaling
ci/prow/e2e-vsphere-ovn-dualstack-primaryv6 c7c91df link false /test e2e-vsphere-ovn-dualstack-primaryv6
ci/prow/e2e-gcp-disruptive c7c91df link false /test e2e-gcp-disruptive
ci/prow/e2e-vsphere-ovn-etcd-scaling c7c91df link false /test e2e-vsphere-ovn-etcd-scaling
ci/prow/e2e-aws-ovn-kube-apiserver-rollout c7c91df link false /test e2e-aws-ovn-kube-apiserver-rollout
ci/prow/okd-e2e-gcp c7c91df link false /test okd-e2e-gcp
ci/prow/okd-scos-e2e-aws-ovn c7c91df link false /test okd-scos-e2e-aws-ovn
ci/prow/e2e-aws-ovn-single-node-upgrade c7c91df link false /test e2e-aws-ovn-single-node-upgrade
ci/prow/e2e-aws-disruptive c7c91df link false /test e2e-aws-disruptive
ci/prow/e2e-gcp-ovn-etcd-scaling c7c91df link false /test e2e-gcp-ovn-etcd-scaling
ci/prow/e2e-gcp-fips-serial c7c91df link false /test e2e-gcp-fips-serial
ci/prow/4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback c7c91df link false /test 4.12-upgrade-from-stable-4.11-e2e-aws-ovn-upgrade-rollback
ci/prow/e2e-metal-ipi-serial c7c91df link false /test e2e-metal-ipi-serial
ci/prow/e2e-openstack-serial c7c91df link false /test e2e-openstack-serial
ci/prow/e2e-azure-ovn-etcd-scaling c7c91df link false /test e2e-azure-ovn-etcd-scaling

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 2e43993 and 1 for PR HEAD c7c91df in total

@openshift-merge-bot openshift-merge-bot bot merged commit 6e15b2c into openshift:main May 13, 2025
39 of 54 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants