Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update image to v1.25.2-k0s.0 start failed #6

Open
zengzhengrong opened this issue Nov 5, 2022 · 1 comment
Open

Update image to v1.25.2-k0s.0 start failed #6

zengzhengrong opened this issue Nov 5, 2022 · 1 comment

Comments

@zengzhengrong
Copy link
Owner 

kubectl.exe get pod -A
NAMESPACE     NAME                                                READY   STATUS              RESTARTS      AGE
kube-system   coredns-5d5b5b96f9-xnxkf                            0/1     Pending             0             21m
kube-system   konnectivity-agent-mzccl                            0/1     ContainerCreating   0             21m
kube-system   kube-proxy-8bsq7                                    1/1     Running             0             21m
kube-system   kube-router-dls5n                                   0/1     CrashLoopBackOff    6 (46s ago)   21m
kube-system   metrics-server-7c555fc57f-vbpwc                     0/1     Pending             0             21m

Container logs

time="2022-11-05 10:48:32" level=info msg="E1105 10:48:32.577276     148 kuberuntime_manager.go:772] \"CreatePodSandbox for pod failed\" err=\"rpc error: code = Unknown desc = failed to setup network for sandbox \\\"06042d2449076328ffd814f121b5406ad7ef263fce1d25cd1d8e68b7e97cc8d8\\\": plugin type=\\\"bridge\\\" name=\\\"kubernetes\\\" failed (add): no IP ranges specified\" pod=\"kube-system/konnectivity-agent-mzccl\"" component=kubelet
time="2022-11-05 10:48:32" level=info msg="E1105 10:48:32.577330     148 pod_workers.go:965] \"Error syncing pod, skipping\" err=\"failed to \\\"CreatePodSandbox\\\" for \\\"konnectivity-agent-mzccl_kube-system(d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6)\\\" with CreatePodSandboxError: \\\"Failed to create sandbox for pod \\\\\\\"konnectivity-agent-mzccl_kube-system(d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6)\\\\\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\\\\\"06042d2449076328ffd814f121b5406ad7ef263fce1d25cd1d8e68b7e97cc8d8\\\\\\\": plugin type=\\\\\\\"bridge\\\\\\\" name=\\\\\\\"kubernetes\\\\\\\" failed (add): no IP ranges specified\\\"\" pod=\"kube-system/konnectivity-agent-mzccl\" podUID=d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6" component=kubelet
time="2022-11-05 10:48:34" level=info msg="current cfg matches existing, not gonna do anything" component=coredns
time="2022-11-05 10:48:34" level=info msg="I1105 10:48:34.453210     148 scope.go:115] \"RemoveContainer\" containerID=\"3c439cefaa9735f79d41adc7aa81772c24551ff80ffc41004c100efd038773db\"" component=kubelet
time="2022-11-05 10:48:34" level=info msg="time=\"2022-11-05T10:48:34.463019200+08:00\" level=info msg=\"CreateContainer within sandbox \\\"958b9f54fd758cf4e3279e24fce1f0440e9d1c73bbdd1555eb9bca0756e32100\\\" for container &ContainerMetadata{Name:kube-router,Attempt:7,}\"" component=containerd
time="2022-11-05 10:48:34" level=info msg="time=\"2022-11-05T10:48:34.504622900+08:00\" level=info msg=\"CreateContainer within sandbox \\\"958b9f54fd758cf4e3279e24fce1f0440e9d1c73bbdd1555eb9bca0756e32100\\\" for &ContainerMetadata{Name:kube-router,Attempt:7,} returns container id \\\"07d4d4e2ccab5743d47ff0dbcb68e3e3055798d6c84077874e4f1ba47d298665\\\"\"" component=containerd
time="2022-11-05 10:48:34" level=info msg="time=\"2022-11-05T10:48:34.506307100+08:00\" level=info msg=\"StartContainer for \\\"07d4d4e2ccab5743d47ff0dbcb68e3e3055798d6c84077874e4f1ba47d298665\\\"\"" component=containerd
time="2022-11-05 10:48:34" level=info msg="time=\"2022-11-05T10:48:34.701011500+08:00\" level=info msg=\"StartContainer for \\\"07d4d4e2ccab5743d47ff0dbcb68e3e3055798d6c84077874e4f1ba47d298665\\\" returns successfully\"" component=containerd
time="2022-11-05 10:48:36" level=info msg="I1105 10:48:36.029080     148 eviction_manager.go:340] \"Eviction manager: attempting to reclaim\" resourceName=\"ephemeral-storage\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="I1105 10:48:36.029155     148 container_gc.go:85] \"Attempting to delete unused containers\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="I1105 10:48:36.032106     148 image_gc_manager.go:327] \"Attempting to delete unused images\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="I1105 10:48:36.043172     148 eviction_manager.go:351] \"Eviction manager: must evict pod(s) to reclaim\" resourceName=\"ephemeral-storage\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="I1105 10:48:36.043367     148 eviction_manager.go:369] \"Eviction manager: pods ranked for eviction\" pods=[kube-system/konnectivity-agent-mzccl kube-system/kube-proxy-8bsq7 kube-system/kube-router-dls5n]" component=kubelet
time="2022-11-05 10:48:36" level=info msg="E1105 10:48:36.043408     148 eviction_manager.go:562] \"Eviction manager: cannot evict a critical pod\" pod=\"kube-system/konnectivity-agent-mzccl\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="E1105 10:48:36.043421     148 eviction_manager.go:562] \"Eviction manager: cannot evict a critical pod\" pod=\"kube-system/kube-proxy-8bsq7\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="E1105 10:48:36.043428     148 eviction_manager.go:562] \"Eviction manager: cannot evict a critical pod\" pod=\"kube-system/kube-router-dls5n\"" component=kubelet
time="2022-11-05 10:48:36" level=info msg="I1105 10:48:36.043438     148 eviction_manager.go:392] \"Eviction manager: unable to evict any pods from the node\"" component=kubelet
time="2022-11-05 10:48:44" level=info msg="current cfg matches existing, not gonna do anything" component=coredns
time="2022-11-05 10:48:44" level=info msg="E1105 10:48:44.207764     119 resource_quota_controller.go:417] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request" component=kube-controller-manager
time="2022-11-05 10:48:44" level=info msg="W1105 10:48:44.853300     119 garbagecollector.go:752] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]" component=kube-controller-manager
time="2022-11-05 10:48:46" level=info msg="I1105 10:48:46.054891     148 eviction_manager.go:340] \"Eviction manager: attempting to reclaim\" resourceName=\"ephemeral-storage\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="I1105 10:48:46.054952     148 container_gc.go:85] \"Attempting to delete unused containers\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="I1105 10:48:46.056367     148 image_gc_manager.go:327] \"Attempting to delete unused images\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="I1105 10:48:46.065537     148 eviction_manager.go:351] \"Eviction manager: must evict pod(s) to reclaim\" resourceName=\"ephemeral-storage\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="I1105 10:48:46.065594     148 eviction_manager.go:369] \"Eviction manager: pods ranked for eviction\" pods=[kube-system/konnectivity-agent-mzccl kube-system/kube-proxy-8bsq7 kube-system/kube-router-dls5n]" component=kubelet
time="2022-11-05 10:48:46" level=info msg="E1105 10:48:46.065608     148 eviction_manager.go:562] \"Eviction manager: cannot evict a critical pod\" pod=\"kube-system/konnectivity-agent-mzccl\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="E1105 10:48:46.065619     148 eviction_manager.go:562] \"Eviction manager: cannot evict a critical pod\" pod=\"kube-system/kube-proxy-8bsq7\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="E1105 10:48:46.065626     148 eviction_manager.go:562] \"Eviction manager: cannot evict a critical pod\" pod=\"kube-system/kube-router-dls5n\"" component=kubelet
time="2022-11-05 10:48:46" level=info msg="I1105 10:48:46.065633     148 eviction_manager.go:392] \"Eviction manager: unable to evict any pods from the node\"" component=kubelet
time="2022-11-05 10:48:47" level=info msg="time=\"2022-11-05T10:48:47.448896800+08:00\" level=info msg=\"RunPodSandbox for &PodSandboxMetadata{Name:konnectivity-agent-mzccl,Uid:d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6,Namespace:kube-system,Attempt:0,}\"" component=containerd
time="2022-11-05 10:48:47" level=info msg="time=\"2022-11-05T10:48:47.586968500+08:00\" level=error msg=\"Failed to destroy network for sandbox \\\"519890a5ea4ce5b613b86ea081a4a7fa371300a39e714f45af1c5d5391152f76\\\"\" error=\"plugin type=\\\"bridge\\\" name=\\\"kubernetes\\\" failed (delete): no IP ranges specified\"" component=containerd
time="2022-11-05 10:48:47" level=info msg="time=\"2022-11-05T10:48:47.587433200+08:00\" level=error msg=\"RunPodSandbox for &PodSandboxMetadata{Name:konnectivity-agent-mzccl,Uid:d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6,Namespace:kube-system,Attempt:0,} failed, error\" error=\"failed to setup network for sandbox \\\"519890a5ea4ce5b613b86ea081a4a7fa371300a39e714f45af1c5d5391152f76\\\": plugin type=\\\"bridge\\\" name=\\\"kubernetes\\\" failed (add): no IP ranges specified\"" component=containerd
time="2022-11-05 10:48:47" level=info msg="E1105 10:48:47.588125     148 remote_runtime.go:222] \"RunPodSandbox from runtime service failed\" err=\"rpc error: code = Unknown desc = failed to setup network for sandbox \\\"519890a5ea4ce5b613b86ea081a4a7fa371300a39e714f45af1c5d5391152f76\\\": plugin type=\\\"bridge\\\" name=\\\"kubernetes\\\" failed (add): no IP ranges specified\"" component=kubelet
time="2022-11-05 10:48:47" level=info msg="E1105 10:48:47.588291     148 kuberuntime_sandbox.go:71] \"Failed to create sandbox for pod\" err=\"rpc error: code = Unknown desc = failed to setup network for sandbox \\\"519890a5ea4ce5b613b86ea081a4a7fa371300a39e714f45af1c5d5391152f76\\\": plugin type=\\\"bridge\\\" name=\\\"kubernetes\\\" failed (add): no IP ranges specified\" pod=\"kube-system/konnectivity-agent-mzccl\"" component=kubelet
time="2022-11-05 10:48:47" level=info msg="E1105 10:48:47.588343     148 kuberuntime_manager.go:772] \"CreatePodSandbox for pod failed\" err=\"rpc error: code = Unknown desc = failed to setup network for sandbox \\\"519890a5ea4ce5b613b86ea081a4a7fa371300a39e714f45af1c5d5391152f76\\\": plugin type=\\\"bridge\\\" name=\\\"kubernetes\\\" failed (add): no IP ranges specified\" pod=\"kube-system/konnectivity-agent-mzccl\"" component=kubelet
time="2022-11-05 10:48:47" level=info msg="E1105 10:48:47.588504     148 pod_workers.go:965] \"Error syncing pod, skipping\" err=\"failed to \\\"CreatePodSandbox\\\" for \\\"konnectivity-agent-mzccl_kube-system(d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6)\\\" with CreatePodSandboxError: \\\"Failed to create sandbox for pod \\\\\\\"konnectivity-agent-mzccl_kube-system(d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6)\\\\\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\\\\\"519890a5ea4ce5b613b86ea081a4a7fa371300a39e714f45af1c5d5391152f76\\\\\\\": plugin type=\\\\\\\"bridge\\\\\\\" name=\\\\\\\"kubernetes\\\\\\\" failed (add): no IP ranges specified\\\"\" pod=\"kube-system/konnectivity-agent-mzccl\" podUID=d63fb5d1-0dcf-4da2-8538-88bb4e08b8e6" component=kubelet

Describe Logs

kubectl.exe describe pod/konnectivity-agent-mzccl -n kube-system
Name:                 konnectivity-agent-mzccl
Namespace:            kube-system
Priority:             2000000000
Priority Class Name:  system-cluster-critical
Service Account:      konnectivity-agent
Node:                 k0s/172.17.0.4
Start Time:           Sat, 05 Nov 2022 10:22:57 +0800
Labels:               controller-revision-hash=655d6bbd94
                      k8s-app=konnectivity-agent
                      pod-template-generation=2
Annotations:          prometheus.io/port: 8093
                      prometheus.io/scrape: true
Status:               Pending
IP:
IPs:                  <none>
Controlled By:        DaemonSet/konnectivity-agent
Containers:
  konnectivity-agent:
    Container ID:
    Image:         quay.io/k0sproject/apiserver-network-proxy-agent:0.0.32-k0s1
    Image ID:
    Port:          <none>
    Host Port:     <none>
    Command:
      /proxy-agent
    Args:
      --logtostderr=true
      --ca-cert=/var/run/secrets/kubernetes.io/serviceaccount/ca.crt
      --proxy-server-host=172.17.0.4
      --proxy-server-port=8132
      --service-account-token-path=/var/run/secrets/tokens/konnectivity-agent-token
      --agent-identifiers=host=$(NODE_IP)
      --agent-id=$(NODE_IP)
    State:          Waiting
      Reason:       ContainerCreating
    Ready:          False
    Restart Count:  0
    Liveness:       http-get http://:8093/healthz delay=15s timeout=15s period=10s #success=1 #failure=3
    Environment:
      K0S_CONTROLLER_COUNT:  1
      NODE_IP:                (v1:status.hostIP)
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-pfj26 (ro)
      /var/run/secrets/tokens from konnectivity-agent-token (rw)
Conditions:
  Type              Status
  Initialized       True
  Ready             False
  ContainersReady   False
  PodScheduled      True
Volumes:
  konnectivity-agent-token:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3600
  kube-api-access-pfj26:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              kubernetes.io/os=linux
Tolerations:                 op=Exists
                             node.kubernetes.io/disk-pressure:NoSchedule op=Exists
                             node.kubernetes.io/memory-pressure:NoSchedule op=Exists
                             node.kubernetes.io/not-ready:NoExecute op=Exists
                             node.kubernetes.io/pid-pressure:NoSchedule op=Exists
                             node.kubernetes.io/unreachable:NoExecute op=Exists
                             node.kubernetes.io/unschedulable:NoSchedule op=Exists
Events:
  Type     Reason                  Age                  From               Message
  ----     ------                  ----                 ----               -------
  Normal   Scheduled               21m                  default-scheduler  Successfully assigned kube-system/konnectivity-agent-mzccl to k0s
  Warning  NetworkNotReady         16m (x152 over 21m)  kubelet            network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized
  Warning  FailedCreatePodSandBox  97s (x43 over 11m)   kubelet            (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8a8b6b64db65338719983249dbad6d758e12441801743c753f273b46d9c180ba": plugin type="bridge" name="kubernetes" failed (add): no IP ranges specified
@zengzhengrong
Copy link
Owner Author

#k0sproject/k0s#2361

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@zengzhengrong