"http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.

Question

"http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.

thiagousa opened this issue 2 years ago · comments

Thiago Dos Santos commented 2 years ago

Hi All,

I am having the following problem on my servers.

Can somebody help me with it?

Thanks,

W1221 20:10:16.883570 15919 common.go:84] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta2". Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
W1221 20:10:16.890661 15919 common.go:84] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta2". Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
[init] Using Kubernetes version: v1.26.0
[preflight] Running pre-flight checks
[WARNING NumCPU]: the number of available CPUs 1 is less than the required 2
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/etc/kubernetes/pki"
[certs] Generating "ca" certificate and key
[certs] Generating "apiserver" certificate and key
[certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local node1] and IPs [10.96.0.1 10.0.0.11 129.213.97.29]
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost node1] and IPs [10.0.0.11 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost node1] and IPs [10.0.0.11 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[kubelet-check] Initial timeout of 40s passed.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.
[kubelet-check] It seems like the kubelet isn't running or healthy.
[kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.

Unfortunately, an error has occurred:
timed out waiting for the condition

This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

If you are on a systemd-powered system, you can try to troubleshoot the error with the following commands:
- 'systemctl status kubelet'
- 'journalctl -xeu kubelet'

Additionally, a control plane component may have crashed or exited when started by the container runtime.
To troubleshoot, list all containers using your preferred container runtimes CLI.
Here is one example how you may list all running Kubernetes containers by using crictl:
- 'crictl --runtime-endpoint unix:///var/run/containerd/containerd.sock ps -a | grep kube | grep -v pause'
Once you have found the failing container, you can inspect its logs with:
- 'crictl --runtime-endpoint unix:///var/run/containerd/containerd.sock logs CONTAINERID'
error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster
To see the stack trace of this error execute with --v=5 or higher
The connection to the server 10.0.0.11:6443 was refused - did you specify the right host or port?
Cloud-init v. 22.3.4-0ubuntu120.04.1 running 'modules:final' at Wed, 21 Dec 2022 20:08:46 +0000. Up 37.08 seconds.
Cloud-init v. 22.3.4-0ubuntu120.04.1 finished at Wed, 21 Dec 2022 20:12:39 +0000. Datasource DataSourceOracle. Up 270.79 seconds

k8s@node1:~$ systemctl status kubelet
● kubelet.service - kubelet: The Kubernetes Node Agent
Loaded: loaded (/lib/systemd/system/kubelet.service; enabled; vendor preset: enabled)
Drop-In: /etc/systemd/system/kubelet.service.d
└─10-kubeadm.conf
Active: activating (auto-restart) (Result: exit-code) since Wed 2022-12-21 20:22:00 UTC; 8s ago
Docs: https://kubernetes.io/docs/home/
Process: 16845 ExecStart=/usr/bin/kubelet $KUBELET_KUBECONFIG_ARGS $KUBELET_CONFIG_ARGS $KUBELET_KUBEADM_ARGS $KUBELET_EXTRA_ARGS (code=exited, status=1/FAILURE)
Main PID: 16845 (code=exited, status=1/FAILURE)

k8s@node1:~$ sudo journalctl -xeu kubelet
-- The job identifier is 9025.
Dec 21 20:23:12 node1 kubelet[16926]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.27. Image garbage collector will get sandbox image information from CRI.
Dec 21 20:23:12 node1 kubelet[16926]: I1221 20:23:12.544869 16926 server.go:198] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Dec 21 20:23:12 node1 kubelet[16926]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.27. Image garbage collector will get sandbox image information from CRI.
Dec 21 20:23:12 node1 kubelet[16926]: I1221 20:23:12.550799 16926 server.go:412] "Kubelet version" kubeletVersion="v1.26.0"
Dec 21 20:23:12 node1 kubelet[16926]: I1221 20:23:12.550949 16926 server.go:414] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Dec 21 20:23:12 node1 kubelet[16926]: I1221 20:23:12.551265 16926 server.go:836] "Client rotation is on, will bootstrap in background"
Dec 21 20:23:12 node1 kubelet[16926]: I1221 20:23:12.552838 16926 certificate_store.go:130] Loading cert/key pair from "/var/lib/kubelet/pki/kubelet-client-current.pem".
Dec 21 20:23:12 node1 kubelet[16926]: W1221 20:23:12.554953 16926 machine.go:65] Cannot read vendor id correctly, set empty.
Dec 21 20:23:12 node1 kubelet[16926]: I1221 20:23:12.555513 16926 server.go:659] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /"
Dec 21 20:23:12 node1 kubelet[16926]: I1221 20:23:12.555943 16926 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Dec 21 20:23:12 node1 kubelet[16926]: I1221 20:23:12.556133 16926 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: KubeletOOMScoreAdj:-999 ContainerRuntime: CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet Pro>
Dec 21 20:23:12 node1 kubelet[16926]: I1221 20:23:12.556287 16926 topology_manager.go:134] "Creating topology manager with policy per scope" topologyPolicyName="none" topologyScopeName="container"
Dec 21 20:23:12 node1 kubelet[16926]: I1221 20:23:12.556394 16926 container_manager_linux.go:308] "Creating device plugin manager"
Dec 21 20:23:12 node1 kubelet[16926]: I1221 20:23:12.556535 16926 state_mem.go:36] "Initialized new in-memory state store"
Dec 21 20:23:12 node1 kubelet[16926]: I1221 20:23:12.557091 16926 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/etc/kubernetes/pki/ca.crt"
Dec 21 20:23:12 node1 kubelet[16926]: E1221 20:23:12.559218 16926 run.go:74] "command failed" err="failed to run Kubelet: validate service connection: CRI v1 runtime API is not implemented for endpoint "unix:///var/run/containerd/containerd.sock": rpc error: code = Unimplemented desc = unknown service runtime.v1.RuntimeService"
Dec 21 20:23:12 node1 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE
-- Subject: Unit process exited
-- Defined-By: systemd
-- Support: http://www.ubuntu.com/support

-- An ExecStart= process belonging to unit kubelet.service has exited.

-- The process' exit code is 'exited' and its exit status is 1.
Dec 21 20:23:12 node1 systemd[1]: kubelet.service: Failed with result 'exit-code'.
-- Subject: Unit failed
-- Defined-By: systemd
-- Support: http://www.ubuntu.com/support

-- The unit kubelet.service has entered the 'failed' state with result 'exit-code'.

JandersonFB · Answer 1 · Thu Dec 22 2022 06:50:30 GMT+0800 (China Standard Time)

Same error :'(

Jérôme Petazzoni · Answer 2 · Thu Dec 22 2022 09:39:48 GMT+0800 (China Standard Time)

Hi! Please try again with the latest version (make sure to git pull!) as I just pushed a bunch of updates that should improve the process a lot.

Also, now Terraform will show the cloud-init progress; I hope it will give a better idea about what's going on, especially in case of problems!

Thiago Dos Santos · Answer 3 · Thu Dec 22 2022 23:34:39 GMT+0800 (China Standard Time)

Hi @jpetazzo, I am having the same problem now.

Maybe it is the problem.

run-parts: executing /usr/share/netfilter-persistent/plugins.d/15-ip4tables flush
iptables: Bad built-in chain name.
iptables: Bad built-in chain name.
iptables: Bad built-in chain name.
iptables: Bad built-in chain name.
iptables: Bad built-in chain name.
iptables: Bad built-in chain name.
run-parts: executing /usr/share/netfilter-persistent/plugins.d/25-ip6tables flush
run-parts: executing /usr/share/netfilter-persistent/plugins.d/15-ip4tables start
run-parts: executing /usr/share/netfilter-persistent/plugins.d/25-ip6tables start

Thanks for your help.

To follow the output.

cat /var/log/cloud-init-output.log

Cloud-init v. 22.3.4-0ubuntu122.04.1 running 'init-local' at Thu, 22 Dec 2022 15:06:37 +0000. Up 16.26 seconds.
Cloud-init v. 22.3.4-0ubuntu122.04.1 running 'init' at Thu, 22 Dec 2022 15:06:39 +0000. Up 17.85 seconds.
ci-info: ++++++++++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++++++++++
ci-info: +--------+------+-------------------------+---------------+--------+-------------------+
ci-info: | Device | Up | Address | Mask | Scope | Hw-Address |
ci-info: +--------+------+-------------------------+---------------+--------+-------------------+
ci-info: | enp0s3 | True | 10.0.0.11 | 255.255.255.0 | global | 02:00:17:0b:73:72 |
ci-info: | enp0s3 | True | fe80::17ff:fe0b:7372/64 | . | link | 02:00:17:0b:73:72 |
ci-info: | lo | True | 127.0.0.1 | 255.0.0.0 | host | . |
ci-info: | lo | True | ::1/128 | . | host | . |
ci-info: +--------+------+-------------------------+---------------+--------+-------------------+
ci-info: ++++++++++++++++++++++++++++++Route IPv4 info+++++++++++++++++++++++++++++++
ci-info: +-------+-----------------+----------+-----------------+-----------+-------+
ci-info: | Route | Destination | Gateway | Genmask | Interface | Flags |
ci-info: +-------+-----------------+----------+-----------------+-----------+-------+
ci-info: | 0 | 0.0.0.0 | 10.0.0.1 | 0.0.0.0 | enp0s3 | UG |
ci-info: | 1 | 10.0.0.0 | 0.0.0.0 | 255.255.255.0 | enp0s3 | U |
ci-info: | 2 | 10.0.0.1 | 0.0.0.0 | 255.255.255.255 | enp0s3 | UH |
ci-info: | 3 | 169.254.169.254 | 10.0.0.1 | 255.255.255.255 | enp0s3 | UGH |
ci-info: +-------+-----------------+----------+-----------------+-----------+-------+
ci-info: +++++++++++++++++++Route IPv6 info+++++++++++++++++++
ci-info: +-------+-------------+---------+-----------+-------+
ci-info: | Route | Destination | Gateway | Interface | Flags |
ci-info: +-------+-------------+---------+-----------+-------+
ci-info: | 1 | fe80::/64 | :: | enp0s3 | U |
ci-info: | 3 | local | :: | enp0s3 | U |
ci-info: | 4 | multicast | :: | enp0s3 | U |
ci-info: +-------+-------------+---------+-----------+-------+
2022-12-22 15:06:39,628 - schema.py[WARNING]: Invalid cloud-config provided: Please run 'sudo cloud-init schema --system' to see the schema errors.
Generating public/private rsa key pair.
Your identification has been saved in /etc/ssh/ssh_host_rsa_key
Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub
The key fingerprint is:
SHA256:zZTzdqKx9pMvqaYgO3ddO6PISfT6Y/N7VDIQ1sJrtok root@node1
The key's randomart image is:
+---[RSA 3072]----+
| .oo |
| o+ . |
| + + |
| + o+ o .|
| S +++o.+ |
| . .E=+o. |
| . . ..=. = |
| .o.+.=.O . |
| .o .=++O. |
+----[SHA256]-----+
Generating public/private dsa key pair.
Your identification has been saved in /etc/ssh/ssh_host_dsa_key
Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub
The key fingerprint is:
SHA256:ZE1KwJjiqHa0KxHuR5iEGzsM12ScRks2hHe/NmJCXFA root@node1
The key's randomart image is:
+---[DSA 1024]----+
| =BBE.. . |
| ooXo+. + |
|.o O.o .+ . |
|=oo.+ o. |
|==.. S. |
|=B +. o + |
|o.+ .o o . |
| o o |
| o |
+----[SHA256]-----+
Generating public/private ecdsa key pair.
Your identification has been saved in /etc/ssh/ssh_host_ecdsa_key
Your public key has been saved in /etc/ssh/ssh_host_ecdsa_key.pub
The key fingerprint is:
SHA256:xXwtf+Dkunlab3HHUFxUkRTjbpohC03Q6WKyV8zdB/w root@node1
The key's randomart image is:
+---[ECDSA 256]---+
| .. ...BX|
| o.o .+.+|
| B.+ == |
| . +o* BooE|
| S.oo .+=o|
| . .. o.=o+|
| . ..o. +|
| +...|
| +o ..|
+----[SHA256]-----+
Generating public/private ed25519 key pair.
Your identification has been saved in /etc/ssh/ssh_host_ed25519_key
Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub
The key fingerprint is:
SHA256:5so48js06n8Nidk2p6rJPwhwlrh4I53+kfimc81ONss root@node1
The key's randomart image is:
+--[ED25519 256]--+
| |
| |
| . . |
|o + |
|o= . + .S |
|= =.=.o. |
| =.=o=+. |
| .oB=+. |
| .*%XOE |
+----[SHA256]-----+
Cloud-init v. 22.3.4-0ubuntu122.04.1 running 'modules:config' at Thu, 22 Dec 2022 15:06:51 +0000. Up 29.93 seconds.
Get:1 https://download.docker.com/linux/ubuntu jammy InRelease [48.9 kB]
Get:3 http://ports.ubuntu.com/ubuntu-ports jammy-security InRelease [110 kB]
Hit:4 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy InRelease
Get:2 https://packages.cloud.google.com/apt kubernetes-xenial InRelease [9383 B]
Get:5 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates InRelease [114 kB]
Get:6 https://download.docker.com/linux/ubuntu jammy/stable arm64 Packages [10.5 kB]
Get:7 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-backports InRelease [99.8 kB]
Get:8 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/universe arm64 Packages [13.9 MB]
Ign:9 https://packages.cloud.google.com/apt kubernetes-xenial/main arm64 Packages
Get:9 https://apt.kubernetes.io kubernetes-xenial/main arm64 Packages [60.8 kB]
Get:10 http://ports.ubuntu.com/ubuntu-ports jammy-security/main arm64 Packages [475 kB]
Get:11 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/universe Translation-en [5652 kB]
Get:12 http://ports.ubuntu.com/ubuntu-ports jammy-security/main Translation-en [114 kB]
Get:13 http://ports.ubuntu.com/ubuntu-ports jammy-security/main arm64 c-n-f Metadata [7092 B]
Get:14 http://ports.ubuntu.com/ubuntu-ports jammy-security/restricted arm64 Packages [192 kB]
Get:15 http://ports.ubuntu.com/ubuntu-ports jammy-security/restricted Translation-en [70.5 kB]
Get:16 http://ports.ubuntu.com/ubuntu-ports jammy-security/restricted arm64 c-n-f Metadata [412 B]
Get:17 http://ports.ubuntu.com/ubuntu-ports jammy-security/universe arm64 Packages [517 kB]
Get:18 http://ports.ubuntu.com/ubuntu-ports jammy-security/universe Translation-en [82.9 kB]
Get:19 http://ports.ubuntu.com/ubuntu-ports jammy-security/universe arm64 c-n-f Metadata [8268 B]
Get:20 http://ports.ubuntu.com/ubuntu-ports jammy-security/multiverse Translation-en [972 B]
Get:21 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/universe arm64 c-n-f Metadata [277 kB]
Get:22 http://ports.ubuntu.com/ubuntu-ports jammy-security/multiverse arm64 c-n-f Metadata [116 B]
Get:23 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/multiverse arm64 Packages [184 kB]
Get:24 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/multiverse Translation-en [112 kB]
Get:25 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/multiverse arm64 c-n-f Metadata [7064 B]
Get:26 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 Packages [705 kB]
Get:27 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main Translation-en [172 kB]
Get:28 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 c-n-f Metadata [11.3 kB]
Get:29 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/restricted arm64 Packages [203 kB]
Get:30 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/restricted Translation-en [76.3 kB]
Get:31 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/restricted arm64 c-n-f Metadata [412 B]
Get:32 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/universe arm64 Packages [661 kB]
Get:33 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/universe Translation-en [130 kB]
Get:34 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/universe arm64 c-n-f Metadata [11.4 kB]
Get:35 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/multiverse arm64 Packages [2280 B]
Get:36 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/multiverse Translation-en [2432 B]
Get:37 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/multiverse arm64 c-n-f Metadata [116 B]
Get:38 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-backports/main arm64 Packages [3324 B]
Get:39 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-backports/main Translation-en [1580 B]
Get:40 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-backports/main arm64 c-n-f Metadata [272 B]
Get:41 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-backports/restricted arm64 c-n-f Metadata [116 B]
Get:42 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-backports/universe arm64 Packages [6736 B]
Get:43 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-backports/universe Translation-en [9460 B]
Get:44 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-backports/universe arm64 c-n-f Metadata [352 B]
Get:45 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-backports/multiverse arm64 c-n-f Metadata [116 B]
Fetched 24.0 MB in 6s (4019 kB/s)
Reading package lists...
Cloud-init v. 22.3.4-0ubuntu122.04.1 running 'modules:final' at Thu, 22 Dec 2022 15:07:03 +0000. Up 41.91 seconds.
Reading package lists...
Building dependency tree...
Reading state information...
lsb-release is already the newest version (11.1.0ubuntu4).
lsb-release set to manually installed.
curl is already the newest version (7.81.0-1ubuntu1.6).
curl set to manually installed.
software-properties-common is already the newest version (0.99.22.3).
software-properties-common set to manually installed.
The following additional packages will be installed:
bzip2 conntrack cpp cpp-11 cri-tools docker-ce-cli docker-ce-rootless-extras
dpkg-dev ebtables fakeroot fontconfig-config fonts-dejavu-core g++ g++-11
gcc gcc-11 gcc-11-base javascript-common kubectl kubernetes-cni
libalgorithm-diff-perl libalgorithm-diff-xs-perl libalgorithm-merge-perl
libasan6 libatomic1 libc-dev-bin libc-devtools libc6-dev libcc1-0
libcrypt-dev libdeflate0 libdpkg-perl libexpat1 libexpat1-dev libfakeroot
libfile-fcntllock-perl libfontconfig1 libgcc-11-dev libgd3 libgomp1
libhwasan0 libio-pty-perl libipc-run-perl libisl23 libitm1 libjbig0
libjpeg-turbo8 libjpeg8 libjq1 libjs-jquery libjs-sphinxdoc libjs-underscore
liblsan0 libltdl7 libmpc3 libnsl-dev libonig5 libpython3-dev libpython3.10
libpython3.10-dev libpython3.10-minimal libpython3.10-stdlib libslirp0
libstdc++-11-dev libtiff5 libtime-duration-perl libtimedate-perl
libtirpc-dev libtsan0 libubsan1 libwebp7 libxpm4 linux-libc-dev
lto-disabled-list manpages-dev moreutils pigz
prometheus-node-exporter-collectors python3-dev python3-wheel python3.10
python3.10-dev python3.10-minimal rpcsvc-proto slirp4netns smartmontools
socat zlib1g-dev
Suggested packages:
bzip2-doc cpp-doc gcc-11-locales cgroupfs-mount | cgroup-lite debian-keyring
gcc-11-doc gcc-multilib autoconf automake libtool flex bison gdb gcc-doc
apache2 | lighttpd | httpd glibc-doc bzr libgd-tools libstdc++-11-doc
make-doc python3.10-venv python3.10-doc binfmt-support gsmartcontrol
smart-notifier mailx | mailutils zip
The following NEW packages will be installed:
apt-transport-https build-essential bzip2 conntrack containerd.io cpp cpp-11
cri-tools docker-ce docker-ce-cli docker-ce-rootless-extras dpkg-dev
ebtables fakeroot fontconfig-config fonts-dejavu-core g++ g++-11 gcc gcc-11
gcc-11-base javascript-common jq kubeadm kubectl kubelet kubernetes-cni
libalgorithm-diff-perl libalgorithm-diff-xs-perl libalgorithm-merge-perl
libasan6 libatomic1 libc-dev-bin libc-devtools libc6-dev libcc1-0
libcrypt-dev libdeflate0 libdpkg-perl libexpat1-dev libfakeroot
libfile-fcntllock-perl libfontconfig1 libgcc-11-dev libgd3 libgomp1
libhwasan0 libio-pty-perl libipc-run-perl libisl23 libitm1 libjbig0
libjpeg-turbo8 libjpeg8 libjq1 libjs-jquery libjs-sphinxdoc libjs-underscore
liblsan0 libltdl7 libmpc3 libnsl-dev libonig5 libpython3-dev
libpython3.10-dev libslirp0 libstdc++-11-dev libtiff5 libtime-duration-perl
libtimedate-perl libtirpc-dev libtsan0 libubsan1 libwebp7 libxpm4
linux-libc-dev lto-disabled-list make manpages-dev moreutils pigz
prometheus-node-exporter prometheus-node-exporter-collectors python3-dev
python3-pip python3-wheel python3.10-dev rpcsvc-proto slirp4netns
smartmontools socat tree unzip zlib1g-dev
The following packages will be upgraded:
ca-certificates libexpat1 libpython3.10 libpython3.10-minimal
libpython3.10-stdlib python3.10 python3.10-minimal tmux
8 upgraded, 94 newly installed, 0 to remove and 39 not upgraded.
Need to get 234 MB of archives.
After this operation, 892 MB of additional disk space will be used.
Get:1 https://download.docker.com/linux/ubuntu jammy/stable arm64 containerd.io arm64 1.6.14-1 [19.9 MB]
Get:6 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libexpat1 arm64 2.4.7-1ubuntu0.2 [76.8 kB]
Get:2 https://packages.cloud.google.com/apt kubernetes-xenial/main arm64 cri-tools arm64 1.25.0-00 [16.6 MB]
Get:8 https://download.docker.com/linux/ubuntu jammy/stable arm64 docker-ce-cli arm64 5:20.10.22~~3-0~~ubuntu-jammy [37.2 MB]
Get:9 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libpython3.10 arm64 3.10.6-122.04.2 [1892 kB]
Get:3 https://packages.cloud.google.com/apt kubernetes-xenial/main arm64 kubernetes-cni arm64 1.1.1-00 [23.1 MB]
Get:10 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 python3.10 arm64 3.10.6-122.04.2 [497 kB]
Get:11 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libpython3.10-stdlib arm64 3.10.6-122.04.2 [1828 kB]
Get:12 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 python3.10-minimal arm64 3.10.6-122.04.2 [2246 kB]
Get:13 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libpython3.10-minimal arm64 3.10.6-122.04.2 [807 kB]
Get:14 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/universe arm64 pigz arm64 2.6-1 [55.7 kB]
Get:15 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/universe arm64 prometheus-node-exporter arm64 1.3.1-1 [3335 kB]
Get:16 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 ca-certificates all 20211016ubuntu0.22.04.1 [144 kB]
Get:17 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/universe arm64 apt-transport-https all 2.4.8 [1506 B]
Get:18 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libc-dev-bin arm64 2.35-0ubuntu3.1 [19.6 kB]
Get:19 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 linux-libc-dev arm64 5.15.0-56.62 [1309 kB]
Get:20 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libcrypt-dev arm64 1:4.4.27-1 [119 kB]
Get:4 https://packages.cloud.google.com/apt kubernetes-xenial/main arm64 kubelet arm64 1.26.0-00 [17.8 MB]
Get:21 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 rpcsvc-proto arm64 1.4.2-0ubuntu6 [65.4 kB]
Get:22 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libtirpc-dev arm64 1.3.2-2ubuntu0.1 [199 kB]
Get:23 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libnsl-dev arm64 1.3.0-2build2 [72.1 kB]
Get:24 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libc6-dev arm64 2.35-0ubuntu3.1 [1544 kB]
Get:25 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 gcc-11-base arm64 11.3.0-1ubuntu122.04 [20.8 kB]
Get:26 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libisl23 arm64 0.24-2build1 [689 kB]
Get:27 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libmpc3 arm64 1.2.1-2build1 [48.1 kB]
Get:28 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 cpp-11 arm64 11.3.0-1ubuntu122.04 [9709 kB]
Get:29 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 cpp arm64 4:11.2.0-1ubuntu1 [27.7 kB]
Get:30 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libcc1-0 arm64 12.1.0-2ubuntu122.04 [45.0 kB]
Get:31 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libgomp1 arm64 12.1.0-2ubuntu122.04 [124 kB]
Get:32 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libitm1 arm64 12.1.0-2ubuntu122.04 [28.4 kB]
Get:5 https://packages.cloud.google.com/apt kubernetes-xenial/main arm64 kubectl arm64 1.26.0-00 [8625 kB]
Get:33 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libatomic1 arm64 12.1.0-2ubuntu122.04 [10.8 kB]
Get:34 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libasan6 arm64 11.3.0-1ubuntu122.04 [2227 kB]
Get:35 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 liblsan0 arm64 12.1.0-2ubuntu122.04 [1034 kB]
Get:36 https://download.docker.com/linux/ubuntu jammy/stable arm64 docker-ce arm64 5:20.10.223-0ubuntu-jammy [12.7 MB]
Get:37 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libtsan0 arm64 11.3.0-1ubuntu122.04 [2235 kB]
Get:7 https://packages.cloud.google.com/apt kubernetes-xenial/main arm64 kubeadm arm64 1.26.0-00 [8348 kB]
Get:38 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libubsan1 arm64 12.1.0-2ubuntu122.04 [965 kB]
Get:39 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libhwasan0 arm64 12.1.0-2ubuntu122.04 [1119 kB]
Get:40 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libgcc-11-dev arm64 11.3.0-1ubuntu122.04 [1151 kB]
Get:41 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 gcc-11 arm64 11.3.0-1ubuntu122.04 [19.4 MB]
Get:42 https://download.docker.com/linux/ubuntu jammy/stable arm64 docker-ce-rootless-extras arm64 5:20.10.22~~3-0~~ubuntu-jammy [7569 kB]
Get:43 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 gcc arm64 4:11.2.0-1ubuntu1 [5128 B]
Get:44 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libstdc++-11-dev arm64 11.3.0-1ubuntu122.04 [2075 kB]
Get:45 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 g++-11 arm64 11.3.0-1ubuntu122.04 [11.1 MB]
Get:46 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 g++ arm64 4:11.2.0-1ubuntu1 [1394 B]
Get:47 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 make arm64 4.3-4.1build1 [177 kB]
Get:48 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libdpkg-perl all 1.21.1ubuntu2.1 [237 kB]
Get:49 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 bzip2 arm64 1.0.8-5build1 [34.6 kB]
Get:50 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 lto-disabled-list all 24 [12.5 kB]
Get:51 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 dpkg-dev all 1.21.1ubuntu2.1 [922 kB]
Get:52 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 build-essential arm64 12.9ubuntu3 [4740 B]
Get:53 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 conntrack arm64 1:1.4.6-2build2 [32.4 kB]
Get:54 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 ebtables arm64 2.0.11-4build2 [85.4 kB]
Get:55 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libfakeroot arm64 1.28-1ubuntu1 [31.5 kB]
Get:56 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 fakeroot arm64 1.28-1ubuntu1 [60.5 kB]
Get:57 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 fonts-dejavu-core all 2.37-2build1 [1041 kB]
Get:58 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 fontconfig-config all 2.13.1-4.2ubuntu5 [29.1 kB]
Get:59 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 javascript-common all 11+nmu1 [5936 B]
Get:60 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libonig5 arm64 6.9.7.1-2build1 [169 kB]
Get:61 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libjq1 arm64 1.6-2.1ubuntu3 [125 kB]
Get:62 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 jq arm64 1.6-2.1ubuntu3 [52.1 kB]
Get:63 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 socat arm64 1.7.4.1-3ubuntu4 [348 kB]
Get:64 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libalgorithm-diff-perl all 1.201-1 [41.8 kB]
Get:65 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libalgorithm-diff-xs-perl arm64 0.04-6build3 [11.7 kB]
Get:66 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libalgorithm-merge-perl all 0.08-3 [12.0 kB]
Get:67 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libfontconfig1 arm64 2.13.1-4.2ubuntu5 [135 kB]
Get:68 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libjpeg-turbo8 arm64 2.1.2-0ubuntu1 [129 kB]
Get:69 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libjpeg8 arm64 8c-2ubuntu10 [2264 B]
Get:70 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libdeflate0 arm64 1.10-2 [69.1 kB]
Get:71 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libjbig0 arm64 2.1-3.1ubuntu0.22.04.1 [29.1 kB]
Get:72 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libwebp7 arm64 1.2.2-2 [192 kB]
Get:73 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libtiff5 arm64 4.3.0-6ubuntu0.3 [180 kB]
Get:74 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libxpm4 arm64 1:3.5.12-1build2 [35.0 kB]
Get:75 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libgd3 arm64 2.3.0-2ubuntu2 [126 kB]
Get:76 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libc-devtools arm64 2.35-0ubuntu3.1 [27.6 kB]
Get:77 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libexpat1-dev arm64 2.4.7-1ubuntu0.2 [129 kB]
Get:78 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libfile-fcntllock-perl arm64 0.22-3build7 [33.7 kB]
Get:79 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libio-pty-perl arm64 1:1.15-2build2 [34.6 kB]
Get:80 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libipc-run-perl all 20200505.0-1 [89.8 kB]
Get:81 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libjs-jquery all 3.6.0+dfsg+3.5.13-1 [321 kB]
Get:82 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libjs-underscore all 1.13.2dfsg-2 [118 kB]
Get:83 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libjs-sphinxdoc all 4.3.2-1 [139 kB]
Get:84 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libltdl7 arm64 2.4.6-15build2 [39.5 kB]
Get:85 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 zlib1g-dev arm64 1:1.2.11.dfsg-2ubuntu9.2 [163 kB]
Get:86 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libpython3.10-dev arm64 3.10.6-122.04.2 [4662 kB]
Get:87 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 libpython3-dev arm64 3.10.6-122.04 [7168 B]
Get:88 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libslirp0 arm64 4.6.1-1build1 [60.8 kB]
Get:89 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libtime-duration-perl all 1.21-1 [13.1 kB]
Get:90 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 libtimedate-perl all 2.3300-2 [34.0 kB]
Get:91 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 manpages-dev all 5.10-1ubuntu1 [2309 kB]
Get:92 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/universe arm64 moreutils arm64 0.66-1 [62.6 kB]
Get:93 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/universe arm64 prometheus-node-exporter-collectors all 0+git20211024.8eeeffb-1 [27.1 kB]
Get:94 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 python3.10-dev arm64 3.10.6-122.04.2 [507 kB]
Get:95 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 python3-dev arm64 3.10.6-122.04 [26.0 kB]
Get:96 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/universe arm64 python3-wheel all 0.37.1-2 [31.9 kB]
Get:97 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/universe arm64 python3-pip all 22.0.2+dfsg-1 [1306 kB]
Get:98 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/universe arm64 slirp4netns arm64 1.0.1-2 [27.0 kB]
Get:99 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/main arm64 smartmontools arm64 7.2-1build2 [570 kB]
Get:100 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 tmux arm64 3.2a-4ubuntu0.1 [418 kB]
Get:101 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy/universe arm64 tree arm64 2.0.2-1 [47.2 kB]
Get:102 http://iad-ad-2.clouds.ports.ubuntu.com/ubuntu-ports jammy-updates/main arm64 unzip arm64 6.0-26ubuntu3.1 [171 kB]
Preconfiguring packages ...
Fetched 234 MB in 6s (40.6 MB/s)
(Reading database ... 65806 files and directories currently installed.)
Preparing to unpack .../000-libexpat1_2.4.7-1ubuntu0.2_arm64.deb ...
Unpacking libexpat1:arm64 (2.4.7-1ubuntu0.2) over (2.4.7-1) ...
Preparing to unpack .../001-libpython3.10_3.10.6-122.04.2_arm64.deb ...
Unpacking libpython3.10:arm64 (3.10.6-122.04.2) over (3.10.6-122.04.1) ...
Preparing to unpack .../002-python3.10_3.10.6-122.04.2_arm64.deb ...
Unpacking python3.10 (3.10.6-1~~22.04.2) over (3.10.6-1~~22.04.1) ...
Preparing to unpack .../003-libpython3.10-stdlib_3.10.6-122.04.2_arm64.deb ...
Unpacking libpython3.10-stdlib:arm64 (3.10.6-122.04.2) over (3.10.6-122.04.1) ...
Preparing to unpack .../004-python3.10-minimal_3.10.6-122.04.2_arm64.deb ...
Unpacking python3.10-minimal (3.10.6-1~~22.04.2) over (3.10.6-1~~22.04.1) ...
Preparing to unpack .../005-libpython3.10-minimal_3.10.6-122.04.2_arm64.deb ...
Unpacking libpython3.10-minimal:arm64 (3.10.6-122.04.2) over (3.10.6-122.04.1) ...
Selecting previously unselected package pigz.
Preparing to unpack .../006-pigz_2.6-1_arm64.deb ...
Unpacking pigz (2.6-1) ...
Selecting previously unselected package prometheus-node-exporter.
Preparing to unpack .../007-prometheus-node-exporter_1.3.1-1_arm64.deb ...
Unpacking prometheus-node-exporter (1.3.1-1) ...
Preparing to unpack .../008-ca-certificates_20211016ubuntu0.22.04.1_all.deb ...
Unpacking ca-certificates (20211016ubuntu0.22.04.1) over (20211016) ...
Selecting previously unselected package apt-transport-https.
Preparing to unpack .../009-apt-transport-https_2.4.8_all.deb ...
Unpacking apt-transport-https (2.4.8) ...
Selecting previously unselected package libc-dev-bin.
Preparing to unpack .../010-libc-dev-bin_2.35-0ubuntu3.1_arm64.deb ...
Unpacking libc-dev-bin (2.35-0ubuntu3.1) ...
Selecting previously unselected package linux-libc-dev:arm64.
Preparing to unpack .../011-linux-libc-dev_5.15.0-56.62_arm64.deb ...
Unpacking linux-libc-dev:arm64 (5.15.0-56.62) ...
Selecting previously unselected package libcrypt-dev:arm64.
Preparing to unpack .../012-libcrypt-dev_1%3a4.4.27-1_arm64.deb ...
Unpacking libcrypt-dev:arm64 (1:4.4.27-1) ...
Selecting previously unselected package rpcsvc-proto.
Preparing to unpack .../013-rpcsvc-proto_1.4.2-0ubuntu6_arm64.deb ...
Unpacking rpcsvc-proto (1.4.2-0ubuntu6) ...
Selecting previously unselected package libtirpc-dev:arm64.
Preparing to unpack .../014-libtirpc-dev_1.3.2-2ubuntu0.1_arm64.deb ...
Unpacking libtirpc-dev:arm64 (1.3.2-2ubuntu0.1) ...
Selecting previously unselected package libnsl-dev:arm64.
Preparing to unpack .../015-libnsl-dev_1.3.0-2build2_arm64.deb ...
Unpacking libnsl-dev:arm64 (1.3.0-2build2) ...
Selecting previously unselected package libc6-dev:arm64.
Preparing to unpack .../016-libc6-dev_2.35-0ubuntu3.1_arm64.deb ...
Unpacking libc6-dev:arm64 (2.35-0ubuntu3.1) ...
Selecting previously unselected package gcc-11-base:arm64.
Preparing to unpack .../017-gcc-11-base_11.3.0-1ubuntu122.04_arm64.deb ...
Unpacking gcc-11-base:arm64 (11.3.0-1ubuntu122.04) ...
Selecting previously unselected package libisl23:arm64.
Preparing to unpack .../018-libisl23_0.24-2build1_arm64.deb ...
Unpacking libisl23:arm64 (0.24-2build1) ...
Selecting previously unselected package libmpc3:arm64.
Preparing to unpack .../019-libmpc3_1.2.1-2build1_arm64.deb ...
Unpacking libmpc3:arm64 (1.2.1-2build1) ...
Selecting previously unselected package cpp-11.
Preparing to unpack .../020-cpp-11_11.3.0-1ubuntu122.04_arm64.deb ...
Unpacking cpp-11 (11.3.0-1ubuntu122.04) ...
Selecting previously unselected package cpp.
Preparing to unpack .../021-cpp_4%3a11.2.0-1ubuntu1_arm64.deb ...
Unpacking cpp (4:11.2.0-1ubuntu1) ...
Selecting previously unselected package libcc1-0:arm64.
Preparing to unpack .../022-libcc1-0_12.1.0-2ubuntu122.04_arm64.deb ...
Unpacking libcc1-0:arm64 (12.1.0-2ubuntu122.04) ...
Selecting previously unselected package libgomp1:arm64.
Preparing to unpack .../023-libgomp1_12.1.0-2ubuntu122.04_arm64.deb ...
Unpacking libgomp1:arm64 (12.1.0-2ubuntu122.04) ...
Selecting previously unselected package libitm1:arm64.
Preparing to unpack .../024-libitm1_12.1.0-2ubuntu122.04_arm64.deb ...
Unpacking libitm1:arm64 (12.1.0-2ubuntu122.04) ...
Selecting previously unselected package libatomic1:arm64.
Preparing to unpack .../025-libatomic1_12.1.0-2ubuntu122.04_arm64.deb ...
Unpacking libatomic1:arm64 (12.1.0-2ubuntu122.04) ...
Selecting previously unselected package libasan6:arm64.
Preparing to unpack .../026-libasan6_11.3.0-1ubuntu122.04_arm64.deb ...
Unpacking libasan6:arm64 (11.3.0-1ubuntu122.04) ...
Selecting previously unselected package liblsan0:arm64.
Preparing to unpack .../027-liblsan0_12.1.0-2ubuntu122.04_arm64.deb ...
Unpacking liblsan0:arm64 (12.1.0-2ubuntu122.04) ...
Selecting previously unselected package libtsan0:arm64.
Preparing to unpack .../028-libtsan0_11.3.0-1ubuntu122.04_arm64.deb ...
Unpacking libtsan0:arm64 (11.3.0-1ubuntu122.04) ...
Selecting previously unselected package libubsan1:arm64.
Preparing to unpack .../029-libubsan1_12.1.0-2ubuntu122.04_arm64.deb ...
Unpacking libubsan1:arm64 (12.1.0-2ubuntu122.04) ...
Selecting previously unselected package libhwasan0:arm64.
Preparing to unpack .../030-libhwasan0_12.1.0-2ubuntu122.04_arm64.deb ...
Unpacking libhwasan0:arm64 (12.1.0-2ubuntu122.04) ...
Selecting previously unselected package libgcc-11-dev:arm64.
Preparing to unpack .../031-libgcc-11-dev_11.3.0-1ubuntu122.04_arm64.deb ...
Unpacking libgcc-11-dev:arm64 (11.3.0-1ubuntu122.04) ...
Selecting previously unselected package gcc-11.
Preparing to unpack .../032-gcc-11_11.3.0-1ubuntu122.04_arm64.deb ...
Unpacking gcc-11 (11.3.0-1ubuntu122.04) ...
Selecting previously unselected package gcc.
Preparing to unpack .../033-gcc_4%3a11.2.0-1ubuntu1_arm64.deb ...
Unpacking gcc (4:11.2.0-1ubuntu1) ...
Selecting previously unselected package libstdc++-11-dev:arm64.
Preparing to unpack .../034-libstdc++-11-dev_11.3.0-1ubuntu122.04_arm64.deb ...
Unpacking libstdc++-11-dev:arm64 (11.3.0-1ubuntu122.04) ...
Selecting previously unselected package g++-11.
Preparing to unpack .../035-g++-11_11.3.0-1ubuntu122.04_arm64.deb ...
Unpacking g++-11 (11.3.0-1ubuntu122.04) ...
Selecting previously unselected package g++.
Preparing to unpack .../036-g++_4%3a11.2.0-1ubuntu1_arm64.deb ...
Unpacking g++ (4:11.2.0-1ubuntu1) ...
Selecting previously unselected package make.
Preparing to unpack .../037-make_4.3-4.1build1_arm64.deb ...
Unpacking make (4.3-4.1build1) ...
Selecting previously unselected package libdpkg-perl.
Preparing to unpack .../038-libdpkg-perl_1.21.1ubuntu2.1_all.deb ...
Unpacking libdpkg-perl (1.21.1ubuntu2.1) ...
Selecting previously unselected package bzip2.
Preparing to unpack .../039-bzip2_1.0.8-5build1_arm64.deb ...
Unpacking bzip2 (1.0.8-5build1) ...
Selecting previously unselected package lto-disabled-list.
Preparing to unpack .../040-lto-disabled-list_24_all.deb ...
Unpacking lto-disabled-list (24) ...
Selecting previously unselected package dpkg-dev.
Preparing to unpack .../041-dpkg-dev_1.21.1ubuntu2.1_all.deb ...
Unpacking dpkg-dev (1.21.1ubuntu2.1) ...
Selecting previously unselected package build-essential.
Preparing to unpack .../042-build-essential_12.9ubuntu3_arm64.deb ...
Unpacking build-essential (12.9ubuntu3) ...
Selecting previously unselected package conntrack.
Preparing to unpack .../043-conntrack_1%3a1.4.6-2build2_arm64.deb ...
Unpacking conntrack (1:1.4.6-2build2) ...
Selecting previously unselected package containerd.io.
Preparing to unpack .../044-containerd.io_1.6.14-1_arm64.deb ...
Unpacking containerd.io (1.6.14-1) ...
Selecting previously unselected package cri-tools.
Preparing to unpack .../045-cri-tools_1.25.0-00_arm64.deb ...
Unpacking cri-tools (1.25.0-00) ...
Selecting previously unselected package docker-ce-cli.
Preparing to unpack .../046-docker-ce-cli_5%3a20.10.223-0ubuntu-jammy_arm64.deb ...
Unpacking docker-ce-cli (5:20.10.223-0ubuntu-jammy) ...
Selecting previously unselected package docker-ce.
Preparing to unpack .../047-docker-ce_5%3a20.10.223-0ubuntu-jammy_arm64.deb ...
Unpacking docker-ce (5:20.10.223-0ubuntu-jammy) ...
Selecting previously unselected package docker-ce-rootless-extras.
Preparing to unpack .../048-docker-ce-rootless-extras_5%3a20.10.223-0ubuntu-jammy_arm64.deb ...
Unpacking docker-ce-rootless-extras (5:20.10.223-0ubuntu-jammy) ...
Selecting previously unselected package ebtables.
Preparing to unpack .../049-ebtables_2.0.11-4build2_arm64.deb ...
Unpacking ebtables (2.0.11-4build2) ...
Selecting previously unselected package libfakeroot:arm64.
Preparing to unpack .../050-libfakeroot_1.28-1ubuntu1_arm64.deb ...
Unpacking libfakeroot:arm64 (1.28-1ubuntu1) ...
Selecting previously unselected package fakeroot.
Preparing to unpack .../051-fakeroot_1.28-1ubuntu1_arm64.deb ...
Unpacking fakeroot (1.28-1ubuntu1) ...
Selecting previously unselected package fonts-dejavu-core.
Preparing to unpack .../052-fonts-dejavu-core_2.37-2build1_all.deb ...
Unpacking fonts-dejavu-core (2.37-2build1) ...
Selecting previously unselected package fontconfig-config.
Preparing to unpack .../053-fontconfig-config_2.13.1-4.2ubuntu5_all.deb ...
Unpacking fontconfig-config (2.13.1-4.2ubuntu5) ...
Selecting previously unselected package javascript-common.
Preparing to unpack .../054-javascript-common_11+nmu1_all.deb ...
Unpacking javascript-common (11+nmu1) ...
Selecting previously unselected package libonig5:arm64.
Preparing to unpack .../055-libonig5_6.9.7.1-2build1_arm64.deb ...
Unpacking libonig5:arm64 (6.9.7.1-2build1) ...
Selecting previously unselected package libjq1:arm64.
Preparing to unpack .../056-libjq1_1.6-2.1ubuntu3_arm64.deb ...
Unpacking libjq1:arm64 (1.6-2.1ubuntu3) ...
Selecting previously unselected package jq.
Preparing to unpack .../057-jq_1.6-2.1ubuntu3_arm64.deb ...
Unpacking jq (1.6-2.1ubuntu3) ...
Selecting previously unselected package kubernetes-cni.
Preparing to unpack .../058-kubernetes-cni_1.1.1-00_arm64.deb ...
Unpacking kubernetes-cni (1.1.1-00) ...
Selecting previously unselected package socat.
Preparing to unpack .../059-socat_1.7.4.1-3ubuntu4_arm64.deb ...
Unpacking socat (1.7.4.1-3ubuntu4) ...
Selecting previously unselected package kubelet.
Preparing to unpack .../060-kubelet_1.26.0-00_arm64.deb ...
Unpacking kubelet (1.26.0-00) ...
Selecting previously unselected package kubectl.
Preparing to unpack .../061-kubectl_1.26.0-00_arm64.deb ...
Unpacking kubectl (1.26.0-00) ...
Selecting previously unselected package kubeadm.
Preparing to unpack .../062-kubeadm_1.26.0-00_arm64.deb ...
Unpacking kubeadm (1.26.0-00) ...
Selecting previously unselected package libalgorithm-diff-perl.
Preparing to unpack .../063-libalgorithm-diff-perl_1.201-1_all.deb ...
Unpacking libalgorithm-diff-perl (1.201-1) ...
Selecting previously unselected package libalgorithm-diff-xs-perl.
Preparing to unpack .../064-libalgorithm-diff-xs-perl_0.04-6build3_arm64.deb ...
Unpacking libalgorithm-diff-xs-perl (0.04-6build3) ...
Selecting previously unselected package libalgorithm-merge-perl.
Preparing to unpack .../065-libalgorithm-merge-perl_0.08-3_all.deb ...
Unpacking libalgorithm-merge-perl (0.08-3) ...
Selecting previously unselected package libfontconfig1:arm64.
Preparing to unpack .../066-libfontconfig1_2.13.1-4.2ubuntu5_arm64.deb ...
Unpacking libfontconfig1:arm64 (2.13.1-4.2ubuntu5) ...
Selecting previously unselected package libjpeg-turbo8:arm64.
Preparing to unpack .../067-libjpeg-turbo8_2.1.2-0ubuntu1_arm64.deb ...
Unpacking libjpeg-turbo8:arm64 (2.1.2-0ubuntu1) ...
Selecting previously unselected package libjpeg8:arm64.
Preparing to unpack .../068-libjpeg8_8c-2ubuntu10_arm64.deb ...
Unpacking libjpeg8:arm64 (8c-2ubuntu10) ...
Selecting previously unselected package libdeflate0:arm64.
Preparing to unpack .../069-libdeflate0_1.10-2_arm64.deb ...
Unpacking libdeflate0:arm64 (1.10-2) ...
Selecting previously unselected package libjbig0:arm64.
Preparing to unpack .../070-libjbig0_2.1-3.1ubuntu0.22.04.1_arm64.deb ...
Unpacking libjbig0:arm64 (2.1-3.1ubuntu0.22.04.1) ...
Selecting previously unselected package libwebp7:arm64.
Preparing to unpack .../071-libwebp7_1.2.2-2_arm64.deb ...
Unpacking libwebp7:arm64 (1.2.2-2) ...
Selecting previously unselected package libtiff5:arm64.
Preparing to unpack .../072-libtiff5_4.3.0-6ubuntu0.3_arm64.deb ...
Unpacking libtiff5:arm64 (4.3.0-6ubuntu0.3) ...
Selecting previously unselected package libxpm4:arm64.
Preparing to unpack .../073-libxpm4_1%3a3.5.12-1build2_arm64.deb ...
Unpacking libxpm4:arm64 (1:3.5.12-1build2) ...
Selecting previously unselected package libgd3:arm64.
Preparing to unpack .../074-libgd3_2.3.0-2ubuntu2_arm64.deb ...
Unpacking libgd3:arm64 (2.3.0-2ubuntu2) ...
Selecting previously unselected package libc-devtools.
Preparing to unpack .../075-libc-devtools_2.35-0ubuntu3.1_arm64.deb ...
Unpacking libc-devtools (2.35-0ubuntu3.1) ...
Selecting previously unselected package libexpat1-dev:arm64.
Preparing to unpack .../076-libexpat1-dev_2.4.7-1ubuntu0.2_arm64.deb ...
Unpacking libexpat1-dev:arm64 (2.4.7-1ubuntu0.2) ...
Selecting previously unselected package libfile-fcntllock-perl.
Preparing to unpack .../077-libfile-fcntllock-perl_0.22-3build7_arm64.deb ...
Unpacking libfile-fcntllock-perl (0.22-3build7) ...
Selecting previously unselected package libio-pty-perl.
Preparing to unpack .../078-libio-pty-perl_1%3a1.15-2build2_arm64.deb ...
Unpacking libio-pty-perl (1:1.15-2build2) ...
Selecting previously unselected package libipc-run-perl.
Preparing to unpack .../079-libipc-run-perl_20200505.0-1_all.deb ...
Unpacking libipc-run-perl (20200505.0-1) ...
Selecting previously unselected package libjs-jquery.
Preparing to unpack .../080-libjs-jquery_3.6.0+dfsg+3.5.13-1_all.deb ...
Unpacking libjs-jquery (3.6.0+dfsg+3.5.13-1) ...
Selecting previously unselected package libjs-underscore.
Preparing to unpack .../081-libjs-underscore_1.13.2dfsg-2_all.deb ...
Unpacking libjs-underscore (1.13.2dfsg-2) ...
Selecting previously unselected package libjs-sphinxdoc.
Preparing to unpack .../082-libjs-sphinxdoc_4.3.2-1_all.deb ...
Unpacking libjs-sphinxdoc (4.3.2-1) ...
Selecting previously unselected package libltdl7:arm64.
Preparing to unpack .../083-libltdl7_2.4.6-15build2_arm64.deb ...
Unpacking libltdl7:arm64 (2.4.6-15build2) ...
Selecting previously unselected package zlib1g-dev:arm64.
Preparing to unpack .../084-zlib1g-dev_1%3a1.2.11.dfsg-2ubuntu9.2_arm64.deb ...
Unpacking zlib1g-dev:arm64 (1:1.2.11.dfsg-2ubuntu9.2) ...
Selecting previously unselected package libpython3.10-dev:arm64.
Preparing to unpack .../085-libpython3.10-dev_3.10.6-122.04.2_arm64.deb ...
Unpacking libpython3.10-dev:arm64 (3.10.6-122.04.2) ...
Selecting previously unselected package libpython3-dev:arm64.
Preparing to unpack .../086-libpython3-dev_3.10.6-122.04_arm64.deb ...
Unpacking libpython3-dev:arm64 (3.10.6-122.04) ...
Selecting previously unselected package libslirp0:arm64.
Preparing to unpack .../087-libslirp0_4.6.1-1build1_arm64.deb ...
Unpacking libslirp0:arm64 (4.6.1-1build1) ...
Selecting previously unselected package libtime-duration-perl.
Preparing to unpack .../088-libtime-duration-perl_1.21-1_all.deb ...
Unpacking libtime-duration-perl (1.21-1) ...
Selecting previously unselected package libtimedate-perl.
Preparing to unpack .../089-libtimedate-perl_2.3300-2_all.deb ...
Unpacking libtimedate-perl (2.3300-2) ...
Selecting previously unselected package manpages-dev.
Preparing to unpack .../090-manpages-dev_5.10-1ubuntu1_all.deb ...
Unpacking manpages-dev (5.10-1ubuntu1) ...
Selecting previously unselected package moreutils.
Preparing to unpack .../091-moreutils_0.66-1_arm64.deb ...
Unpacking moreutils (0.66-1) ...
Selecting previously unselected package prometheus-node-exporter-collectors.
Preparing to unpack .../092-prometheus-node-exporter-collectors_0+git20211024.8eeeffb-1_all.deb ...
Unpacking prometheus-node-exporter-collectors (0+git20211024.8eeeffb-1) ...
Selecting previously unselected package python3.10-dev.
Preparing to unpack .../093-python3.10-dev_3.10.6-122.04.2_arm64.deb ...
Unpacking python3.10-dev (3.10.6-122.04.2) ...
Selecting previously unselected package python3-dev.
Preparing to unpack .../094-python3-dev_3.10.6-122.04_arm64.deb ...
Unpacking python3-dev (3.10.6-122.04) ...
Selecting previously unselected package python3-wheel.
Preparing to unpack .../095-python3-wheel_0.37.1-2_all.deb ...
Unpacking python3-wheel (0.37.1-2) ...
Selecting previously unselected package python3-pip.
Preparing to unpack .../096-python3-pip_22.0.2+dfsg-1_all.deb ...
Unpacking python3-pip (22.0.2+dfsg-1) ...
Selecting previously unselected package slirp4netns.
Preparing to unpack .../097-slirp4netns_1.0.1-2_arm64.deb ...
Unpacking slirp4netns (1.0.1-2) ...
Selecting previously unselected package smartmontools.
Preparing to unpack .../098-smartmontools_7.2-1build2_arm64.deb ...
Unpacking smartmontools (7.2-1build2) ...
Preparing to unpack .../099-tmux_3.2a-4ubuntu0.1_arm64.deb ...
Unpacking tmux (3.2a-4ubuntu0.1) over (3.2a-4build1) ...
Selecting previously unselected package tree.
Preparing to unpack .../100-tree_2.0.2-1_arm64.deb ...
Unpacking tree (2.0.2-1) ...
Selecting previously unselected package unzip.
Preparing to unpack .../101-unzip_6.0-26ubuntu3.1_arm64.deb ...
Unpacking unzip (6.0-26ubuntu3.1) ...
Setting up smartmontools (7.2-1build2) ...
Created symlink /etc/systemd/system/smartd.service → /lib/systemd/system/smartmontools.service.
Created symlink /etc/systemd/system/multi-user.target.wants/smartmontools.service → /lib/systemd/system/smartmontools.service.
Setting up libexpat1:arm64 (2.4.7-1ubuntu0.2) ...
Setting up javascript-common (11+nmu1) ...
Setting up gcc-11-base:arm64 (11.3.0-1ubuntu122.04) ...
Setting up manpages-dev (5.10-1ubuntu1) ...
Setting up lto-disabled-list (24) ...
Setting up libxpm4:arm64 (1:3.5.12-1build2) ...
Setting up apt-transport-https (2.4.8) ...
Setting up libio-pty-perl (1:1.15-2build2) ...
Setting up libfile-fcntllock-perl (0.22-3build7) ...
Setting up libalgorithm-diff-perl (1.201-1) ...
Setting up unzip (6.0-26ubuntu3.1) ...
Setting up libdeflate0:arm64 (1.10-2) ...
Setting up linux-libc-dev:arm64 (5.15.0-56.62) ...
Setting up libgomp1:arm64 (12.1.0-2ubuntu122.04) ...
Setting up bzip2 (1.0.8-5build1) ...
Setting up conntrack (1:1.4.6-2build2) ...
Setting up python3-wheel (0.37.1-2) ...
Setting up libjbig0:arm64 (2.1-3.1ubuntu0.22.04.1) ...
Setting up libfakeroot:arm64 (1.28-1ubuntu1) ...
Setting up libasan6:arm64 (11.3.0-1ubuntu122.04) ...
Setting up prometheus-node-exporter (1.3.1-1) ...
ERROR: ld.so: object 'libeatmydata.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
Created symlink /etc/systemd/system/multi-user.target.wants/prometheus-node-exporter.service → /lib/systemd/system/prometheus-node-exporter.service.
Setting up fakeroot (1.28-1ubuntu1) ...
update-alternatives: using /usr/bin/fakeroot-sysv to provide /usr/bin/fakeroot (fakeroot) in auto mode
Setting up ca-certificates (20211016ubuntu0.22.04.1) ...
Updating certificates in /etc/ssl/certs...
rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL
0 added, 3 removed; done.
Setting up libtirpc-dev:arm64 (1.3.2-2ubuntu0.1) ...
Setting up rpcsvc-proto (1.4.2-0ubuntu6) ...
Setting up make (4.3-4.1build1) ...
Setting up kubectl (1.26.0-00) ...
Setting up ebtables (2.0.11-4build2) ...
Setting up socat (1.7.4.1-3ubuntu4) ...
Setting up tree (2.0.2-1) ...
Setting up libmpc3:arm64 (1.2.1-2build1) ...
Setting up libatomic1:arm64 (12.1.0-2ubuntu122.04) ...
Setting up containerd.io (1.6.14-1) ...
Created symlink /etc/systemd/system/multi-user.target.wants/containerd.service → /lib/systemd/system/containerd.service.
Setting up libpython3.10-minimal:arm64 (3.10.6-122.04.2) ...
Setting up fonts-dejavu-core (2.37-2build1) ...
Setting up libipc-run-perl (20200505.0-1) ...
Setting up python3-pip (22.0.2+dfsg-1) ...
Setting up libjpeg-turbo8:arm64 (2.1.2-0ubuntu1) ...
Setting up libltdl7:arm64 (2.4.6-15build2) ...
Setting up libdpkg-perl (1.21.1ubuntu2.1) ...
Setting up libtime-duration-perl (1.21-1) ...
Setting up libwebp7:arm64 (1.2.2-2) ...
Setting up libtimedate-perl (2.3300-2) ...
Setting up libubsan1:arm64 (12.1.0-2ubuntu122.04) ...
Setting up docker-ce-cli (5:20.10.223-0ubuntu-jammy) ...
Setting up libslirp0:arm64 (4.6.1-1build1) ...
Setting up libnsl-dev:arm64 (1.3.0-2build2) ...
Setting up libhwasan0:arm64 (12.1.0-2ubuntu122.04) ...
Setting up pigz (2.6-1) ...
Setting up libcrypt-dev:arm64 (1:4.4.27-1) ...
Setting up cri-tools (1.25.0-00) ...
Setting up docker-ce-rootless-extras (5:20.10.22~~3-0~~ubuntu-jammy) ...
Setting up libjs-jquery (3.6.0+dfsg+3.5.13-1) ...
Setting up libisl23:arm64 (0.24-2build1) ...
Setting up libc-dev-bin (2.35-0ubuntu3.1) ...
Setting up kubernetes-cni (1.1.1-00) ...
Setting up libalgorithm-diff-xs-perl (0.04-6build3) ...
Setting up tmux (3.2a-4ubuntu0.1) ...
Setting up libcc1-0:arm64 (12.1.0-2ubuntu122.04) ...
Setting up libonig5:arm64 (6.9.7.1-2build1) ...
Setting up liblsan0:arm64 (12.1.0-2ubuntu122.04) ...
Setting up libitm1:arm64 (12.1.0-2ubuntu122.04) ...
Setting up libjs-underscore (1.13.2dfsg-2) ...
Setting up libalgorithm-merge-perl (0.08-3) ...
Setting up libtsan0:arm64 (11.3.0-1ubuntu122.04) ...
Setting up libjpeg8:arm64 (8c-2ubuntu10) ...
Setting up cpp-11 (11.3.0-1ubuntu122.04) ...
Setting up moreutils (0.66-1) ...
Setting up slirp4netns (1.0.1-2) ...
Setting up libjq1:arm64 (1.6-2.1ubuntu3) ...
Setting up fontconfig-config (2.13.1-4.2ubuntu5) ...
Setting up python3.10-minimal (3.10.6-122.04.2) ...
Setting up dpkg-dev (1.21.1ubuntu2.1) ...
Setting up libpython3.10-stdlib:arm64 (3.10.6-122.04.2) ...
Setting up docker-ce (5:20.10.223-0ubuntu-jammy) ...
Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /lib/systemd/system/docker.service.
Created symlink /etc/systemd/system/sockets.target.wants/docker.socket → /lib/systemd/system/docker.socket.
Setting up libjs-sphinxdoc (4.3.2-1) ...
Setting up libgcc-11-dev:arm64 (11.3.0-1ubuntu122.04) ...
Setting up gcc-11 (11.3.0-1ubuntu122.04) ...
Setting up cpp (4:11.2.0-1ubuntu1) ...
Setting up jq (1.6-2.1ubuntu3) ...
Setting up libc6-dev:arm64 (2.35-0ubuntu3.1) ...
Setting up libtiff5:arm64 (4.3.0-6ubuntu0.3) ...
Setting up libfontconfig1:arm64 (2.13.1-4.2ubuntu5) ...
Setting up kubelet (1.26.0-00) ...
Created symlink /etc/systemd/system/multi-user.target.wants/kubelet.service → /lib/systemd/system/kubelet.service.
Setting up kubeadm (1.26.0-00) ...
Setting up libpython3.10:arm64 (3.10.6-122.04.2) ...
Setting up prometheus-node-exporter-collectors (0+git20211024.8eeeffb-1) ...
Created symlink /etc/systemd/system/timers.target.wants/prometheus-node-exporter-apt.timer → /lib/systemd/system/prometheus-node-exporter-apt.timer.
Created symlink /etc/systemd/system/timers.target.wants/prometheus-node-exporter-ipmitool-sensor.timer → /lib/systemd/system/prometheus-node-exporter-ipmitool-sensor.timer.
Created symlink /etc/systemd/system/timers.target.wants/prometheus-node-exporter-mellanox-hca-temp.timer → /lib/systemd/system/prometheus-node-exporter-mellanox-hca-temp.timer.
Created symlink /etc/systemd/system/timers.target.wants/prometheus-node-exporter-nvme.timer → /lib/systemd/system/prometheus-node-exporter-nvme.timer.
Created symlink /etc/systemd/system/timers.target.wants/prometheus-node-exporter-smartmon.timer → /lib/systemd/system/prometheus-node-exporter-smartmon.timer.
Setting up python3.10 (3.10.6-122.04.2) ...
Setting up gcc (4:11.2.0-1ubuntu1) ...
Setting up libexpat1-dev:arm64 (2.4.7-1ubuntu0.2) ...
Setting up libgd3:arm64 (2.3.0-2ubuntu2) ...
Setting up libstdc++-11-dev:arm64 (11.3.0-1ubuntu122.04) ...
Setting up zlib1g-dev:arm64 (1:1.2.11.dfsg-2ubuntu9.2) ...
Setting up libc-devtools (2.35-0ubuntu3.1) ...
Setting up g++-11 (11.3.0-1ubuntu122.04) ...
Setting up libpython3.10-dev:arm64 (3.10.6-122.04.2) ...
Setting up python3.10-dev (3.10.6-122.04.2) ...
Setting up g++ (4:11.2.0-1ubuntu1) ...
update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode
Setting up build-essential (12.9ubuntu3) ...
Setting up libpython3-dev:arm64 (3.10.6-122.04) ...
Setting up python3-dev (3.10.6-1~22.04) ...
Processing triggers for man-db (2.10.2-1) ...
Processing triggers for libc-bin (2.35-0ubuntu3.1) ...
Processing triggers for ca-certificates (20211016ubuntu0.22.04.1) ...
Updating certificates in /etc/ssl/certs...
0 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
done.
NEEDRESTART-VER: 3.5
NEEDRESTART-KCUR: 5.15.0-1021-oracle
NEEDRESTART-KEXP: 5.15.0-1021-oracle
NEEDRESTART-KSTA: 1
NEEDRESTART-SVC: cloud-final.service
NEEDRESTART-SVC: dbus.service
NEEDRESTART-SVC: networkd-dispatcher.service
NEEDRESTART-SVC: polkit.service
NEEDRESTART-SVC: unattended-upgrades.service
run-parts: executing /usr/share/netfilter-persistent/plugins.d/15-ip4tables flush
iptables: Bad built-in chain name.
iptables: Bad built-in chain name.
iptables: Bad built-in chain name.
iptables: Bad built-in chain name.
iptables: Bad built-in chain name.
iptables: Bad built-in chain name.
run-parts: executing /usr/share/netfilter-persistent/plugins.d/25-ip6tables flush
run-parts: executing /usr/share/netfilter-persistent/plugins.d/15-ip4tables start
run-parts: executing /usr/share/netfilter-persistent/plugins.d/25-ip6tables start
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 16 100 16 0 0 76 0 --:--:-- --:--:-- --:--:-- 76
[init] Using Kubernetes version: v1.26.0
[preflight] Running pre-flight checks
[WARNING NumCPU]: the number of available CPUs 1 is less than the required 2
[preflight] Pulling images required for setting up a Kubernetes cluster
[preflight] This might take a minute or two, depending on the speed of your internet connection
[preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
[certs] Using certificateDir folder "/etc/kubernetes/pki"
[certs] Generating "ca" certificate and key
[certs] Generating "apiserver" certificate and key
[certs] apiserver serving cert is signed for DNS names [kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local node1] and IPs [10.96.0.1 10.0.0.11 158.101.110.227]
[certs] Generating "apiserver-kubelet-client" certificate and key
[certs] Generating "front-proxy-ca" certificate and key
[certs] Generating "front-proxy-client" certificate and key
[certs] Generating "etcd/ca" certificate and key
[certs] Generating "etcd/server" certificate and key
[certs] etcd/server serving cert is signed for DNS names [localhost node1] and IPs [10.0.0.11 127.0.0.1 ::1]
[certs] Generating "etcd/peer" certificate and key
[certs] etcd/peer serving cert is signed for DNS names [localhost node1] and IPs [10.0.0.11 127.0.0.1 ::1]
[certs] Generating "etcd/healthcheck-client" certificate and key
[certs] Generating "apiserver-etcd-client" certificate and key
[certs] Generating "sa" key and public key
[kubeconfig] Using kubeconfig folder "/etc/kubernetes"
[kubeconfig] Writing "admin.conf" kubeconfig file
[kubeconfig] Writing "kubelet.conf" kubeconfig file
[kubeconfig] Writing "controller-manager.conf" kubeconfig file
[kubeconfig] Writing "scheduler.conf" kubeconfig file
[kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
[kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
[kubelet-start] Starting the kubelet
[control-plane] Using manifest folder "/etc/kubernetes/manifests"
[control-plane] Creating static Pod manifest for "kube-apiserver"
[control-plane] Creating static Pod manifest for "kube-controller-manager"
[control-plane] Creating static Pod manifest for "kube-scheduler"
[etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
[wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
[apiclient] All control plane components are healthy after 11.502572 seconds
[upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
[kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
[upload-certs] Skipping phase. Please see --upload-certs
[mark-control-plane] Marking the node node1 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
[mark-control-plane] Marking the node node1 as control-plane by adding the taints [node-role.kubernetes.io/control-plane:NoSchedule]
[bootstrap-token] Using token: 1e0auu.jxyvn6wm9htworsu
[bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
[bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
[bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
[bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
[bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
[bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
[kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
[addons] Applied essential addon: CoreDNS
[addons] Applied essential addon: kube-proxy

Your Kubernetes control-plane has initialized successfully!

To start using your cluster, you need to run the following as a regular user:

mkdir -p $HOME/.kube
sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
sudo chown $(id -u):$(id -g) $HOME/.kube/config

Alternatively, if you are the root user, you can run:

export KUBECONFIG=/etc/kubernetes/admin.conf

You should now deploy a pod network to the cluster.
Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
https://kubernetes.io/docs/concepts/cluster-administration/addons/

Then you can join any number of worker nodes by running the following on each as root:

kubeadm join 10.0.0.11:6443 --token 1e0auu.jxyvn6wm9htworsu
--discovery-token-ca-cert-hash sha256:5c4bb3abe7b12f734987dc94489270c5e78fec7726f9989689f18dcbb1752afc
serviceaccount/weave-net created
clusterrole.rbac.authorization.k8s.io/weave-net created
clusterrolebinding.rbac.authorization.k8s.io/weave-net created
role.rbac.authorization.k8s.io/weave-net created
rolebinding.rbac.authorization.k8s.io/weave-net created
daemonset.apps/weave-net created
Cloud-init v. 22.3.4-0ubuntu1~22.04.1 finished at Thu, 22 Dec 2022 15:08:40 +0000. Datasource DataSourceOracle. Up 139.28 seconds

Jérôme Petazzoni · Answer 4 · Fri Dec 23 2022 00:23:37 GMT+0800 (China Standard Time)

Ah, don't worry too much about the iptables errors. I have them on my clusters too, and it works anyway :)

Just to be sure --- with the log that you pasted above, did Terraform provisioning complete? Or did you get an error from Terraform?

Thiago Dos Santos · Answer 5 · Fri Dec 23 2022 01:00:49 GMT+0800 (China Standard Time)

Terraform doesn't have any errors.

Apply complete! Resources: 14 added, 0 changed, 0 destroyed.

Just this request.
oci_core_instance.["2"] (remote-exec): curl: (7) Failed to connect to 10.0.0.11 port 6443 after 22 ms: Connection refused
oci_core_instance.["2"] (remote-exec): Kubernetes API server (10.0.0.11:6443) not responding.

k8s@node1:$ kubectl get nodes
NAME STATUS ROLES AGE VERSION
node1 Ready control-plane 95s v1.26.0
node2 Ready 68s v1.26.0
node3 Ready 63s v1.26.0
k8s@node1:$ kubectl get pod -A
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system coredns-787d4945fb-hpjfc 0/1 ContainerCreating 0 111s
kube-system coredns-787d4945fb-qbdrg 0/1 ContainerCreating 0 111s
kube-system etcd-node1 1/1 Running 0 115s
kube-system kube-apiserver-node1 1/1 Running 0 115s
kube-system kube-controller-manager-node1 1/1 Running 0 115s
kube-system kube-proxy-lpn84 1/1 Running 0 87s
kube-system kube-proxy-n82bg 1/1 Running 0 111s
kube-system kube-proxy-vqtxw 1/1 Running 0 92s
kube-system kube-scheduler-node1 1/1 Running 0 115s
kube-system weave-net-59mk4 0/2 CrashLoopBackOff 8 (16s ago) 111s
kube-system weave-net-5fd5q 0/2 CrashLoopBackOff 6 (30s ago) 92s
kube-system weave-net-d7fzr 0/2 CrashLoopBackOff 6 (26s ago) 87s

kubectl describe pod -n kube-system coredns-787d4945fb-hpjfc
Name: coredns-787d4945fb-hpjfc
Namespace: kube-system
Priority: 2000000000
Priority Class Name: system-cluster-critical
Service Account: coredns
Node: node1/10.0.0.11
Start Time: Thu, 22 Dec 2022 16:45:19 +0000
Labels: k8s-app=kube-dns
pod-template-hash=787d4945fb
Annotations:
Status: Pending
IP:
IPs:
Controlled By: ReplicaSet/coredns-787d4945fb
Containers:
coredns:
Container ID:
Image: registry.k8s.io/coredns/coredns:v1.9.3
Image ID:
Ports: 53/UDP, 53/TCP, 9153/TCP
Host Ports: 0/UDP, 0/TCP, 0/TCP
Args:
-conf
/etc/coredns/Corefile
State: Waiting
Reason: ContainerCreating
Ready: False
Restart Count: 0
Limits:
memory: 170Mi
Requests:
cpu: 100m
memory: 70Mi
Liveness: http-get http://:8080/health delay=60s timeout=5s period=10s #success=1 #failure=5
Readiness: http-get http://:8181/ready delay=0s timeout=1s period=10s #success=1 #failure=3
Environment:
Mounts:
/etc/coredns from config-volume (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-xxld7 (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
config-volume:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: coredns
Optional: false
kube-api-access-xxld7:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional:
DownwardAPI: true
QoS Class: Burstable
Node-Selectors: kubernetes.io/os=linux
Tolerations: CriticalAddonsOnly op=Exists
node-role.kubernetes.io/control-plane:NoSchedule
node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message

Warning FailedScheduling 14m default-scheduler 0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling..
Normal Scheduled 14m default-scheduler Successfully assigned kube-system/coredns-787d4945fb-hpjfc to node1
Warning FailedCreatePodSandBox 14m kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c": plugin type="weave-net" name="weave" failed (add): netplugin failed with no error message: fork/exec /opt/cni/bin/weave-net: exec format error
Normal SandboxChanged 3m56s (x48 over 14m) kubelet Pod sandbox changed, it will be killed and re-created.

kubectl describe pod -n kube-system weave-net-59mk4
Name: weave-net-59mk4
Namespace: kube-system
Priority: 2000001000
Priority Class Name: system-node-critical
Service Account: weave-net
Node: node1/10.0.0.11
Start Time: Thu, 22 Dec 2022 16:45:14 +0000
Labels: controller-revision-hash=84bb6976d7
name=weave-net
pod-template-generation=1
Annotations:
Status: Running
IP: 10.0.0.11
IPs:
IP: 10.0.0.11
Controlled By: DaemonSet/weave-net
Init Containers:
weave-init:
Container ID: containerd://6bcc705830fe43754b4aef340e3cec69321fbd1e410dd18aa0fbc35e7afbfc67
Image: weaveworks/weave-kube:latest
Image ID: docker.io/weaveworks/weave-kube@sha256:35827a9c549c095f0e9d1cf8b35d8f27ae2c76e31bc6f7f3c0bc95911d5accea
Port:
Host Port:
Command:
/home/weave/init.sh
State: Terminated
Reason: Completed
Exit Code: 0
Started: Thu, 22 Dec 2022 16:45:17 +0000
Finished: Thu, 22 Dec 2022 16:45:18 +0000
Ready: True
Restart Count: 0
Environment:
Mounts:
/host/etc from cni-conf (rw)
/host/home from cni-bin2 (rw)
/host/opt from cni-bin (rw)
/lib/modules from lib-modules (rw)
/run/xtables.lock from xtables-lock (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hz8tk (ro)
Containers:
weave:
Container ID: containerd://0e89a487423f543e4b18319ae0c0641a80f43b229a54dd6b7efa5f82f8d4e09d
Image: weaveworks/weave-kube:latest
Image ID: docker.io/weaveworks/weave-kube@sha256:35827a9c549c095f0e9d1cf8b35d8f27ae2c76e31bc6f7f3c0bc95911d5accea
Port:
Host Port:
Command:
/home/weave/launch.sh
State: Waiting
Reason: CrashLoopBackOff
Last State: Terminated
Reason: Error
Exit Code: 2
Started: Thu, 22 Dec 2022 16:56:12 +0000
Finished: Thu, 22 Dec 2022 16:56:12 +0000
Ready: False
Restart Count: 7
Requests:
cpu: 50m
Readiness: http-get http://127.0.0.1:6784/status delay=0s timeout=1s period=10s #success=1 #failure=3
Environment:
INIT_CONTAINER: true
HOSTNAME: (v1:spec.nodeName)
Mounts:
/host/etc/machine-id from cni-machine-id (ro)
/host/var/lib/dbus from dbus (ro)
/run/xtables.lock from xtables-lock (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hz8tk (ro)
/weavedb from weavedb (rw)
weave-npc:
Container ID: containerd://fb6bd3dd9427324533ccc1cb61a3efe722e6c6db802969c96c919d570c953b92
Image: weaveworks/weave-npc:latest
Image ID: docker.io/weaveworks/weave-npc@sha256:062832fd25b5e9e16650e618f26bba1409a7b3bf2c3903e1b369d788abc63aef
Port:
Host Port:
State: Waiting
Reason: CrashLoopBackOff
Last State: Terminated
Reason: Error
Exit Code: 2
Started: Thu, 22 Dec 2022 16:56:12 +0000
Finished: Thu, 22 Dec 2022 16:56:12 +0000
Ready: False
Restart Count: 7
Requests:
cpu: 50m
Environment:
HOSTNAME: (v1:spec.nodeName)
Mounts:
/run/xtables.lock from xtables-lock (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-hz8tk (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
weavedb:
Type: HostPath (bare host directory volume)
Path: /var/lib/weave
HostPathType:
cni-bin:
Type: HostPath (bare host directory volume)
Path: /opt
HostPathType:
cni-bin2:
Type: HostPath (bare host directory volume)
Path: /home
HostPathType:
cni-conf:
Type: HostPath (bare host directory volume)
Path: /etc
HostPathType:
cni-machine-id:
Type: HostPath (bare host directory volume)
Path: /etc/machine-id
HostPathType:
dbus:
Type: HostPath (bare host directory volume)
Path: /var/lib/dbus
HostPathType:
lib-modules:
Type: HostPath (bare host directory volume)
Path: /lib/modules
HostPathType:
xtables-lock:
Type: HostPath (bare host directory volume)
Path: /run/xtables.lock
HostPathType: FileOrCreate
kube-api-access-hz8tk:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional:
DownwardAPI: true
QoS Class: Burstable
Node-Selectors:
Tolerations: :NoSchedule op=Exists
:NoExecute op=Exists
node.kubernetes.io/disk-pressure:NoSchedule op=Exists
node.kubernetes.io/memory-pressure:NoSchedule op=Exists
node.kubernetes.io/network-unavailable:NoSchedule op=Exists
node.kubernetes.io/not-ready:NoExecute op=Exists
node.kubernetes.io/pid-pressure:NoSchedule op=Exists
node.kubernetes.io/unreachable:NoExecute op=Exists
node.kubernetes.io/unschedulable:NoSchedule op=Exists
Events:
Type Reason Age From Message

Normal Scheduled 14m default-scheduler Successfully assigned kube-system/weave-net-59mk4 to node1
Normal Pulling 14m kubelet Pulling image "weaveworks/weave-kube:latest"
Normal Pulled 14m kubelet Successfully pulled image "weaveworks/weave-kube:latest" in 2.003269212s (2.003275132s including waiting)
Normal Created 14m kubelet Created container weave-init
Normal Started 14m kubelet Started container weave-init
Normal Pulled 14m kubelet Successfully pulled image "weaveworks/weave-kube:latest" in 100.407754ms (100.413634ms including waiting)
Normal Pulled 14m kubelet Successfully pulled image "weaveworks/weave-npc:latest" in 1.119119345s (1.119124665s including waiting)
Normal Started 14m (x2 over 14m) kubelet Started container weave
Normal Created 14m (x2 over 14m) kubelet Created container weave
Normal Pulling 14m (x2 over 14m) kubelet Pulling image "weaveworks/weave-npc:latest"
Normal Pulling 14m (x2 over 14m) kubelet Pulling image "weaveworks/weave-kube:latest"
Normal Pulled 14m kubelet Successfully pulled image "weaveworks/weave-kube:latest" in 125.017009ms (125.022249ms including waiting)
Normal Pulled 14m kubelet Successfully pulled image "weaveworks/weave-npc:latest" in 119.998622ms (120.003422ms including waiting)
Normal Created 14m (x2 over 14m) kubelet Created container weave-npc
Normal Started 14m (x2 over 14m) kubelet Started container weave-npc
Warning BackOff 14m (x2 over 14m) kubelet Back-off restarting failed container weave-npc in pod weave-net-59mk4_kube-system(6fa1766e-3acd-45a5-abb8-c1aca4d084a4)
Warning BackOff 4m38s (x56 over 14m) kubelet Back-off restarting failed container weave in pod weave-net-59mk4_kube-system(6fa1766e-3acd-45a5-abb8-c1aca4d084a4)

Thiago Dos Santos · Answer 6 · Fri Dec 23 2022 01:10:54 GMT+0800 (China Standard Time)

k8s@node1:~$ sudo systemctl status kubelet
● kubelet.service - kubelet: The Kubernetes Node Agent
Loaded: loaded (/lib/systemd/system/kubelet.service; enabled; vendor preset: enabled)
Drop-In: /etc/systemd/system/kubelet.service.d
└─10-kubeadm.conf
Active: active (running) since Thu 2022-12-22 16:45:10 UTC; 22min ago
Docs: https://kubernetes.io/docs/home/
Main PID: 10468 (kubelet)
Tasks: 10 (limit: 7015)
Memory: 37.6M
CPU: 13.350s
CGroup: /system.slice/kubelet.service
└─10468 /usr/bin/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --kubeconfig=/etc/kubernetes/kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/containerd/containerd.sock --pod-infra-container-image=registry.k8s.io/pause:3.9

Dec 22 17:08:00 node1 kubelet[10468]: E1222 17:08:00.431289 10468 kuberuntime_manager.go:965] "Failed to stop sandbox" podSandboxID={Type:containerd ID:6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024}
Dec 22 17:08:00 node1 kubelet[10468]: E1222 17:08:00.431333 10468 kuberuntime_manager.go:705] "killPodWithSyncResult failed" err="failed to "KillPodSandbox" for "a6b466fa-60e6-4ced-9eef-380d0e41d63f" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024\": plugin type=\"weave-net\">
Dec 22 17:08:00 node1 kubelet[10468]: E1222 17:08:00.431363 10468 pod_workers.go:965] "Error syncing pod, skipping" err="failed to "KillPodSandbox" for "a6b466fa-60e6-4ced-9eef-380d0e41d63f" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024\": plugin type=\"weave-net\" name=\>
Dec 22 17:08:02 node1 kubelet[10468]: E1222 17:08:02.432033 10468 remote_runtime.go:205] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox "859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c": plugin type="weave-net" name="weave" failed (delete): netplugin failed with no error message: fork/exec /opt/cni/bin/weave>
Dec 22 17:08:02 node1 kubelet[10468]: E1222 17:08:02.432075 10468 kuberuntime_manager.go:965] "Failed to stop sandbox" podSandboxID={Type:containerd ID:859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c}
Dec 22 17:08:02 node1 kubelet[10468]: E1222 17:08:02.432121 10468 kuberuntime_manager.go:705] "killPodWithSyncResult failed" err="failed to "KillPodSandbox" for "d8f03fbd-0add-47eb-b972-491f9a465ad1" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c\": plugin type=\"weave-net\">
Dec 22 17:08:02 node1 kubelet[10468]: E1222 17:08:02.432150 10468 pod_workers.go:965] "Error syncing pod, skipping" err="failed to "KillPodSandbox" for "d8f03fbd-0add-47eb-b972-491f9a465ad1" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c\": plugin type=\"weave-net\" name=\>
Dec 22 17:08:05 node1 kubelet[10468]: I1222 17:08:05.399416 10468 scope.go:115] "RemoveContainer" containerID="77cc1a53c84e23c1109b9f23d4d58a4763bbc582bedea57fcc55bc264c7695bc"
Dec 22 17:08:05 node1 kubelet[10468]: I1222 17:08:05.399896 10468 scope.go:115] "RemoveContainer" containerID="f197bf85b7e40718bf41603c41df028b8afae1bc520ce3a7e4dd54b49a51ee16"
Dec 22 17:08:05 node1 kubelet[10468]: E1222 17:08:05.400393 10468 pod_workers.go:965] "Error syncing pod, skipping" err="[failed to "StartContainer" for "weave" with CrashLoopBackOff: "back-off 5m0s restarting failed container=weave pod=weave-net-59mk4_kube-system(6fa1766e-3acd-45a5-abb8-c1aca4d084a4)", failed to "StartContainer" for "weave-npc" with CrashLoopBackOff: "back-off 5m0s restartin>
...skipping...

k8s@node1:~$ sudo journalctl -xeu kubelet
Dec 22 17:09:30 node1 kubelet[10468]: E1222 17:09:30.432983 10468 pod_workers.go:965] "Error syncing pod, skipping" err="failed to "KillPodSandbox" for "a6b466fa-60e6-4ced-9eef-380d0e41d63f" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024\": plugin type=\"weave-net\" name=\>
Dec 22 17:09:37 node1 kubelet[10468]: E1222 17:09:37.429430 10468 remote_runtime.go:205] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox "859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c": plugin type="weave-net" name="weave" failed (delete): netplugin failed with no error message: fork/exec /opt/cni/bin/weave>
Dec 22 17:09:37 node1 kubelet[10468]: E1222 17:09:37.429469 10468 kuberuntime_manager.go:965] "Failed to stop sandbox" podSandboxID={Type:containerd ID:859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c}
Dec 22 17:09:37 node1 kubelet[10468]: E1222 17:09:37.429510 10468 kuberuntime_manager.go:705] "killPodWithSyncResult failed" err="failed to "KillPodSandbox" for "d8f03fbd-0add-47eb-b972-491f9a465ad1" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c\": plugin type=\"weave-net\">
Dec 22 17:09:37 node1 kubelet[10468]: E1222 17:09:37.429537 10468 pod_workers.go:965] "Error syncing pod, skipping" err="failed to "KillPodSandbox" for "d8f03fbd-0add-47eb-b972-491f9a465ad1" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c\": plugin type=\"weave-net\" name=\>
Dec 22 17:09:42 node1 kubelet[10468]: I1222 17:09:42.401390 10468 scope.go:115] "RemoveContainer" containerID="77cc1a53c84e23c1109b9f23d4d58a4763bbc582bedea57fcc55bc264c7695bc"
Dec 22 17:09:42 node1 kubelet[10468]: I1222 17:09:42.401830 10468 scope.go:115] "RemoveContainer" containerID="f197bf85b7e40718bf41603c41df028b8afae1bc520ce3a7e4dd54b49a51ee16"
Dec 22 17:09:42 node1 kubelet[10468]: E1222 17:09:42.402247 10468 pod_workers.go:965] "Error syncing pod, skipping" err="[failed to "StartContainer" for "weave" with CrashLoopBackOff: "back-off 5m0s restarting failed container=weave pod=weave-net-59mk4_kube-system(6fa1766e-3acd-45a5-abb8-c1aca4d084a4)", failed to "StartContainer" for "weave-npc" with CrashLoopBackOff: "back-off 5m0s restartin>
Dec 22 17:09:45 node1 kubelet[10468]: E1222 17:09:45.429368 10468 remote_runtime.go:205] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox "6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024": plugin type="weave-net" name="weave" failed (delete): netplugin failed with no error message: fork/exec /opt/cni/bin/weave>
Dec 22 17:09:45 node1 kubelet[10468]: E1222 17:09:45.429408 10468 kuberuntime_manager.go:965] "Failed to stop sandbox" podSandboxID={Type:containerd ID:6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024}
Dec 22 17:09:45 node1 kubelet[10468]: E1222 17:09:45.429442 10468 kuberuntime_manager.go:705] "killPodWithSyncResult failed" err="failed to "KillPodSandbox" for "a6b466fa-60e6-4ced-9eef-380d0e41d63f" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024\": plugin type=\"weave-net\">
Dec 22 17:09:45 node1 kubelet[10468]: E1222 17:09:45.429467 10468 pod_workers.go:965] "Error syncing pod, skipping" err="failed to "KillPodSandbox" for "a6b466fa-60e6-4ced-9eef-380d0e41d63f" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024\": plugin type=\"weave-net\" name=\>
Dec 22 17:09:50 node1 kubelet[10468]: E1222 17:09:50.431008 10468 remote_runtime.go:205] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox "859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c": plugin type="weave-net" name="weave" failed (delete): netplugin failed with no error message: fork/exec /opt/cni/bin/weave>
Dec 22 17:09:50 node1 kubelet[10468]: E1222 17:09:50.431046 10468 kuberuntime_manager.go:965] "Failed to stop sandbox" podSandboxID={Type:containerd ID:859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c}
Dec 22 17:09:50 node1 kubelet[10468]: E1222 17:09:50.431092 10468 kuberuntime_manager.go:705] "killPodWithSyncResult failed" err="failed to "KillPodSandbox" for "d8f03fbd-0add-47eb-b972-491f9a465ad1" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c\": plugin type=\"weave-net\">
Dec 22 17:09:50 node1 kubelet[10468]: E1222 17:09:50.431118 10468 pod_workers.go:965] "Error syncing pod, skipping" err="failed to "KillPodSandbox" for "d8f03fbd-0add-47eb-b972-491f9a465ad1" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c\": plugin type=\"weave-net\" name=\>
Dec 22 17:09:54 node1 kubelet[10468]: I1222 17:09:54.398529 10468 scope.go:115] "RemoveContainer" containerID="77cc1a53c84e23c1109b9f23d4d58a4763bbc582bedea57fcc55bc264c7695bc"
Dec 22 17:09:54 node1 kubelet[10468]: I1222 17:09:54.398985 10468 scope.go:115] "RemoveContainer" containerID="f197bf85b7e40718bf41603c41df028b8afae1bc520ce3a7e4dd54b49a51ee16"
Dec 22 17:09:54 node1 kubelet[10468]: E1222 17:09:54.399520 10468 pod_workers.go:965] "Error syncing pod, skipping" err="[failed to "StartContainer" for "weave" with CrashLoopBackOff: "back-off 5m0s restarting failed container=weave pod=weave-net-59mk4_kube-system(6fa1766e-3acd-45a5-abb8-c1aca4d084a4)", failed to "StartContainer" for "weave-npc" with CrashLoopBackOff: "back-off 5m0s restartin>
Dec 22 17:09:57 node1 kubelet[10468]: E1222 17:09:57.432272 10468 remote_runtime.go:205] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox "6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024": plugin type="weave-net" name="weave" failed (delete): netplugin failed with no error message: fork/exec /opt/cni/bin/weave>
Dec 22 17:09:57 node1 kubelet[10468]: E1222 17:09:57.432310 10468 kuberuntime_manager.go:965] "Failed to stop sandbox" podSandboxID={Type:containerd ID:6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024}
Dec 22 17:09:57 node1 kubelet[10468]: E1222 17:09:57.432351 10468 kuberuntime_manager.go:705] "killPodWithSyncResult failed" err="failed to "KillPodSandbox" for "a6b466fa-60e6-4ced-9eef-380d0e41d63f" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024\": plugin type=\"weave-net\">
Dec 22 17:09:57 node1 kubelet[10468]: E1222 17:09:57.432380 10468 pod_workers.go:965] "Error syncing pod, skipping" err="failed to "KillPodSandbox" for "a6b466fa-60e6-4ced-9eef-380d0e41d63f" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024\": plugin type=\"weave-net\" name=\>
Dec 22 17:10:04 node1 kubelet[10468]: E1222 17:10:04.432130 10468 remote_runtime.go:205] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox "859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c": plugin type="weave-net" name="weave" failed (delete): netplugin failed with no error message: fork/exec /opt/cni/bin/weave>
Dec 22 17:10:04 node1 kubelet[10468]: E1222 17:10:04.432183 10468 kuberuntime_manager.go:965] "Failed to stop sandbox" podSandboxID={Type:containerd ID:859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c}
Dec 22 17:10:04 node1 kubelet[10468]: E1222 17:10:04.432220 10468 kuberuntime_manager.go:705] "killPodWithSyncResult failed" err="failed to "KillPodSandbox" for "d8f03fbd-0add-47eb-b972-491f9a465ad1" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c\": plugin type=\"weave-net\">
Dec 22 17:10:04 node1 kubelet[10468]: E1222 17:10:04.432258 10468 pod_workers.go:965] "Error syncing pod, skipping" err="failed to "KillPodSandbox" for "d8f03fbd-0add-47eb-b972-491f9a465ad1" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c\": plugin type=\"weave-net\" name=\>
Dec 22 17:10:07 node1 kubelet[10468]: I1222 17:10:07.398667 10468 scope.go:115] "RemoveContainer" containerID="77cc1a53c84e23c1109b9f23d4d58a4763bbc582bedea57fcc55bc264c7695bc"
Dec 22 17:10:07 node1 kubelet[10468]: I1222 17:10:07.399116 10468 scope.go:115] "RemoveContainer" containerID="f197bf85b7e40718bf41603c41df028b8afae1bc520ce3a7e4dd54b49a51ee16"
Dec 22 17:10:07 node1 kubelet[10468]: E1222 17:10:07.399669 10468 pod_workers.go:965] "Error syncing pod, skipping" err="[failed to "StartContainer" for "weave" with CrashLoopBackOff: "back-off 5m0s restarting failed container=weave pod=weave-net-59mk4_kube-system(6fa1766e-3acd-45a5-abb8-c1aca4d084a4)", failed to "StartContainer" for "weave-npc" with CrashLoopBackOff: "back-off 5m0s restartin>
Dec 22 17:10:10 node1 kubelet[10468]: E1222 17:10:10.438646 10468 remote_runtime.go:205] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox "6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024": plugin type="weave-net" name="weave" failed (delete): netplugin failed with no error message: fork/exec /opt/cni/bin/weave>
Dec 22 17:10:10 node1 kubelet[10468]: E1222 17:10:10.438700 10468 kuberuntime_manager.go:965] "Failed to stop sandbox" podSandboxID={Type:containerd ID:6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024}
Dec 22 17:10:10 node1 kubelet[10468]: E1222 17:10:10.438731 10468 kuberuntime_manager.go:705] "killPodWithSyncResult failed" err="failed to "KillPodSandbox" for "a6b466fa-60e6-4ced-9eef-380d0e41d63f" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024\": plugin type=\"weave-net\">
Dec 22 17:10:10 node1 kubelet[10468]: E1222 17:10:10.438783 10468 pod_workers.go:965] "Error syncing pod, skipping" err="failed to "KillPodSandbox" for "a6b466fa-60e6-4ced-9eef-380d0e41d63f" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"6b2a4b9e5ea9c3afbe2774a8fcbe40602d50af24066356ebd314f1d0dfe4b024\": plugin type=\"weave-net\" name=\>
Dec 22 17:10:10 node1 kubelet[10468]: W1222 17:10:10.577364 10468 machine.go:65] Cannot read vendor id correctly, set empty.
Dec 22 17:10:18 node1 kubelet[10468]: E1222 17:10:18.432671 10468 remote_runtime.go:205] "StopPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to destroy network for sandbox "859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c": plugin type="weave-net" name="weave" failed (delete): netplugin failed with no error message: fork/exec /opt/cni/bin/weave>
Dec 22 17:10:18 node1 kubelet[10468]: E1222 17:10:18.432707 10468 kuberuntime_manager.go:965] "Failed to stop sandbox" podSandboxID={Type:containerd ID:859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c}
Dec 22 17:10:18 node1 kubelet[10468]: E1222 17:10:18.432742 10468 kuberuntime_manager.go:705] "killPodWithSyncResult failed" err="failed to "KillPodSandbox" for "d8f03fbd-0add-47eb-b972-491f9a465ad1" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c\": plugin type=\"weave-net\">
Dec 22 17:10:18 node1 kubelet[10468]: E1222 17:10:18.432766 10468 pod_workers.go:965] "Error syncing pod, skipping" err="failed to "KillPodSandbox" for "d8f03fbd-0add-47eb-b972-491f9a465ad1" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c\": plugin type=\"weave-net\" name=\>
Dec 22 17:10:19 node1 kubelet[10468]: I1222 17:10:19.398695 10468 scope.go:115] "RemoveContainer" containerID="77cc1a53c84e23c1109b9f23d4d58a4763bbc582bedea57fcc55bc264c7695bc"
Dec 22 17:10:19 node1 kubelet[10468]: I1222 17:10:19.398979 10468 scope.go:115] "RemoveContainer" containerID="f197bf85b7e40718bf41603c41df028b8afae1bc520ce3a7e4dd54b49a51ee16"
Dec 22 17:10:19 node1 kubelet[10468]: E1222 17:10:19.399502 10468 pod_workers.go:965] "Error syncing pod, skipping" err="[failed to "StartContainer" for "weave" with CrashLoopBackOff: "back-off 5m0s restarting failed container=weave pod=weave-net-59mk4_kube-system(6fa1766e-3acd-45a5-abb8-c1aca4d084a4)", failed to "StartContainer" for "weave-npc" with CrashLoopBackOff: "back-off 5m0s restartin>
lines 959-1000/1000 (END)

Jérôme Petazzoni · Answer 7 · Fri Dec 23 2022 15:47:03 GMT+0800 (China Standard Time)

Hi!

It seems to be a different problem, though.

In your first message, the problem was:

 [kubelet-check] The HTTP call equal to 'curl -sSL http://localhost:10248/healthz' failed with error: Get "http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.

Unfortunately, an error has occurred:
timed out waiting for the condition

This error is likely caused by:
- The kubelet is not running
- The kubelet is unhealthy due to a misconfiguration of the node in some way (required cgroups disabled)

Which was probably caused by the fact that Kubelet 1.26 doesn't support the Docker Engine anymore (and that's why I updated the project a few days ago to install containerd 1.6 from the Docker upstream repositories).

In your last message, the problem seems to be:

kube-system weave-net-59mk4 0/2 CrashLoopBackOff 8 (16s ago) 111s
kube-system weave-net-5fd5q 0/2 CrashLoopBackOff 6 (30s ago) 92s
kube-system weave-net-d7fzr 0/2 CrashLoopBackOff 6 (26s ago) 87s

i.e., Weave fails to start correctly.

The following message:

Warning FailedCreatePodSandBox 14m kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = 
failed to setup network for sandbox "859999c1d8d33e2f9fc54e2011ed3ce02122eb6e4725a3e9825ecfb6e621a38c": 
plugin type="weave-net" name="weave" failed (add): netplugin failed with no error message: 
fork/exec /opt/cni/bin/weave-net: exec format error

This could indicate that Weave is using an amd64 image instead of arm64 - the exec format error is typical of using the wrong architecture.

However, I see:

 Image ID: docker.io/weaveworks/weave-kube@sha256:35827a9c549c095f0e9d1cf8b35d8f27ae2c76e31bc6f7f3c0bc95911d5accea

And that seems alright:

$ regctl manifest get --list  weaveworks/weave-kube:latest
Name:        weaveworks/weave-kube:latest
MediaType:   application/vnd.docker.distribution.manifest.list.v2+json
Digest:      sha256:35827a9c549c095f0e9d1cf8b35d8f27ae2c76e31bc6f7f3c0bc95911d5accea
             
Manifests:   
             
  Name:      docker.io/weaveworks/weave-kube@sha256:c7e98ecdcaba3b116013e12e0cdfd9b28f5247fe6492bb85d04852b1896a7158
  MediaType: application/vnd.docker.distribution.manifest.v2+json
  Platform:  linux/amd64
[...]
  Name:      docker.io/weaveworks/weave-kube@sha256:6b7b1c5bbb0589e6b294324aa3d7ee9316d49203c7c418bf087cbd7982ad62fa
  MediaType: application/vnd.docker.distribution.manifest.v2+json
  Platform:  linux/arm64

I'll try to reproduce the issue on my cluster to troubleshoot further!

Jérôme Petazzoni · Answer 8 · Fri Dec 23 2022 16:22:11 GMT+0800 (China Standard Time)

This should be fixed in 90d22b3.

Sorry, that was my bad - I got the wrong Weave YAML URL!

Let me know if that fixes the problem (it did on my test cluster👍🏻)

Thiago Dos Santos · Answer 9 · Fri Dec 23 2022 23:08:42 GMT+0800 (China Standard Time)

Hi @jpetazzo,

It doesn't fix my problem. = /

kubectl get nodes
NAME STATUS ROLES AGE VERSION
node1 Ready control-plane 104m v1.26.0
node2 Ready 103m v1.26.0
node3 Ready 103m v1.26.0
node4 Ready 103m v1.26.0

kubectl get pod -A
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system coredns-787d4945fb-p6pct 0/1 ContainerCreating 0 105m
kube-system coredns-787d4945fb-s4snt 0/1 ContainerCreating 0 105m
kube-system etcd-node1 1/1 Running 0 105m
kube-system kube-apiserver-node1 1/1 Running 0 105m
kube-system kube-controller-manager-node1 1/1 Running 0 105m
kube-system kube-proxy-6wnk4 1/1 Running 0 105m
kube-system kube-proxy-86t7q 1/1 Running 0 105m
kube-system kube-proxy-ftw4k 1/1 Running 0 104m
kube-system kube-proxy-wknn8 1/1 Running 0 105m
kube-system kube-scheduler-node1 1/1 Running 0 105m
kube-system weave-net-6nth5 0/2 CrashLoopBackOff 8 (86s ago) 3m7s
kube-system weave-net-mth26 0/2 CrashLoopBackOff 10 (6s ago) 3m7s
kube-system weave-net-tqbmh 0/2 CrashLoopBackOff 8 (87s ago) 3m7s
kube-system weave-net-w2ztx 0/2 CrashLoopBackOff 10 (19s ago) 3m7s

kubectl describe pod -n kube-system coredns-787d4945fb-p6pct
Name: coredns-787d4945fb-p6pct
Namespace: kube-system
Priority: 2000000000
Priority Class Name: system-cluster-critical
Service Account: coredns
Node: node1/10.0.0.11
Start Time: Fri, 23 Dec 2022 13:15:20 +0000
Labels: k8s-app=kube-dns
pod-template-hash=787d4945fb
Annotations:
Status: Pending
IP:
IPs:
Controlled By: ReplicaSet/coredns-787d4945fb
Containers:
coredns:
Container ID:
Image: registry.k8s.io/coredns/coredns:v1.9.3
Image ID:
Ports: 53/UDP, 53/TCP, 9153/TCP
Host Ports: 0/UDP, 0/TCP, 0/TCP
Args:
-conf
/etc/coredns/Corefile
State: Waiting
Reason: ContainerCreating
Ready: False
Restart Count: 0
Limits:
memory: 170Mi
Requests:
cpu: 100m
memory: 70Mi
Liveness: http-get http://:8080/health delay=60s timeout=5s period=10s #success=1 #failure=5
Readiness: http-get http://:8181/ready delay=0s timeout=1s period=10s #success=1 #failure=3
Environment:
Mounts:
/etc/coredns from config-volume (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-9cdc4 (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
config-volume:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: coredns
Optional: false
kube-api-access-9cdc4:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional:
DownwardAPI: true
QoS Class: Burstable
Node-Selectors: kubernetes.io/os=linux
Tolerations: CriticalAddonsOnly op=Exists
node-role.kubernetes.io/control-plane:NoSchedule
node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message

Normal SandboxChanged 110s (x482 over 107m) kubelet Pod sandbox changed, it will be killed and re-created.

kubectl describe pod -n kube-system weave-net-6nth5
Name: weave-net-6nth5
Namespace: kube-system
Priority: 2000001000
Priority Class Name: system-node-critical
Service Account: weave-net
Node: node2/10.0.0.12
Start Time: Fri, 23 Dec 2022 14:57:27 +0000
Labels: controller-revision-hash=84bb6976d7
name=weave-net
pod-template-generation=1
Annotations:
Status: Running
IP: 10.0.0.12
IPs:
IP: 10.0.0.12
Controlled By: DaemonSet/weave-net
Init Containers:
weave-init:
Container ID: containerd://828bc4754e9144e822201b8a0c131998a8609b22b1fe50d7fe584434d4183d69
Image: weaveworks/weave-kube:latest
Image ID: docker.io/weaveworks/weave-kube@sha256:35827a9c549c095f0e9d1cf8b35d8f27ae2c76e31bc6f7f3c0bc95911d5accea
Port:
Host Port:
Command:
/home/weave/init.sh
State: Terminated
Reason: Completed
Exit Code: 0
Started: Fri, 23 Dec 2022 14:57:28 +0000
Finished: Fri, 23 Dec 2022 14:57:29 +0000
Ready: True
Restart Count: 0
Environment:
Mounts:
/host/etc from cni-conf (rw)
/host/home from cni-bin2 (rw)
/host/opt from cni-bin (rw)
/lib/modules from lib-modules (rw)
/run/xtables.lock from xtables-lock (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-n95dm (ro)
Containers:
weave:
Container ID: containerd://f742b5ca5c73e545e022b8ec4a104236dfff628d2c1db47c59e6c1f972d3d4e1
Image: weaveworks/weave-kube:latest
Image ID: docker.io/weaveworks/weave-kube@sha256:35827a9c549c095f0e9d1cf8b35d8f27ae2c76e31bc6f7f3c0bc95911d5accea
Port:
Host Port:
Command:
/home/weave/launch.sh
State: Waiting
Reason: CrashLoopBackOff
Last State: Terminated
Reason: Error
Exit Code: 2
Started: Fri, 23 Dec 2022 15:03:23 +0000
Finished: Fri, 23 Dec 2022 15:03:23 +0000
Ready: False
Restart Count: 6
Requests:
cpu: 50m
Readiness: http-get http://127.0.0.1:6784/status delay=0s timeout=1s period=10s #success=1 #failure=3
Environment:
INIT_CONTAINER: true
HOSTNAME: (v1:spec.nodeName)
Mounts:
/host/etc/machine-id from cni-machine-id (ro)
/host/var/lib/dbus from dbus (ro)
/run/xtables.lock from xtables-lock (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-n95dm (ro)
/weavedb from weavedb (rw)
weave-npc:
Container ID: containerd://c263b5695186f3b5b4d0fb512a9df00164b235cc39406f15d1980cc111f31fa9
Image: weaveworks/weave-npc:latest
Image ID: docker.io/weaveworks/weave-npc@sha256:062832fd25b5e9e16650e618f26bba1409a7b3bf2c3903e1b369d788abc63aef
Port:
Host Port:
State: Waiting
Reason: CrashLoopBackOff
Last State: Terminated
Reason: Error
Exit Code: 2
Started: Fri, 23 Dec 2022 15:03:24 +0000
Finished: Fri, 23 Dec 2022 15:03:24 +0000
Ready: False
Restart Count: 6
Requests:
cpu: 50m
Environment:
HOSTNAME: (v1:spec.nodeName)
Mounts:
/run/xtables.lock from xtables-lock (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-n95dm (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
weavedb:
Type: HostPath (bare host directory volume)
Path: /var/lib/weave
HostPathType:
cni-bin:
Type: HostPath (bare host directory volume)
Path: /opt
HostPathType:
cni-bin2:
Type: HostPath (bare host directory volume)
Path: /home
HostPathType:
cni-conf:
Type: HostPath (bare host directory volume)
Path: /etc
HostPathType:
cni-machine-id:
Type: HostPath (bare host directory volume)
Path: /etc/machine-id
HostPathType:
dbus:
Type: HostPath (bare host directory volume)
Path: /var/lib/dbus
HostPathType:
lib-modules:
Type: HostPath (bare host directory volume)
Path: /lib/modules
HostPathType:
xtables-lock:
Type: HostPath (bare host directory volume)
Path: /run/xtables.lock
HostPathType: FileOrCreate
kube-api-access-n95dm:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional:
DownwardAPI: true
QoS Class: Burstable
Node-Selectors:
Tolerations: :NoSchedule op=Exists
:NoExecute op=Exists
node.kubernetes.io/disk-pressure:NoSchedule op=Exists
node.kubernetes.io/memory-pressure:NoSchedule op=Exists
node.kubernetes.io/network-unavailable:NoSchedule op=Exists
node.kubernetes.io/not-ready:NoExecute op=Exists
node.kubernetes.io/pid-pressure:NoSchedule op=Exists
node.kubernetes.io/unreachable:NoExecute op=Exists
node.kubernetes.io/unschedulable:NoSchedule op=Exists
Events:
Type Reason Age From Message

Normal Pulling 7m29s kubelet Pulling image "weaveworks/weave-kube:latest"
Normal Pulled 7m29s kubelet Successfully pulled image "weaveworks/weave-kube:latest" in 143.352411ms (143.357891ms including waiting)
Normal Created 7m29s kubelet Created container weave-init
Normal Scheduled 7m29s default-scheduler Successfully assigned kube-system/weave-net-6nth5 to node2
Normal Started 7m28s kubelet Started container weave-init
Normal Pulled 7m27s kubelet Successfully pulled image "weaveworks/weave-kube:latest" in 101.279699ms (101.285099ms including waiting)
Normal Pulled 7m26s kubelet Successfully pulled image "weaveworks/weave-npc:latest" in 143.434935ms (143.440535ms including waiting)
Normal Pulling 7m26s (x2 over 7m27s) kubelet Pulling image "weaveworks/weave-kube:latest"
Normal Created 7m26s (x2 over 7m27s) kubelet Created container weave
Normal Pulled 7m26s kubelet Successfully pulled image "weaveworks/weave-kube:latest" in 97.497071ms (97.501951ms including waiting)
Normal Started 7m25s (x2 over 7m26s) kubelet Started container weave
Normal Created 7m25s (x2 over 7m26s) kubelet Created container weave-npc
Normal Started 7m25s (x2 over 7m26s) kubelet Started container weave-npc
Normal Pulling 7m25s (x2 over 7m26s) kubelet Pulling image "weaveworks/weave-npc:latest"
Normal Pulled 7m25s kubelet Successfully pulled image "weaveworks/weave-npc:latest" in 135.386239ms (135.392959ms including waiting)
Warning BackOff 7m24s (x2 over 7m25s) kubelet Back-off restarting failed container weave-npc in pod weave-net-6nth5_kube-system(5a74e6f5-26c2-48af-a0c2-27d1a8365344)
Warning BackOff 2m22s (x33 over 7m25s) kubelet Back-off restarting failed container weave in pod weave-net-6nth5_kube-system(5a74e6f5-26c2-48af-a0c2-27d1a8365344)

kubectl delete -f https://github.com/weaveworks/weave/releases/download/v2.8.1/weave-daemonset-k8s.yaml
serviceaccount "weave-net" deleted
clusterrole.rbac.authorization.k8s.io "weave-net" deleted
clusterrolebinding.rbac.authorization.k8s.io "weave-net" deleted
role.rbac.authorization.k8s.io "weave-net" deleted
rolebinding.rbac.authorization.k8s.io "weave-net" deleted
daemonset.apps "weave-net" deleted

kubectl apply -f https://github.com/weaveworks/weave/releases/download/v2.8.1/weave-daemonset-k8s.yaml
serviceaccount/weave-net created
clusterrole.rbac.authorization.k8s.io/weave-net created
clusterrolebinding.rbac.authorization.k8s.io/weave-net created
role.rbac.authorization.k8s.io/weave-net created
rolebinding.rbac.authorization.k8s.io/weave-net created
daemonset.apps/weave-net created

kubectl get pod -A
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system coredns-787d4945fb-p6pct 0/1 ContainerCreating 0 112m
kube-system coredns-787d4945fb-s4snt 0/1 ContainerCreating 0 112m
kube-system etcd-node1 1/1 Running 0 112m
kube-system kube-apiserver-node1 1/1 Running 0 112m
kube-system kube-controller-manager-node1 1/1 Running 0 112m
kube-system kube-proxy-6wnk4 1/1 Running 0 112m
kube-system kube-proxy-86t7q 1/1 Running 0 112m
kube-system kube-proxy-ftw4k 1/1 Running 0 111m
kube-system kube-proxy-wknn8 1/1 Running 0 112m
kube-system kube-scheduler-node1 1/1 Running 0 112m
kube-system weave-net-7kjxz 0/2 CrashLoopBackOff 2 (19s ago) 23s
kube-system weave-net-rpncn 0/2 CrashLoopBackOff 2 (20s ago) 23s
kube-system weave-net-rth5b 0/2 CrashLoopBackOff 2 (19s ago) 23s
kube-system weave-net-wkbdz 0/2 CrashLoopBackOff 2 (19s ago) 23s

Jérôme Petazzoni · Answer 10 · Sat Dec 24 2022 17:21:16 GMT+0800 (China Standard Time)

Ah, instead of:

kubectl apply -f https://github.com/weaveworks/weave/releases/download/v2.8.1/weave-daemonset-k8s.yaml

Try:

kubectl apply -f https://github.com/weaveworks/weave/releases/download/v2.8.1/weave-daemonset-k8s-1.11.yaml

Let me know if that works!
(Normally if you git pull then terraform destroy and terraform apply again it should work too... Unless I f***ed up my commits😅)

Thiago Dos Santos · Answer 11 · Mon Dec 26 2022 06:26:08 GMT+0800 (China Standard Time)

Thanks, @jpetazzo It works for me.

"http://localhost:10248/healthz": dial tcp 127.0.0.1:10248: connect: connection refused.

-- An ExecStart= process belonging to unit kubelet.service has exited.

-- The process' exit code is 'exited' and its exit status is 1. Dec 21 20:23:12 node1 systemd[1]: kubelet.service: Failed with result 'exit-code'. -- Subject: Unit failed -- Defined-By: systemd -- Support: http://www.ubuntu.com/support

-- The process' exit code is 'exited' and its exit status is 1.
Dec 21 20:23:12 node1 systemd[1]: kubelet.service: Failed with result 'exit-code'.
-- Subject: Unit failed
-- Defined-By: systemd
-- Support: http://www.ubuntu.com/support