KubeIP not able to assign an IP to a node in state NotReady
migueldelucasdoit opened this issue · comments
Describe the bug
If a new node is starting and it is in NotReady state - kubeIP removes the public IP (assigns 0.0.0.0) and the node loses internet connection and can't provision properly
To Reproduce
This behavior has been seen in a customer using KubeIP version 1.0.3
Expected behavior
KubeIP assigns a public fixed IP address from a managed pool.
Logs
time="2023-09-21T13:09:02Z" level=info msg="&{kubeip serve-prod spot-fixedip-v5 true [] 5ns false priority true true true false}"
time="2023-09-21T13:09:02Z" level=info msg="[]"
time="2023-09-21T13:09:02Z" level=info msg="kubeIP is starting" Build Date="2023-09-19T10:15:21+0000" Cluster name=serve-prod Project name=key-cistern-95411 Version=v0
time="2023-09-21T13:09:02Z" level=info msg="Processing initial force assignment check" function=forceAssignment pkg=kubeip
time="2023-09-21T13:09:02Z" level=info msg="Starting forceAssignmentOnce" function=forceAssignmentOnce pkg=kubeip
time="2023-09-21T13:09:02Z" level=info msg="Collecting Node List..." function=processAllNodes pkg=kubeip
time="2023-09-21T13:09:02Z" level=info msg="Starting kubeip controller" pkg=kubeip-node
time="2023-09-21T13:09:02Z" level=info msg="Collected 3 Nodes of interest...calculating number of IPs required" function=processAllNodes pkg=kubeip
time="2023-09-21T13:09:02Z" level=info msg="Collected 3 Nodes of interest...processing 3 nodes instances within region europe-west1" function=processAllNodes pkg=kubeip
time="2023-09-21T13:09:02Z" level=info msg="Retrieving addresses used in project key-cistern-95411 in region europe-west1" function=processAllNodes pkg=kubeip
time="2023-09-21T13:09:03Z" level=info msg="kubeip controller synced and ready" pkg=kubeip-node
time="2023-09-21T13:09:03Z" level=info msg="Project key-cistern-95411 in region europe-west1 should use the following IPs [34.78.106.50 35.205.90.80 35.205.250.74]... Checking that the instances follow these assignments" function=processAllNodes pkg=kubeip
time="2023-09-21T13:09:03Z" level=info msg="Found 0 Addresses to remove project key-cistern-95411 in region europe-west1. Addresses []" function=processAllNodes pkg=kubeip
time="2023-09-21T13:09:03Z" level=info msg="Found unassigned node gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 in pool spot-fixedip-v5" function=processAllNodes pkg=kubeip
time="2023-09-21T13:09:03Z" level=info msg="Working on gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 in zone europe-west1-c" function=Kubeip pkg=kubeip
time="2023-09-21T13:09:03Z" level=info msg="Found unassigned node gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb in pool spot-fixedip-v5" function=processAllNodes pkg=kubeip
time="2023-09-21T13:09:03Z" level=info msg="Found unassigned node gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft in pool spot-fixedip-v5" function=processAllNodes pkg=kubeip
time="2023-09-21T13:09:03Z" level=info msg="Found node without tag gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60" function=assignMissingTags pkg=kubeip
time="2023-09-21T13:09:03Z" level=info msg="Found node without tag gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb" function=assignMissingTags pkg=kubeip
time="2023-09-21T13:09:04Z" level=info msg="Found node without tag gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft" function=assignMissingTags pkg=kubeip
time="2023-09-21T13:09:12Z" level=info msg="Deleted IP for gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 zone europe-west1-c" function=DeleteIP pkg=kubeip
time="2023-09-21T13:09:12Z" level=info msg="Tagging node gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 as 0.0.0.0" function=tagNode pkg=kubeip
time="2023-09-21T13:09:12Z" level=info msg="Clear label tag for node gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 with ip 0.0.0.0 and clear tags map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/gke-boot-disk:pd-ssd cloud.google.com/gke-container-runtime:containerd cloud.google.com/gke-cpu-scaling-level:2 cloud.google.com/gke-logging-variant:DEFAULT cloud.google.com/gke-max-pods-per-node:110 cloud.google.com/gke-nodepool:spot-fixedip-v5 cloud.google.com/gke-os-distribution:ubuntu cloud.google.com/gke-spot:true cloud.google.com/machine-family:n1 failure-domain.beta.kubernetes.io/region:europe-west1 failure-domain.beta.kubernetes.io/zone:europe-west1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/masq-agent-ds-ready:true nodepool:preemtible-fixedip projectcalico.org/ds-ready:true topology.kubernetes.io/region:europe-west1 topology.kubernetes.io/zone:europe-west1-c]" function=tagNode pkg=kubeip
time="2023-09-21T13:09:12Z" level=info msg="Tagging node gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 as 0.0.0.0 with tags {"kubip_assigned":"0-0-0-0" ,"nodepool":null ,"[projectcalico.org/ds-ready](http://projectcalico.org/ds-ready%5C)":null} " function=tagNode pkg=kubeip
time="2023-09-21T13:09:17Z" level=info msg="Added IP for gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 zone europe-west1-c new ip 35.205.250.74" function=addIP pkg=kubeip
time="2023-09-21T13:09:17Z" level=info msg="Replaced IP for gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 zone europe-west1-c new ip 35.205.250.74" function=replaceIP pkg=kubeip
time="2023-09-21T13:09:17Z" level=info msg="Tagging node gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 as 35.205.250.74" function=tagNode pkg=kubeip
time="2023-09-21T13:09:17Z" level=info msg="Clear label tag for node gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 with ip 35.205.250.74 and clear tags map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/gke-boot-disk:pd-ssd cloud.google.com/gke-container-runtime:containerd cloud.google.com/gke-cpu-scaling-level:2 cloud.google.com/gke-logging-variant:DEFAULT cloud.google.com/gke-max-pods-per-node:110 cloud.google.com/gke-nodepool:spot-fixedip-v5 cloud.google.com/gke-os-distribution:ubuntu cloud.google.com/gke-spot:true cloud.google.com/machine-family:n1 failure-domain.beta.kubernetes.io/region:europe-west1 failure-domain.beta.kubernetes.io/zone:europe-west1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 kubernetes.io/os:linux kubip_assigned:0-0-0-0 node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/masq-agent-ds-ready:true topology.kubernetes.io/region:europe-west1 topology.kubernetes.io/zone:europe-west1-c]" function=tagNode pkg=kubeip
time="2023-09-21T13:09:17Z" level=info msg="Tagging node gke-serve-prod-spot-fixedip-v5-d09bfc56-cj60 as 35.205.250.74 with tags {"kubip_assigned":"35-205-250-74"} " function=tagNode pkg=kubeip
time="2023-09-21T13:09:17Z" level=info msg="Working on gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb in zone europe-west1-c" function=Kubeip pkg=kubeip
time="2023-09-21T13:09:18Z" level=info msg="no free address found"
time="2023-09-21T13:09:18Z" level=info msg="Working on gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft in zone europe-west1-c" function=Kubeip pkg=kubeip
time="2023-09-21T13:09:18Z" level=info msg="no free address found"
time="2023-09-21T13:14:02Z" level=info msg="Tick received for force assignment check" function=forceAssignment pkg=kubeip
time="2023-09-21T13:14:02Z" level=info msg="Starting forceAssignmentOnce" function=forceAssignmentOnce pkg=kubeip
time="2023-09-21T13:14:02Z" level=info msg="Collecting Node List..." function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:02Z" level=info msg="Found unassigned node gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb in pool spot-fixedip-v5" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:02Z" level=info msg="Working on gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb in zone europe-west1-c" function=Kubeip pkg=kubeip
time="2023-09-21T13:14:02Z" level=info msg="Found unassigned node gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft in pool spot-fixedip-v5" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:02Z" level=info msg="Found node without tag gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb" function=assignMissingTags pkg=kubeip
time="2023-09-21T13:14:03Z" level=info msg="no free address found"
time="2023-09-21T13:14:03Z" level=info msg="Working on gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft in zone europe-west1-c" function=Kubeip pkg=kubeip
time="2023-09-21T13:14:03Z" level=info msg="Found node without tag gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft" function=assignMissingTags pkg=kubeip
time="2023-09-21T13:14:03Z" level=info msg="no free address found"
time="2023-09-21T13:14:37Z" level=info msg="Processing removal to node: gke-serve-prod-spot-fixedip-v4-0d87ac80-0khz " function=processItem pkg=kubeip-node
time="2023-09-21T13:14:37Z" level=info msg="Starting forceAssignmentOnce" function=forceAssignmentOnce pkg=kubeip
time="2023-09-21T13:14:37Z" level=info msg="Collecting Node List..." function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:37Z" level=info msg="Collected 3 Nodes of interest...calculating number of IPs required" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:37Z" level=info msg="Collected 3 Nodes of interest...processing 3 nodes instances within region europe-west1" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:37Z" level=info msg="Retrieving addresses used in project key-cistern-95411 in region europe-west1" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:38Z" level=info msg="Project key-cistern-95411 in region europe-west1 should use the following IPs [34.78.106.50 35.205.90.80 35.205.250.74]... Checking that the instances follow these assignments" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:38Z" level=info msg="Found 0 Addresses to remove project key-cistern-95411 in region europe-west1. Addresses []" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:38Z" level=info msg="Found unassigned node gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb in pool spot-fixedip-v5" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:38Z" level=info msg="Working on gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb in zone europe-west1-c" function=Kubeip pkg=kubeip
time="2023-09-21T13:14:38Z" level=info msg="Found unassigned node gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft in pool spot-fixedip-v5" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:38Z" level=info msg="Found node without tag gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb" function=assignMissingTags pkg=kubeip
time="2023-09-21T13:14:38Z" level=info msg="Found node without tag gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft" function=assignMissingTags pkg=kubeip
time="2023-09-21T13:14:42Z" level=info msg="Processing removal to node: gke-serve-prod-spot-fixedip-v4-0d87ac80-w9mq " function=processItem pkg=kubeip-node
time="2023-09-21T13:14:42Z" level=info msg="Starting forceAssignmentOnce" function=forceAssignmentOnce pkg=kubeip
time="2023-09-21T13:14:42Z" level=info msg="Collecting Node List..." function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:42Z" level=info msg="Collected 3 Nodes of interest...calculating number of IPs required" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:42Z" level=info msg="Collected 3 Nodes of interest...processing 3 nodes instances within region europe-west1" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:43Z" level=info msg="Retrieving addresses used in project key-cistern-95411 in region europe-west1" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:43Z" level=info msg="Project key-cistern-95411 in region europe-west1 should use the following IPs [34.78.106.50 35.205.90.80 35.205.250.74]... Checking that the instances follow these assignments" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:43Z" level=info msg="Found 0 Addresses to remove project key-cistern-95411 in region europe-west1. Addresses []" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:43Z" level=info msg="Found unassigned node gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb in pool spot-fixedip-v5" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:44Z" level=info msg="Found unassigned node gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft in pool spot-fixedip-v5" function=processAllNodes pkg=kubeip
time="2023-09-21T13:14:44Z" level=info msg="Found node without tag gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb" function=assignMissingTags pkg=kubeip
time="2023-09-21T13:14:44Z" level=info msg="Found node without tag gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft" function=assignMissingTags pkg=kubeip
time="2023-09-21T13:14:47Z" level=info msg="Deleted IP for gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb zone europe-west1-c" function=DeleteIP pkg=kubeip
time="2023-09-21T13:14:47Z" level=info msg="Tagging node gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb as 0.0.0.0" function=tagNode pkg=kubeip
time="2023-09-21T13:14:47Z" level=info msg="Clear label tag for node gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb with ip 0.0.0.0 and clear tags map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/gke-boot-disk:pd-ssd cloud.google.com/gke-container-runtime:containerd cloud.google.com/gke-cpu-scaling-level:2 cloud.google.com/gke-logging-variant:DEFAULT cloud.google.com/gke-max-pods-per-node:110 cloud.google.com/gke-nodepool:spot-fixedip-v5 cloud.google.com/gke-os-distribution:ubuntu cloud.google.com/gke-spot:true cloud.google.com/machine-family:n1 failure-domain.beta.kubernetes.io/region:europe-west1 failure-domain.beta.kubernetes.io/zone:europe-west1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/masq-agent-ds-ready:true nodepool:preemtible-fixedip projectcalico.org/ds-ready:true topology.kubernetes.io/region:europe-west1 topology.kubernetes.io/zone:europe-west1-c]" function=tagNode pkg=kubeip
time="2023-09-21T13:14:47Z" level=info msg="Tagging node gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb as 0.0.0.0 with tags {"kubip_assigned":"0-0-0-0" ,"[projectcalico.org/ds-ready](http://projectcalico.org/ds-ready%5C)":null ,"nodepool":null} " function=tagNode pkg=kubeip
time="2023-09-21T13:14:54Z" level=info msg="Added IP for gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb zone europe-west1-c new ip 34.78.106.50" function=addIP pkg=kubeip
time="2023-09-21T13:14:54Z" level=info msg="Replaced IP for gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb zone europe-west1-c new ip 34.78.106.50" function=replaceIP pkg=kubeip
time="2023-09-21T13:14:54Z" level=info msg="Tagging node gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb as 34.78.106.50" function=tagNode pkg=kubeip
time="2023-09-21T13:14:54Z" level=info msg="Clear label tag for node gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb with ip 34.78.106.50 and clear tags map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/gke-boot-disk:pd-ssd cloud.google.com/gke-container-runtime:containerd cloud.google.com/gke-cpu-scaling-level:2 cloud.google.com/gke-logging-variant:DEFAULT cloud.google.com/gke-max-pods-per-node:110 cloud.google.com/gke-nodepool:spot-fixedip-v5 cloud.google.com/gke-os-distribution:ubuntu cloud.google.com/gke-spot:true cloud.google.com/machine-family:n1 failure-domain.beta.kubernetes.io/region:europe-west1 failure-domain.beta.kubernetes.io/zone:europe-west1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb kubernetes.io/os:linux kubip_assigned:0-0-0-0 node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/masq-agent-ds-ready:true topology.kubernetes.io/region:europe-west1 topology.kubernetes.io/zone:europe-west1-c]" function=tagNode pkg=kubeip
time="2023-09-21T13:14:54Z" level=info msg="Tagging node gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb as 34.78.106.50 with tags {"kubip_assigned":"34-78-106-50"} " function=tagNode pkg=kubeip
time="2023-09-21T13:14:54Z" level=info msg="Working on gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft in zone europe-west1-c" function=Kubeip pkg=kubeip
time="2023-09-21T13:15:03Z" level=info msg="Deleted IP for gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft zone europe-west1-c" function=DeleteIP pkg=kubeip
time="2023-09-21T13:15:03Z" level=info msg="Tagging node gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft as 0.0.0.0" function=tagNode pkg=kubeip
time="2023-09-21T13:15:03Z" level=info msg="Clear label tag for node gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft with ip 0.0.0.0 and clear tags map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/gke-boot-disk:pd-ssd cloud.google.com/gke-container-runtime:containerd cloud.google.com/gke-cpu-scaling-level:2 cloud.google.com/gke-logging-variant:DEFAULT cloud.google.com/gke-max-pods-per-node:110 cloud.google.com/gke-nodepool:spot-fixedip-v5 cloud.google.com/gke-os-distribution:ubuntu cloud.google.com/gke-spot:true cloud.google.com/machine-family:n1 failure-domain.beta.kubernetes.io/region:europe-west1 failure-domain.beta.kubernetes.io/zone:europe-west1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/masq-agent-ds-ready:true nodepool:preemtible-fixedip projectcalico.org/ds-ready:true topology.kubernetes.io/region:europe-west1 topology.kubernetes.io/zone:europe-west1-c]" function=tagNode pkg=kubeip
time="2023-09-21T13:15:03Z" level=info msg="Tagging node gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft as 0.0.0.0 with tags {"kubip_assigned":"0-0-0-0" ,"[projectcalico.org/ds-ready](http://projectcalico.org/ds-ready%5C)":null ,"nodepool":null} " function=tagNode pkg=kubeip
time="2023-09-21T13:15:08Z" level=info msg="Added IP for gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft zone europe-west1-c new ip 35.205.90.80" function=addIP pkg=kubeip
time="2023-09-21T13:15:08Z" level=info msg="Replaced IP for gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft zone europe-west1-c new ip 35.205.90.80" function=replaceIP pkg=kubeip
time="2023-09-21T13:15:08Z" level=info msg="Tagging node gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft as 35.205.90.80" function=tagNode pkg=kubeip
time="2023-09-21T13:15:08Z" level=info msg="Clear label tag for node gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft with ip 35.205.90.80 and clear tags map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/gke-boot-disk:pd-ssd cloud.google.com/gke-container-runtime:containerd cloud.google.com/gke-cpu-scaling-level:2 cloud.google.com/gke-logging-variant:DEFAULT cloud.google.com/gke-max-pods-per-node:110 cloud.google.com/gke-nodepool:spot-fixedip-v5 cloud.google.com/gke-os-distribution:ubuntu cloud.google.com/gke-spot:true cloud.google.com/machine-family:n1 failure-domain.beta.kubernetes.io/region:europe-west1 failure-domain.beta.kubernetes.io/zone:europe-west1-c kubernetes.io/arch:amd64 kubernetes.io/hostname:gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft kubernetes.io/os:linux kubip_assigned:0-0-0-0 node.kubernetes.io/instance-type:n1-standard-2 node.kubernetes.io/masq-agent-ds-ready:true topology.kubernetes.io/region:europe-west1 topology.kubernetes.io/zone:europe-west1-c]" function=tagNode pkg=kubeip
time="2023-09-21T13:15:08Z" level=info msg="Tagging node gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft as 35.205.90.80 with tags {"kubip_assigned":"35-205-90-80"} " function=tagNode pkg=kubeip
time="2023-09-21T13:15:08Z" level=info msg="Working on gke-serve-prod-spot-fixedip-v5-d09bfc56-qlbb in zone europe-west1-c" function=Kubeip pkg=kubeip
time="2023-09-21T13:15:09Z" level=info msg="no free address found"
time="2023-09-21T13:15:09Z" level=info msg="Working on gke-serve-prod-spot-fixedip-v5-d09bfc56-r0ft in zone europe-west1-c" function=Kubeip pkg=kubeip
time="2023-09-21T13:15:09Z" level=info msg="no free address found"
Additional context
Reference ticket with the information https://doitintl.zendesk.com/agent/tickets/148774