Giters

vmware-tanzu / sonobuoy

Sonobuoy is a diagnostic tool that makes it easier to understand the state of a Kubernetes cluster by running a set of Kubernetes conformance tests and other plugins in an accessible and non-destructive manner.

Home Page:https://sonobuoy.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Lost the ability to read "[It]" tags for `E2E_FOCUS` variable

Joseph-Goergen opened this issue · comments

commented

What steps did you take and what happened:
[A clear and concise description of what the bug is.]

  1. Run conformance on kubernetes cluster
  2. Run into error on test
  3. Retrieve test (sonobuoy retrieve .)
  4. Generate a manifest to apply to retry the failed test. (sonobuoy gen --skip-preflight --rerun-failed file-retrieved.tar.gz)
  5. Retrieve retry test results
Will run 0 of 7207 specs
SSSSSSS...

What did you expect to happen:

Will run 1 of 7207 specs

Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]

I was testing to find out what was causing it to break. It appears to be the [It] tag that gets added onto the retry E2E_FOCUS variable that makes tests not recognizable. I also did some version testing to help narrow it down and the problem appears to show up in version v0.56.9. Where it looks like v0.56.8 reads the [It] tag just fine.

Note: We use v0.56.17 for our testing where we also see the problem.

Environment:

  • Sonobuoy version: v0.56.9
  • Kubernetes version: (use kubectl version): v1.27.4
  • Kubernetes installer & version:
  • Cloud provider or hardware configuration: IBM Cloud
  • OS (e.g. from /etc/os-release):
  • Sonobuoy tarball (which contains * below)