Integration tests failing on travis
donmccasland opened this issue · comments
From recent build:
https://travis-ci.com/donmccasland/container-diff/builds/123926807?utm_medium=notification&utm_source=email
--- FAIL: TestDiffAndAnalysis (0.00s)
integration_test.go:76: Running command: /home/travis/gopath/src/github.com/GoogleContainerTools/container-diff/out/container-diff [diff gcr.io/gcp-runtimes/diff-base gcr.io/gcp-runtimes/diff-modified --type=file --no-cache -j]
integration_test.go:76: Running command: /home/travis/gopath/src/github.com/GoogleContainerTools/container-diff/out/container-diff [diff gcr.io/gcp-runtimes/metadata-base gcr.io/gcp-runtimes/metadata-modified --type=metadata --no-cache -j]
--- FAIL: TestDiffAndAnalysis/file_differ (0.28s)
integration_test.go:255: Error running command: Error running command [diff gcr.io/gcp-runtimes/diff-base gcr.io/gcp-runtimes/diff-modified --type=file --no-cache -j]: exit status 1 Stderr: 2019/08/20 16:36:02 Unable to read "/home/travis/.docker/config.json": open /home/travis/.docker/config.json: no such file or directory
2019/08/20 16:36:02 Unable to read "/home/travis/.docker/config.json": open /home/travis/.docker/config.json: no such file or directory
time="2019-08-20T16:36:03Z" level=error msg="error retrieving image gcr.io/gcp-runtimes/diff-modified: MANIFEST_UNKNOWN: Failed to fetch "latest" from request "/v2/gcp-runtimes/diff-modified/manifests/latest".\nerror retrieving image gcr.io/gcp-runtimes/diff-base: MANIFEST_UNKNOWN: Failed to fetch "latest" from request "/v2/gcp-runtimes/diff-base/manifests/latest"."
. Stderr:
integration_test.go:76: Running command: /home/travis/gopath/src/github.com/GoogleContainerTools/container-diff/out/container-diff [analyze gcr.io/gcp-runtimes/node-modified --type=node --no-cache -j]
--- PASS: TestDiffAndAnalysis/metadata_differ (2.38s)
integration_test.go:76: Running command: /home/travis/gopath/src/github.com/GoogleContainerTools/container-diff/out/container-diff [analyze gcr.io/gcp-runtimes/pip-modified --type=pip --no-cache -j]
--- PASS: TestDiffAndAnalysis/node_analysis (24.86s)
integration_test.go:76: Running command: /home/travis/gopath/src/github.com/GoogleContainerTools/container-diff/out/container-diff [analyze gcr.io/gcp-runtimes/diff-layer-base --type=sizelayer --no-cache -j]
--- FAIL: TestDiffAndAnalysis/size_layer_analysis (0.29s)
integration_test.go:255: Error running command: Error running command [analyze gcr.io/gcp-runtimes/diff-layer-base --type=sizelayer --no-cache -j]: exit status 1 Stderr: 2019/08/20 16:36:27 Unable to read "/home/travis/.docker/config.json": open /home/travis/.docker/config.json: no such file or directory
time="2019-08-20T16:36:28Z" level=error msg="error retrieving image gcr.io/gcp-runtimes/diff-layer-base: getting image layers: MANIFEST_UNKNOWN: Failed to fetch "latest" from request "/v2/gcp-runtimes/diff-layer-base/manifests/latest"."
. Stderr:
okay, when running locally I do not get the same issue with config.json, but the MANIFEST_UNKNOWN issue persists
--- FAIL: TestDiffAndAnalysis (0.00s)
integration_test.go:76: Running command: /usr/local/google/home/donmccasland/go/src/github.com/GoogleContainerTools/container-diff/out/container-diff [diff gcr.io/gcp-runtimes/diff-base gcr.io/gcp-runtimes/diff-modified --type=file --no-cache -j]
integration_test.go:76: Running command: /usr/local/google/home/donmccasland/go/src/github.com/GoogleContainerTools/container-diff/out/container-diff [diff gcr.io/gcp-runtimes/metadata-base gcr.io/gcp-runtimes/metadata-modified --type=metadata --no-cache -j]
integration_test.go:76: Running command: /usr/local/google/home/donmccasland/go/src/github.com/GoogleContainerTools/container-diff/out/container-diff [analyze gcr.io/gcp-runtimes/diff-base --type=size --no-cache -j]
integration_test.go:76: Running command: /usr/local/google/home/donmccasland/go/src/github.com/GoogleContainerTools/container-diff/out/container-diff [analyze gcr.io/gcp-runtimes/diff-layer-base --type=layer --no-cache -j]
--- FAIL: TestDiffAndAnalysis/file_differ (1.91s)
integration_test.go:255: Error running command: Error running command [diff gcr.io/gcp-runtimes/diff-base gcr.io/gcp-runtimes/diff-modified --type=file --no-cache -j]: exit status 1 Stderr: time="2019-08-20T10:10:15-07:00" level=error msg="error retrieving image gcr.io/gcp-runtimes/diff-modified: MANIFEST_UNKNOWN: Failed to fetch "latest" from request "/v2/gcp-runtimes/diff-modified/manifests/latest".\nerror retrieving image gcr.io/gcp-runtimes/diff-base: MANIFEST_UNKNOWN: Failed to fetch "latest" from request "/v2/gcp-runtimes/diff-base/manifests/latest"."
. Stderr:
integration_test.go:76: Running command: /usr/local/google/home/donmccasland/go/src/github.com/GoogleContainerTools/container-diff/out/container-diff [analyze gcr.io/gcp-runtimes/diff-modified --type=file -o --no-cache -j]
Okay, turns out that diff-base and diff-layer-base containers got erased in a cleanup of gcp-runtimes container registry. Now what actually needs to happen is Dockerfiles that will recreate all the containers we use for these tests.