Different test results for test-suite server
BernhardFuchs opened this issue · comments
When we run the docker image and send a request to /test-suite-manager/generate-report
endpoint we get different results than running the testsuite locally with npm run test
.
E.g did-bba
does not throw any error in a local run but has quiet some failed testcases when run against the testsuite server https://github.com/decentralized-identity/universal-resolver/blob/6c030b5510ce0fff4a76abb42c6cec3492361c72/driver-status-reports/nightly-run-2021-07-08_00:08:01/did-test-suite-report-2021-07-08T00:09:34.json#L12
The instance producing these files is deployed at https://did-test-suite.uniresolver.io/test-suite-manager/generate-report and uses the latest image of the test-suite (build locallay with docker build
).