w3c / did-test-suite

W3C DID Test Suite and Implementation Report

Home Page:https://w3c.github.io/did-test-suite/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Different test results for test-suite server

BernhardFuchs opened this issue · comments

When we run the docker image and send a request to /test-suite-manager/generate-report endpoint we get different results than running the testsuite locally with npm run test.

E.g did-bba does not throw any error in a local run but has quiet some failed testcases when run against the testsuite server https://github.com/decentralized-identity/universal-resolver/blob/6c030b5510ce0fff4a76abb42c6cec3492361c72/driver-status-reports/nightly-run-2021-07-08_00:08:01/did-test-suite-report-2021-07-08T00:09:34.json#L12

The instance producing these files is deployed at https://did-test-suite.uniresolver.io/test-suite-manager/generate-report and uses the latest image of the test-suite (build locallay with docker build).