Giters

Crunch-io / nightwatch-vrt

Visual Regression Testing tools for nightwatch.js

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

nightwatch-vrt causes silent failures when running in parallel with --retries

digitalresistor opened this issue · comments

commented

When running night watch with multiple parallel works, and --retries=3 I get the following output:

OK. 1093  total assertions passed. (2m 49s)
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

If I run it instead without --retries=3 I get the following (expected) output:

_________________________________________________

 TEST FAILURE:  1 assertions failed, 1116 passed. (2m 35s)

 ✖ analyze/analyze-small-tables-stretch

   - Small Tables don't strecth (18.587s)
   Visual regression test results for element <.xtab-table>.  - expected "true" but got: "/Users/xistence/Projects/Crunch/swoosh/vrt/diff/analyze/analyze-small-tables-stretch/.xtab-table.png"
       at F.Small Tables don't strecth.browser.selectFirstProjectNamed.dsListSelectFirstDatasetNamed.goto.assert.variableCardPresent.goto.toggleTable.dragVariableToDropZone.waitForNewTable.perform (/Users/xistence/Projects/Crunch/swoosh/e2e/tests/analyze/analyze-small-tables-stretch.js:23:29)