Shelex / cypress-allure-plugin

cypress plugin to use allure reporter api in tests

Home Page:https://shelex.github.io/cypress-allure-plugin-example/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Cypress Allure report shows a count of failed test cases that is less than the actual count.

nthallap opened this issue · comments

Describe the bug
When I run several Cypress test cases(50 test cases) around 20 test cases are failing.
When i check cypress allure reports, It will show total count and failed test count less than actual.

It happens occasionally. Sometimes no reports are generated.

To Reproduce
Steps to reproduce the behavior:

  1. Run Cypess test cases, in that some test should fail

Expected behavior
Total test cases count and failed test cases count in the allure reports should match with terminal output after execution.

Environment (please complete the following information):

  • Cypress version: 12.14.0
  • shelex/cypress-allure-plugin 2.40.0
  • OS: Windows | Linux (centos):

** Developer Tools Console Output **

image

Additional context
In the above scenario total test cases 51, passed 11 failed 35, skipped 2,
but showing as below

image

Hi All, any one checked on this issue ?

Hi @nthallap!

There could be various reasons for that, and most common - when tests have same names accross suites then other test case is calculated as a retry in allure. Would be nice to check allure-results folder to check if recorded information is fine and no tests are missing. Or just try https://github.com/Shelex/cypress-allure-plugin?tab=readme-ov-file#debugging for writer task to check that all information is written to allure-results.