The report does not show the total number of tests ran
VictorAlmeidaTR opened this issue · comments
Describe the bug
The report does not show the total number of tests ran.
For example:
In the photos I attached, I ran a total of 485 tests, but in the report it only shows 435 tests
To Reproduce
Steps to reproduce the behavior:
- Run all tests and compare number ran tests with report
Expected behavior
To show all tests in Report, in Version 2.35.2 works.
in version 2.40.0 not works
Environment (please complete the following information):
- Cypress version: 12.14.0
- OS: Linux
** Developer Tools Console Output **
Additional context
Add any other context about the problem here.
checking the git actions log, I found this error, I don't know if it was related
This only happens in this version, several tests simply do not appear in the report, even if they have been executed.
In the git actions repository a value appears and in the report another appears
LOG:
2023-06-15T22:41:21.2543217Z [30148:0615/224121.252897:ERROR:ssl_client_socket_impl.cc(983)] handshake failed; returned -1, SSL error code 1, net_error -101
2023-06-15T22:41:44.1801091Z �[32m ✓�[0m�[90m MUNICIPAL --> BAURU --> OBRIGACOES - Meio Magnetico - VALIDADOR ISS.WEB (cypress/e2e/municipal/bauru/obrigacoes/obrigacoes.spec.ts)�[0m�[31m (183123ms)�[0m
2023-06-15T22:41:46.2571403Z
I have the same problem, several tests are not appearing in the report. I've run them multiple times, and the result keeps changing. With each execution, different tests are not being reported.
My solution was to roll back the dependency to 2.35.2.
I'm analyzing the log more thoroughly, but I can't find a pattern among the failures. Even in debug mode, the log doesn't give me a more specific exception.
The only thing I've noticed is that it takes more than 450 executed tests for the problem to occur
I have encountered the same issue, but seems to be related with @cypress/grep. My project comprises multiple sites, and I rely on tags to execute tests for each specific site. Typically, I use two tags for each site, namely "[all]" and "[theSiteName]".
However, the problem I'm facing is that the test report is displaying only the tests with the "[theSiteName]" tag, completely omitting the ones with the site-specific tag "[all]".