Flaky test on the CI
Angelmmiguel opened this issue · comments
Describe the bug
Recently, I added several end-to-end tests to ensure everything works fine on different platforms (Linux, MacOS and Windows). The tests already detected some issues when updating dependencies, so they are really useful.
However, the current e2e tests may fail due to race conditions. Certain examples like Ruby or Python requires more time to load the runtime before it's ready to run.
This is currently happening in some PRs when running the MacOS tests.
Reproduction steps
- Run the e2e tests with a low timeout:
E2E_WAITING_TIME=1 cargo test --test e2e -- --show-output
- Get an error in some tests due to the server not being ready
Expected behavior
The CI works consistently and it doesn't fail due to race conditions.
Additional context
No response