Regression Testing Tool
Run tests which cover your current changes only. All other tests are almost guaranteed to be green, just because you did not touch the code they test.
- Run just a few tests instead of the whole gigantic test suite without any downsides.
- Test framework, coverage format, platform agnostic.
- Ideal for massive refactoring.
- Checks if the coverage report is stale and throws a warning.
- Inspired by
--changed-sinceoption of JEST.
- Changed files/lines are extracted from git.
- Current test coverage report is provided via command line option.
- Finally, only relevant tests are run: those tests which cover the changed lines.
Of course, this is tool is not a replacement for classic full cycle of all tests during build time. Because there is an infinite amount of edge cases when this approach can lead to false positive results:
- configuration changes
- test environment changes
- fixture changes
- usage of
eval,rand, network, etc.
To be precise, Regrest detects all test-detectable software defects introduced by changes of "green" code from test coverage report. If the defect is introduced by some other changes (e.g. you messed up Dockerfile of some dependency), this tool cannot detect that.
- git as VCS
- fresh coverage report in a machine-readable format
- Make sure coverage report in PHP format
/path/to/coverage.phpis up-to-date. - Apply your changes to .php files in your project, as usual...
- Pass
regrestoutput to PHPUnit's--filteroption, so only covering current changes tests will be run, not all of them.
phpunit test ..your own phpunit options.. --filter=`docker run ivastly/regrest --changes-since=origin/master --coverage-file=/path/to/coverage.php --framework="phpunit"`# TODOTODO gif here
Framework | Coverage Format | Language | Support --- | --- | --- PHPUnit | PHPUnit .php | PHP | 🟢 Codeception | PHPUnit .php | PHP | 🟡
Contributions are welcome.
see LICENSE