This is example code which is a companion to the Medium article, Zrah, that describes an automated system that:
- runs a suite of tests several times to reduce the effects of a fragile test system to find truly failing tests
- suppresses the failing tests
- creates a new commit and Github pull request that silences the failing test
Fork this repo and run the following commands from a directory where you store your repos:
git clone git@github.com:REPLACE-WITH-YOUR-GITHUB-USERNAME/medium-post-fragile-tests.git
cd medium-post-fragile-tests
git remote add lyndsey git@github.com:lyndsey-ferguson/medium-post-fragile-tests.git
gem install bundler
bundle installCreate a new Github token here and save it as ~/.github-token.
Run the sample code from the Terminal in this cloned repo:
bundle exec fastlane sweep
Observe as the tests run with one consistently failing test. The fastlane sweep lane will run the tests 3 times, suppress the truly failing tests, make a new commit, and issue a pull request against the main repo.
Use this code sample to add improved logic to your build and test system. Feel free to ask questions or make comments in the Medium post or add Issues to this repo.
Thanks for reading and I hope that you enjoyed it!