Test Suites
Setup
Inside the simplecalc directory, run mvn test. You should see test results. You can inspect the resulting files produced by the surefire plugin, in target/superfire-reports.
Stepping one directory back up from the simplecalc directory, run npm install, then node main.js.
You should see the printout of the test suite file:
{ name: 'testSum', time: '0.004', status: 'passed' }
{ name: 'testSlow', time: '0.007', status: 'passed' }
{ name: 'testFlaky', time: '10.715', status: 'passed' }
{ name: 'testMinus', time: '0.005', status: 'failed' }
{ name: 'testDivide', time: '0', status: 'passed' }
{ name: 'testDivideWillThrowExceptionWhenDivideOnZero',
time: '0.001',
status: 'passed' }
Tasks
For the workshop, we will perform two tasks: 1) prioritization tests cases by print out in sorted order, and 2) automatically find the flaky test.
Test prioritization
Print a ranked list of the test cases based on test to execute and test faiilure.
Flaky tests
One of the tests is flaky. Extend the code to run mvn test several times (10--20), and each run, collection statistics about failing and passing tests. See if you can calculate a "flakyness" score for each test case.