tests are incorrect: failures on profiled build
avieth opened this issue · comments
In a profiled build, the call stack information will be different from an unprofiled build, so a test fails.
Build profile: -w ghc-8.4.4 -O1
In order, the following will be built (use -v for more details):
- HUnit-1.6.0.0 (test:tests) --enable-profiling (first run)
Preprocessing test suite 'tests' for HUnit-1.6.0.0..
Building test suite 'tests' for HUnit-1.6.0.0..
Running 1 test suites...
Test suite tests: RUNNING...
Cases: 137 Tried: 0 Errors: 0 Failures: 0
Cases: 137 Tried: 1 Errors: 0 Failures: 0
Cases: 137 Tried: 2 Errors: 0 Failures: 0
Cases: 137 Tried: 3 Errors: 0 Failures: 0
Cases: 137 Tried: 4 Errors: 0 Failures: 0
Cases: 137 Tried: 5 Errors: 0 Failures: 0
Cases: 137 Tried: 6 Errors: 0 Failures: 0
Cases: 137 Tried: 7 Errors: 0 Failures: 0
Cases: 137 Tried: 8 Errors: 0 Failures: 0
Cases: 137 Tried: 9 Errors: 0 Failures: 0
Cases: 137 Tried: 10 Errors: 0 Failures: 0
Cases: 137 Tried: 11 Errors: 0 Failures: 0
Cases: 137 Tried: 12 Errors: 0 Failures: 0
Cases: 137 Tried: 13 Errors: 0 Failures: 0
Cases: 137 Tried: 14 Errors: 0 Failures: 0
Cases: 137 Tried: 15 Errors: 0 Failures: 0
Cases: 137 Tried: 16 Errors: 0 Failures: 0
Cases: 137 Tried: 17 Errors: 0 Failures: 0
Cases: 137 Tried: 18 Errors: 0 Failures: 0
Cases: 137 Tried: 19 Errors: 0 Failures: 0
Cases: 137 Tried: 20 Errors: 0 Failures: 0
Cases: 137 Tried: 21 Errors: 0 Failures: 0
Cases: 137 Tried: 22 Errors: 0 Failures: 0
Cases: 137 Tried: 23 Errors: 0 Failures: 0
Cases: 137 Tried: 24 Errors: 0 Failures: 0
Cases: 137 Tried: 25 Errors: 0 Failures: 0
Cases: 137 Tried: 26 Errors: 0 Failures: 0
Cases: 137 Tried: 27 Errors: 0 Failures: 0
Cases: 137 Tried: 28 Errors: 0 Failures: 0
Cases: 137 Tried: 29 Errors: 0 Failures: 0
Cases: 137 Tried: 30 Errors: 0 Failures: 0
Cases: 137 Tried: 31 Errors: 0 Failures: 0
Cases: 137 Tried: 32 Errors: 0 Failures: 0
Cases: 137 Tried: 33 Errors: 0 Failures: 0
Cases: 137 Tried: 34 Errors: 0 Failures: 0
Cases: 137 Tried: 35 Errors: 0 Failures: 0
Cases: 137 Tried: 36 Errors: 0 Failures: 0
Cases: 137 Tried: 37 Errors: 0 Failures: 0
Cases: 137 Tried: 38 Errors: 0 Failures: 0
Cases: 137 Tried: 39 Errors: 0 Failures: 0
Cases: 137 Tried: 40 Errors: 0 Failures: 0
Cases: 137 Tried: 41 Errors: 0 Failures: 0
Cases: 137 Tried: 42 Errors: 0 Failures: 0
Cases: 137 Tried: 43 Errors: 0 Failures: 0
Cases: 137 Tried: 44 Errors: 0 Failures: 0
Cases: 137 Tried: 45 Errors: 0 Failures: 0
Cases: 137 Tried: 46 Errors: 0 Failures: 0
Cases: 137 Tried: 47 Errors: 0 Failures: 0
Cases: 137 Tried: 48 Errors: 0 Failures: 0
Cases: 137 Tried: 49 Errors: 0 Failures: 0
Cases: 137 Tried: 50 Errors: 0 Failures: 0
Cases: 137 Tried: 51 Errors: 0 Failures: 0
Cases: 137 Tried: 52 Errors: 0 Failures: 0
Cases: 137 Tried: 53 Errors: 0 Failures: 0
Cases: 137 Tried: 54 Errors: 0 Failures: 0
Cases: 137 Tried: 55 Errors: 0 Failures: 0
Cases: 137 Tried: 56 Errors: 0 Failures: 0
Cases: 137 Tried: 57 Errors: 0 Failures: 0
Cases: 137 Tried: 58 Errors: 0 Failures: 0
Cases: 137 Tried: 59 Errors: 0 Failures: 0
Cases: 137 Tried: 60 Errors: 0 Failures: 0
Cases: 137 Tried: 61 Errors: 0 Failures: 0
Cases: 137 Tried: 62 Errors: 0 Failures: 0
Cases: 137 Tried: 63 Errors: 0 Failures: 0
Cases: 137 Tried: 64 Errors: 0 Failures: 0
Cases: 137 Tried: 65 Errors: 0 Failures: 0
Cases: 137 Tried: 66 Errors: 0 Failures: 0
Cases: 137 Tried: 67 Errors: 0 Failures: 0
Cases: 137 Tried: 68 Errors: 0 Failures: 0
Cases: 137 Tried: 69 Errors: 0 Failures: 0
Cases: 137 Tried: 70 Errors: 0 Failures: 0
Cases: 137 Tried: 71 Errors: 0 Failures: 0
Cases: 137 Tried: 72 Errors: 0 Failures: 0
Cases: 137 Tried: 73 Errors: 0 Failures: 0
Cases: 137 Tried: 74 Errors: 0 Failures: 0
Cases: 137 Tried: 75 Errors: 0 Failures: 0
Cases: 137 Tried: 76 Errors: 0 Failures: 0
Cases: 137 Tried: 77 Errors: 0 Failures: 0
Cases: 137 Tried: 78 Errors: 0 Failures: 0
Cases: 137 Tried: 79 Errors: 0 Failures: 0
Cases: 137 Tried: 80 Errors: 0 Failures: 0
Cases: 137 Tried: 81 Errors: 0 Failures: 0
Cases: 137 Tried: 82 Errors: 0 Failures: 0
Cases: 137 Tried: 83 Errors: 0 Failures: 0
Cases: 137 Tried: 84 Errors: 0 Failures: 0
Cases: 137 Tried: 85 Errors: 0 Failures: 0
Cases: 137 Tried: 86 Errors: 0 Failures: 0
Cases: 137 Tried: 87 Errors: 0 Failures: 0
Cases: 137 Tried: 88 Errors: 0 Failures: 0
Cases: 137 Tried: 89 Errors: 0 Failures: 0
Cases: 137 Tried: 90 Errors: 0 Failures: 0
Cases: 137 Tried: 91 Errors: 0 Failures: 0
Cases: 137 Tried: 92 Errors: 0 Failures: 0
Cases: 137 Tried: 93 Errors: 0 Failures: 0
Cases: 137 Tried: 94 Errors: 0 Failures: 0
Cases: 137 Tried: 95 Errors: 0 Failures: 0
Cases: 137 Tried: 96 Errors: 0 Failures: 0
Cases: 137 Tried: 97 Errors: 0 Failures: 0
Cases: 137 Tried: 98 Errors: 0 Failures: 0
Cases: 137 Tried: 99 Errors: 0 Failures: 0
Cases: 137 Tried: 100 Errors: 0 Failures: 0
Cases: 137 Tried: 101 Errors: 0 Failures: 0
Cases: 137 Tried: 102 Errors: 0 Failures: 0
Cases: 137 Tried: 103 Errors: 0 Failures: 0
Cases: 137 Tried: 104 Errors: 0 Failures: 0
Cases: 137 Tried: 105 Errors: 0 Failures: 0
Cases: 137 Tried: 106 Errors: 0 Failures: 0
Cases: 137 Tried: 107 Errors: 0 Failures: 0
Cases: 137 Tried: 108 Errors: 0 Failures: 0
Cases: 137 Tried: 109 Errors: 0 Failures: 0
Cases: 137 Tried: 110 Errors: 0 Failures: 0
Cases: 137 Tried: 111 Errors: 0 Failures: 0
Cases: 137 Tried: 112 Errors: 0 Failures: 0
Cases: 137 Tried: 113 Errors: 0 Failures: 0
Cases: 137 Tried: 114 Errors: 0 Failures: 0
Cases: 137 Tried: 115 Errors: 0 Failures: 0
Cases: 137 Tried: 116 Errors: 0 Failures: 0
Cases: 137 Tried: 117 Errors: 0 Failures: 0
Cases: 137 Tried: 118 Errors: 0 Failures: 0
Cases: 137 Tried: 119 Errors: 0 Failures: 0
Cases: 137 Tried: 120 Errors: 0 Failures: 0
Cases: 137 Tried: 121 Errors: 0 Failures: 0
Cases: 137 Tried: 122 Errors: 0 Failures: 0
Cases: 137 Tried: 123 Errors: 0 Failures: 0
Cases: 137 Tried: 124 Errors: 0 Failures: 0
Cases: 137 Tried: 125 Errors: 0 Failures: 0
Cases: 137 Tried: 126 Errors: 0 Failures: 0
Cases: 137 Tried: 127 Errors: 0 Failures: 0
### Failure in: 1:2:error
tests/HUnitTestBase.lhs:34
for the reports from a test,
expected: [Start (State {path = [], counts = Counts {cases = 1, tried = 0, errors = 0, failures = 0}}),Error "error\nCallStack (from HasCallStack):\n error, called at tests/HUnitTestExtended.hs:11:13 in main:HUnitTestExtended" (State {path = [], counts = Counts {cases = 1, tried = 1, errors = 1, failures = 0}})]
but got: [Start (State {path = [], counts = Counts {cases = 1, tried = 0, errors = 0, failures = 0}}),Error "error\nCallStack (from HasCallStack):\n error, called at tests/HUnitTestExtended.hs:11:13 in main:HUnitTestExtended\nCallStack (from -prof):\n HUnitTestExtended.errorCall (tests/HUnitTestExtended.hs:11:1-25)\n HUnitTestExtended.CAF (<entire-module>)" (State {path = [], counts = Counts {cases = 1, tried = 1, errors = 1, failures = 0}})]
Cases: 137 Tried: 128 Errors: 0 Failures: 1
Cases: 137 Tried: 129 Errors: 0 Failures: 1
Cases: 137 Tried: 130 Errors: 0 Failures: 1
Cases: 137 Tried: 131 Errors: 0 Failures: 1
Cases: 137 Tried: 132 Errors: 0 Failures: 1
Cases: 137 Tried: 133 Errors: 0 Failures: 1
Cases: 137 Tried: 134 Errors: 0 Failures: 1
Cases: 137 Tried: 135 Errors: 0 Failures: 1
Cases: 137 Tried: 136 Errors: 0 Failures: 1
Cases: 137 Tried: 137 Errors: 0 Failures: 1
Test suite tests: FAIL
@avieth Hey! Thanks for opening this PR!
If this is something you want to get fixed, then please go ahead and propose a solution in terms of code by opening a PR. Otherwise, this is a "won't fix".