functional tests occasionally failing
gkc opened this issue Ā· comments
Describe the bug
Seeing messages like this in logs
SEVERE|2023-07-05 19:04:35.767602|LocalSecondary (@aliceš )|exception in llookup:Could not read value from box. Maybe your box is corrupted.
For example in this PR, test run 1 failed but test run 2 succeeded (but can still see the warnings about hive box maybe being corrupted even though the test run succeeded).
Suspect there is a race condition with how and when the hive boxes are being cleaned up / recreated in the functional test pack
Steps to reproduce
run the functional tests
Expected behavior
functional tests should pass or fail consistently
Setting to P0 because (a) worrying messages are worrying (b) happens frequently, which means it is a big thief of time