Kafka Tests Fail
tsmarsh opened this issue · comments
There is a intermittent / persistent bug that causes the kafka tests to fail.
We've tried backoffs / delays. But sometimes it seems it just doesn't want to get out of bed. Locally, the presents as failing on the first run, then passing IMMEDIATELY afterwards (sometimes on the third run... rarer). This seems to be tied to the configuration of the the TestContainer.
Think we fixed it. Added retry in the right places. Mostly I think it was a race condition between the producer and the consumer. Now both retry if they're surprised by the current state.