raster-foundry / raster-foundry

The Raster Foundry web application.

Home Page:https://www.rasterfoundry.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Flaky Integration Tests

notthatbreezy opened this issue · comments

Problem description

One of the scope integration tests seems to be failing randomly and it's unclear why. The output usually looks something like:

[info] Policy simulation
[info] - reports expected failure when relevant scopes are excluded *** FAILED ***
[info]   TestFailedException was thrown during property evaluation. (ScopeSpec.scala:196)
[info]     Message: Left("body deserialization failed: sttp.client.HttpError, code: 401 body: Left(sttp.client.HttpError)") did not equal Right(SimResponse(false)) Authorization expectation failed: received Left(body deserialization failed: sttp.client.HttpError, code: 401 body: Left(sttp.client.HttpError)), expected false
[info]     Location: (ScopeSpec.scala:168)
[info]     Occurred at table row 0 (zero based, not counting headings), which had values (
[info]       Path = /api/datasources/,
[info]       Domain:Action = datasources:read,
[info]       Verb = get
[info]     )
[info] - reports expected success when relevant scopes are included
[info] Run completed in 10 seconds, 251 milliseconds.

Replication Steps

This is kind of random so the only way to reproduce is by running the integration tests and hoping this fails

Expected Behavior or Output

Tests do not fail randomly

Also, that's the first test (and it seems always to be that record in the CSV) so it's probably unrelated to that specific endpoint.