jakeprem / valkyrie

Validates data messages in a pipeline are normalized to an expected standard

Valkyrie

Validates data by evaluating each message and verifying that it has the required fields as specified by the SmartCity.Dataset.Technical.schema Valid messages will be produced to the next topic, and invalid or bad messages will be sent to a dead letter queue.

Setup

• Run mix deps.get to install dependencies

To run the tests

• Run mix test to run the tests a single time
• Run mix test.watch to re-run the tests when a file changes
• Run mix test.watch --stale to only rerun the tests for modules that have changes
• Run mix test.integration to run the integration tests

To run inside a container(from the root directory):

• docker build . -t <image_name:tag>