jnkroeker / elixir-of-data

A data processing pipeline using Elixir and Flow

DataPipeline

Description

Implementation of the data processing pipeline with Elixir tutorial provided here:

https://semaphoreci.com/blog/data-pipelines-elixir?utm_source=Blog+Newsletter&utm_campaign=14212ebe0f-EMAIL_CAMPAIGN_MAR_16_2023&utm_medium=email&utm_term=0_2c1357b8be-14212ebe0f-116468936

This project could be extended or modified for any data processing project.

The primary objective of completing this tutorial at this time is understanding the trade offs with other systems.

Installation

If available in Hex, the package can be installed by adding data_pipeline to your list of dependencies in mix.exs:

def deps do
  [
    {:data_pipeline, "~> 0.1.0"}
  ]
end

Documentation can be generated with ExDoc and published on HexDocs. Once published, the docs can be found at https://hexdocs.pm/data_pipeline.