Giters

chandnipatelTW / twdu2b

Streaming Data Pipeline for twdu2b

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

streaming-data-pipeline

Streaming pipeline repo for data engineering training program

See producers and consumers set up README in their respective directories

local environment setup

Make sure you have sbt installed. Make sure you have docker installed.

Run ./sbin/buildAndRunLocal.sh to create Docker containers for running and testing this setup on your local machine

About

Streaming Data Pipeline for twdu2b

Languages

Language:Scala 59.5%Language:Shell 26.6%Language:Java 11.5%Language:Dockerfile 1.8%Language:Python 0.7%