FelixKleineBoesing / StockData

Education project for the use of kafka, spark and cloud ml integration. Perhaps intzegrate elasticsearch as well.

Stock Data End-to-End Demo project

Purpose

Building a project from online course knowledge about Kafka, Spark and Cloud Integration.

Setup

1. Download the S&P 500 dataset from kaggle.
2. Unzip the file and put the csv file into python/data

ToDos

1. Add python container that posts the postgres configurations to connect container as soon as the port is responding
2. create streams in ksql with ksql client