Fszta / Spark-Toolbox

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Spark toolbox & training exercices

  • Exercice 1 : Write batch DF to kafka topic
  • Exercice 2 : Read batch DF from kafka topic
  • Exercice 3 : Structured Streaming - Read json formated data from kafka & write df to kafka
  • Exercice 4 : DStream - RDD from textfile
  • Exercice 5 : DStream - RDD from kafka json
  • Exercice 6 : Structured Streaming - Read logs from kafka - write processed logs to kafka

About


Languages

Language:Scala 90.0%Language:Dockerfile 5.4%Language:Shell 4.7%