yoreei / LPC-Flink

IMPRO-DBPRO-WS19-20-Tutorial

This tutorial requires:

• Java 8.0, Apache Maven 3.6.0, one IDE (Eclipse, IntelliJ)
• Download the tutorial

Exercises:

• BatchJob: Transactions data analysis

DataSet transformations: https://ci.apache.org/projects/flink/flink-docs-release-1.9/dev/stream/operators/

• StreamJob: Time series data analysis

DataStream transformations: https://ci.apache.org/projects/flink/flink-docs-release-1.9/dev/stream/operators/

Useful links:

Stream examples (Apache Flink github repo)

https://github.com/apache/flink/tree/master/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples

Batch examples (Apache Flink github repo)

https://github.com/apache/flink/tree/master/flink-examples/flink-examples-batch/src/main/java/org/apache/flink/examples/java

Influx vizualisation

https://www.ververica.com/blog/robust-stream-processing-flink-walkthrough

https://www.youtube.com/watch?v=fstKKxvY23c&feature=youtu.be

https://github.com/dataArtisans/oscon

Kafka-Influx-Grafana vizualisation

https://github.com/antonrud/flink-kafka-influx-grafana-framework

Grafana vizualisation

https://github.com/dataArtisans/flink-streaming-demo