arkady-emelyanov / toy-data-platform

Toy data platform for a company that provides web analytics

apache-beam flink-stream-processing terraform golang apache-druid apache-kafka spark-stream-kafka redash helm fasthttp web-analytics message-bus

Toy Data Platform

Toy data platform for a company that provides web analytics.

Status

Work in progress.

Technology stack

Edge service: Go
Simulation service: Go
Message Bus: Apache Kafka
Stream processing: Apache Beam @ Java
- Target: Apache Flink
- Target: Apache Spark
OLAP backend: Apache Druid
Dashboards and exploratory: Redash
Core platform management: Terraform
Applications management: Helm

About

Toy data platform for a company that provides web analytics

apache-beam flink-stream-processing terraform golang apache-druid apache-kafka spark-stream-kafka redash helm fasthttp web-analytics message-bus

MIT License

Languages

Language:HCL 63.0%Language:Java 15.0%Language:Go 11.2%Language:Shell 5.7%Language:Smarty 3.6%Language:Dockerfile 0.8%Language:Makefile 0.6%