Giters

wadhah101 / big-data-project

A big data processing pipeline for a school project

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

hadoopkafkamongodb

big-data-project

A big data pipeline that distrubtes incoming logs from log collection tools ( Elastic Beats ) and saves them real time in mongodb and hdfs using kafka as message broker

Diagram

diagram

About

A big data processing pipeline for a school project

hadoopkafkamongodb

Languages

Language:Java 73.5%Language:Dockerfile 14.4%Language:Python 10.5%Language:Shell 1.6%