chandreshsutariya / bigdata---train-analysis

batch processing and realtime tains(railway) data analysis to help Station Masters refreshing each 20 seconds

bigdata---train-analysis

batch processing and streaming app to analyse live trains(railway) data to help Station Masters refreshing each 20 seconds

Technologies used (highlevel)

Batch processing: pyspark, hadoop Stream processing: pyspark, kafka

how to run

please check the report.pdf