Saugat Awale's repositories
Airflow-to-Kafka-to-PySpark-to-Cassandra
An End to End Containerised Data Engineering Pipeline Project. The source of truth is https://randomuser.me/ where the airflow DAG requests users' data, streams it into Kafka clusters; PySpark then consumes the data from Kafka broker and then inserts it into Cassadra DB
kafka-spark
A sample kafka-spark connector project
Language:Python000
000
AI-ML
Implementation of AI/ML algorithms. So far there is one file which uses Convolutional Neural Networks to classify dogs and cats images using deep computer vision technique.
Language:Jupyter Notebook000
Data_Analysis
Simple python scripts for data analysis
portfolio
A codebase to the portfolio exhibiting various projects
Language:CSS000
Language:TypeScript000
Language:JavaScript000