Deep Thakkar's repositories
deepthakkar007
Config files for my GitHub profile.
practical-data-engineering
Practical Data Engineering: A Hands-On Real-Estate Project Guide
Data-Engineering-Projects
Personal Data Engineering Projects
website
Redash homepage and Knowledge Base
HashtagCashtag
My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on lambda architecture, that aggregates Twitter and US stock market data for user sentiment analysis using open source tools - Apache Kafka for data ingestions, Apache Spark & Spark Streaming for batch & real-time processing,
postgres-kafka-demo
Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog post published on Medium.
DataPipelineDockerSpark
Creating a pipeline with Python, Docker, Spark and Presto
WebCrawlerForOnlineInflation
Price Crawler - Tracking Price Inflation