Weerapat Promwijit's repositories
The-Retail-ELT-Pipeline-End-To-End
This project designs and implements an ETL pipeline using Apache Airflow (Docker Compose) to ingest, process, and store retail data. AWS S3 acts as the data lake, AWS Redshift as the data warehouse, and Looker Studio for visualization. [Data Engineer]
Apache_Airflow_Basic
This repository offers an easy-to-follow guide on Apache Airflow, explaining the basics of creating, running, and managing data pipelines. [Data Engineer]
Apache_Kafka_Basic
This repository provides a fundamental understanding of Apache Kafka, including its core components, basic Python scripts to demonstrate how to create topics, produce messages, and consume messages, as well as a docker-compose.yml file for easy setup. [Data Engineer]
ETLpython_Oracle
ETL from couchDB to Oracle using python [Data Engineer]
UserInsight-Streaming-Data-Pipeline
UserInsight-Streaming-Data-Pipeline is a real-time pipeline that ingests API data into Kafka, processes it with Spark, stores it in S3, and uses AWS Lambda to load it into Redshift. The data is then used to create a dashboard in Looker. [Data Engineer]
VGG16_Transfer_Learning_PyTorch
This project utilizes transfer learning with the VGG16 model to perform classification tasks on a custom dataset. [AI Engineer]
mikecerton
repositpry for my profile
Traditional_ML-by-scikit-learn
Applying traditional machine learning techniques using the Scikit-learn library.
YoloV1_PyTorch_Scratch
YoloV1 from scratch using pytorch