HelloSongi's repositories
Spotify-Data-Pipeline
Routinely collects trending songs world and stores them to a storage pool. Utilizes various Microsoft Azure services(ADLS, ADF, Synapse Analysis, Azure Functions, Logic Apps), Spotify API
TikTok-Analytics-Aggregator
Collects Titktok profile data on demand. Created a web UI to interact with data collect. Leveraged Pandas, Pyspark, MongoDb, Flask, API
Spark-Structured-streaming-IoT-Weather-Sensors
A simulation to automatically collect weather data and visualize it on maps. Tech stack: Kafka, Spark Streaming, Cassandra, Tableau
Automation-and-Web-Scraping
Data extraction,data cleaning, data wrangling, Pandas, BeatifulSoup, Selenium, CSV, Excel, PDF, etc...
Cryptocurrency-Market-Data-Aggregator
A comprehensive data pipeline that aggregates cryptocurrency market data from multiple sources, processes the data, and stores it in a structured format for further analysis.
RustO---A-modern-and-efficient-operating-system
Designed and implemented RustOS, a cutting-edge operating system that demonstrates proficiency in systems programming and a deep understanding of low-level computing. This project aimed to combine the robustness of systems programming with the safety and expressiveness of the Rust programming language.