Fatima Shehab's repositories
Data-Insight-Engine
Data Insight Engine System is a comprehensive data analytics tool that helps users collect, analyze, and display data in a straightforward and interactive manner, aiding them in making informed decisions.
data-platform
Data Platform Analytics System is a comprehensive data anlytics tool that helps users collect, analyze, and display data in a straightforward and interactive manner, aiding them in making informed decisions.
data-pulse-web-scraper
A web scraping Flask API that collects product data from a given URL and stores it in Google Cloud Storage (GCS). The project includes robust error handling and various utility functions to extract specific elements from the HTML content.
data-pulse-pipeline
The Data Pulse pipeline processes and transforms web-scraped pageviews using Apache Beam and Google Cloud Dataflow. It reads JSON lines, parses them into PageView objects, filters for "product" post types, enriches with country info, and writes to Google BigQuery. Robust logging and error handling ensure data integrity