Elsayed91

Islam Elsayed's repositories

taxi-data-pipeline

Automated data & MLOps pipeline leveraging Kubernetes and Apache Airflow. Integrates Spark, Kafka, and DBT with a focus on data quality. Tailors solutions for diverse user needs.

Language:Python400

easy_ge

Simplified Data Validation and Quality Testing with Great Expectations

Language:PythonMIT200

100-days-of-code

Fork this template for the 100 days journal - to keep yourself accountable (multiple languages available)

000

easy_expectations

Simplified Data Validation and Quality Testing with Great Expectations

Language:Python000

oot

Order Of The Template - a Python toolkit to parse YAML files and Jinja templates, resolve environment variables, and validate JSON schemas

Language:PythonMIT010

Efficiently groups Parquet files based on their schema, allowing for the detection of schema inconsistencies between files on different filesystems. Achieves high efficiency by reading metadata without loading entire files.

Language:PythonMIT000

xbox_de_project

Automated data-driven project leveraging Python, Airflow, and GKE. Scrapes diverse data sources, providing insights into Xbox hardware and software data.

Language:Python000