Santosh Gouda's repositories
airflow-dags
Airflow DAG code for all projects.
Airflow2.0-De-0-a-Heroe
Repositorio para realizar el curso en Udemy llamado "Airflow2.0 De 0 a Héroe", de la academia "Datapath".
airflow_sandbox_template
Airflow basic and general functionalities to get started on airflow
alaska-etl
ETL webscraping pipeline to compare NWS forecasts for Alaska against USCRN weather data. Python, Airflow, SQL, BigQuery. Currently migrating to Cloud Functions and Cloud Scheduler.
Apache-Airflow-Training
Airflow Training A to Z
audiophile
This project is an end-to-end extract, load, and transform (ELT) pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes the data for use in a Metabase dashboard.
AutomateReporting
Automate Excel Reporting
BigQuery
My BigQuery projects
DBT_Data_Transformation_Validation
the objective of this project is to implement data transformations and validation using DBT
DS_Algos
Practice code for the Data Structure and Algorithms
dw_etl_airfow_example
Example Of Data Warehouse pipeline with Airflow
elt_sales
A data pipeline that extracts, loads and transform sales data from a mysql db to posstgres db. The workflow management is orchestrated using apache airflow.
job-data-pipeline
My data engineering project
MUST_HAVE_SKILLS
This repo consists of all important concepts for data engineers.
Practice-SQL-problems-in-Spark
Solving SQL Interview SQL question in Pyspark and SQL
python-gcp-101
This is a small data engineering project using python, mysql, mongodb, airflow, docker and gcp services.
Retailstore_ETL_pipeline_project
Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and transforms the raw data (ETL process) using Apache spark to meet business requirements and also enables Data Analyst create Data Visualization using Superset. Airflow is used to orchestrate the pipeline
stockprice-predictions
The Stock Price Prediction web app powered by AWS, Snowflake, Python, Snowpark and Streamlit