Repository for DAG's used in Garudata Data Platform Project
get-and-save-weather-data
: Download weather data from Open-Meteo and save the files into S3 bucketextract-weather-data-from-json
: Extract and transform the data in the JSON files and store in the PostgreSQL database for reporting
TODO:
- Auto deploy to Airflow
- Test DAG's before deployment