There are 0 repository under data-piplines topic.
Orbital automates integration between data sources (APIs, Databases, Queues and Functions). BFF's, API Composition and ETL pipelines that adapt as your specs change.
Open-source metadata collector based on ODD Specification
Wharfie is an experimental table-oriented data application framework built ontop of AWS Athena.
This Airflow DAG processes and transforms orders data from an S3 bucket to a Snowflake data warehouse. The pipeline cleans, enriches, and merges the data to create a reporting-ready dataset.
In this repository, exploratory data analysis was performed on the ESG risk variable particularly temperature, precipitation and wildfire datasets downloaded from Copernicus website.