KlimaDAO / data-pipelines

Data extraction and processing pipelines to power KlimaDAO products

KlimaDAO/data-pipelines Issues

Add pipeline that ingests Puro project data into Sanity CMS
Updated 5 months ago
Add pipeline that ingests ICR project data into the Sanity CMS
Updated 5 months ago
Improve algortihms that compute tokens retirements and bridges per credit
Updated 6 months ago
Update dependencies
Updated 7 months ago
Remove the workaround to fix memory issues when prefect support Pedantic2
Updated 9 months ago
Fix random crashes
Closed 9 months ago
Improve performance by downloading only new data from subgraphs
Updated a year ago
Add retries on data fetching tasks
Closed a year ago
Add a move to production section in the README
Closed a year ago
Migrate to new subgraphs
Updated a year ago
Replace calls to test subgraphs
Closed a year ago
Latests carbon assets prices with high frequency updates
Closed a year ago
Add raw extraction for other datasets
Closed a year ago1
Store data in feather format
Closed a year ago
[content enrichment] Import enhanced project description to Sanity
Closed a year ago1
The way we pass secrets to customize does not work on newer versions of kustomize
Closed a year ago1
Rolling history
Closed a year ago3
Add simple validations to the Verra CSV data
Closed a year ago1
Initial Prefect setup and simple pipeline for Verra registry source data extraction
Closed a year ago