There are 105 repositories under etl topic.
An orchestration platform for the development, production, and observation of data assets.
Fancy stream processing made operationally mundane
The open source high performance ELT framework powered by Apache Arrow
Privacy and Security focused Segment-alternative, in Golang and React
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ
Quadratic | Data Science Spreadsheet with Python & SQL
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
Actively curated list of awesome BI tools. PRs welcome!
A curated list with resources about node-based UIs
đź”® Instill Core is an open-source no-/low-code data, AI, and pipelines orchestration platform
A lightweight stream processing library for Go
Sync data between persistence engines, like ETL only not stodgy
Implementing best practices for PySpark ETL jobs and applications.
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
This repository is a getting started guide to Singer.
Efficient data transformation and modeling framework that is backwards compatible with dbt.
The best place to learn data engineering. Built and maintained by the data engineering community.
Logical Replication extension for PostgreSQL 15, 14, 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgrades.