Blockchain ETL

ethereum-etl

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

bitcoin-etl

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

ethereum-etl-airflow

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

public-datasets

The list of public blockchain datasets in BigQuery

ethereum-etl-postgres

ETL for moving Ethereum data to PostgreSQL database

polygon-etl

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

ethereum2-etl

Python scripts for ETL (extract, transform and load) jobs for Ethereum 2.0 beacon blocks, attestations, deposits, slashings, validators, committees. Data is available in Google BigQuery

ethers.js-bigquery

ethers.js library, compiled for use in Google BigQuery

solana-etl-airflow

ETL for Solana. Contributions are welcome. Join the Telegram channel https://t.me/joinchat/GsMpbA3mv1OJ6YMp3T5ORQ

tezos-etl

Python scripts for ETL (extract, transform and load) jobs for Tezos blocks, balance updates, and operations

hedera-etl

ETL scripts for Hedera Hashgraph

eos-etl

ETL scripts for EOS.

solana-etl

abi-functions

blockchain-etl-dataflow

Dataflow pipelines for Blockchain ETL. Connects Pub/Sub topics with BigQuery tables.

abi-parser

Web app which parses smart contracts and outputs queries and tables for Ethereum-ETL

awesome-etl-tools

Awesome ETL tools for blockchain data

blockchain-terraform-deployment

Template repository for deploying https://github.com/blockchain-etl/blockchain-terraform

etl-rust

abi

EVM public good - pull requests welcome for any ABI from any EVM

band-etl

ETL (extract, transform and load) tools for ingesting Band Protocol blockchain data to Google BigQuery and Pub/Sub

blockchain-etl-common

Common utils for blockchain-etl

iotex-etl

ETL (extract, transform and load) tools for ingesting IoTeX blockchain data to Google BigQuery and Pub/Sub

ordinals-etl

docker-bitcoind

💰 Bitcoind Docker image that runs the Bitcoin node in a container for easy deployment

twitter-bot-cloud-function

Google Cloud Function for tweeting Blockchain ETL alerts

zilliqa-etl

Python scripts for ETL (extract, transform and load) jobs for Zilliqa blockchain data

tezos-etl-airflow

Airflow DAGs for exporting and loading the Tezos blockchain data to Google BigQuery

throttle-pubsub-cloud-function

Google Cloud Function that can throttle messages in a Pub/Sub topic

pubsub-to-firestore-cloud-function

Google Cloud Function that pulls messages from Pub/Sub and saves them in Firestore