blockchain-etl / iotex-etl

ETL (extract, transform and load) tools for ingesting IoTeX blockchain data to Google BigQuery and Pub/Sub

https://console.cloud.google.com/bigquery?page=dataset&d=crypto_iotex&p=public-data-finance

blockchain-etl/iotex-etl Issues

Add field descriptions to schema files
Closed 4 years ago1
Create Source Repository to hold Dataflow chainConfig.json file
Closed 4 years ago1
Add Configuration section in README for streaming
Closed 4 years ago
Change instance type from custom-2-4096 to n1-standard-1 in streaming
Closed 4 years ago
Cloud Build config for deploying Airflow variables
Closed 4 years ago
Setup travis script for running Dataflow tests
Closed 4 years ago
Add task to verify_streaming DAG that checks that mainnet.errors table is empty
Closed 4 years ago
Move iotex-etl cli files to the cli subfolder
Closed 4 years ago
Add verify streaming DAG
Closed 4 years ago
Update type of bytes fields in blocks to BYTES
Closed 4 years ago
producer_pubkey should be rename to producer in blocks
Closed 4 years ago