blockchain-etl / ethereum-etl-postgres

ETL for moving Ethereum data to PostgreSQL database

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Unable to export contracts from BQ to GCS

whydna opened this issue · comments

 from `bigquery-public-data.crypto_ethereum.contracts`,'), '}') as function_sighashes,
'C:\Users\xxx\AppData\Local\Google\Cloud' is not recognized as an internal or external command,
operable program or batch file.
Exporting BigQuery table export_temp_dataset.flattened_contracts
Extracting export_temp_dataset.flattened_contracts to gs://ether-123/export_temp_dataset.flattened_contracts_raw/*.gz ...
BigQuery error in extract operation: Error processing job 'crypto-
developer:bqjob_r1030b112cfb90c68_0000018090afc78a_1': Not found: Table crypto-
developer:export_temp_dataset.flattened_contracts was not found in location US
Composing files in gs://ether-123export_temp_dataset.flattened_contracts_raw/ to gs://ether-123export_temp_dataset.flattened_contracts_composed/
Composing files in gs://ether-123export_temp_dataset.flattened_contracts_composed/ to gs://ether-123export_temp_dataset.flattened_contracts/
CommandException: 1 files/objects could not be removed.
CommandException: 1 files/objects could not be removed.
CommandException: No URLs matched: gs://ether-123/export_temp_dataset.flattened_contracts/*
CommandException: 1 file/object could not be transferred.

@bsh98, would appreciate if you could take a look

commented
 from `bigquery-public-data.crypto_ethereum.contracts`,'), '}') as function_sighashes,
'C:\Users\xxx\AppData\Local\Google\Cloud' is not recognized as an internal or external command,
operable program or batch file.
Exporting BigQuery table export_temp_dataset.flattened_contracts
Extracting export_temp_dataset.flattened_contracts to gs://ether-123/export_temp_dataset.flattened_contracts_raw/*.gz ...
BigQuery error in extract operation: Error processing job 'crypto-
developer:bqjob_r1030b112cfb90c68_0000018090afc78a_1': Not found: Table crypto-
developer:export_temp_dataset.flattened_contracts was not found in location US
Composing files in gs://ether-123export_temp_dataset.flattened_contracts_raw/ to gs://ether-123export_temp_dataset.flattened_contracts_composed/
Composing files in gs://ether-123export_temp_dataset.flattened_contracts_composed/ to gs://ether-123export_temp_dataset.flattened_contracts/
CommandException: 1 files/objects could not be removed.
CommandException: 1 files/objects could not be removed.
CommandException: No URLs matched: gs://ether-123/export_temp_dataset.flattened_contracts/*
CommandException: 1 file/object could not be transferred.

Thank you for pointing this out! It looks like the temp table for contracts isn't being created since the query is being truncated by a comment. The issue should be resolved in #13. Hope this helps.