Dynamic analysis data in BigQuery is not being updated.
calebbrown opened this issue · comments
The BigQuery loader job is taking longer than 6 hours to complete and is timing out.
This is preventing new data from appear in BigQuery.
The amount of data in Google Cloud Storage has likely now exceeding the amount that can be loaded in a single BigQuery load job using WRITE_TRUNCATE.
An alternative approach that can be done incrementally or in shards needs to be built.
This is now feeding in daily.