does this support BigQuery?

Question

does this support BigQuery?

darrenhaken opened this issue 5 years ago · comments

Darren Haken commented 5 years ago

Andrej Blaha commented 5 years ago

+1 for BQ

Drew Banin · Answer 1 · Mon Aug 19 2019 21:08:05 GMT+0800 (China Standard Time)

Hey @darrenhaken - I think this should work, but this package is probably not a good paradigm for BQ. While really none of the databases that dbt supports are intended to receive many small insert statements, BigQuery in particular has limits around how many times an insert can be run against a table in a given day.

We have a draft PR that will batch insert all of these stats at the end of the run - I think that might be a long-term better approach here.

Claire Carroll · Answer 2 · Thu Feb 27 2020 00:54:11 GMT+0800 (China Standard Time)

A reminder to myself: The v0.2.0 release introduces further problems for BQ: there is an assumption that target.user exists, and that's never the case for BQ users