dbt-labs / dbt-audit-helper

Useful macros when performing data audits

Home Page:https://hub.getdbt.com/dbt-labs/audit_helper/latest/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

BigQuery compare_queries should materialize temporary tables for large queries

graciegoheen opened this issue · comments

Describe the feature

A clear and concise description of what you want to happen.

Right now, when you use compare_queries in BQ you may hit BQ limits for view definition. The work around is to materialize those queries as tables, then use the compare_relations macro.

Instead, compare_queries should materialize the queries as temporary tables in BQ, perform the comparison, then drop the tables.

Describe alternatives you've considered

A clear and concise description of any alternative solutions or features you've considered.

Additional context

Is this feature database-specific? Which database(s) is/are relevant? Please include any other relevant context here.

This is specific to BigQuery.

Who will this benefit?

What kind of use case will this feature be useful for? Please be specific and provide examples, this will help us prioritize properly.

Are you interested in contributing this feature?

This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please comment on the issue or else it will be closed in 7 days.

Although we are closing this issue as stale, it's not gone forever. Issues can be reopened if there is renewed community interest. Just add a comment to notify the maintainers.