Giters

snowplow / dbt-snowplow-mobile

A fully incremental model, that transforms raw mobile event data generated by the Snowplow mobile trackers into a series of derived tables of varying levels of aggregation.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Optimize performance in Databricks for incremental models

emielver opened this issue · comments

commented

Describe the feature

We need to optimize performance in Databricks. We can leverage the optimizeWrite and optimizeCompact table properties in Databricks to achieve this, and we should focus on all incremental (Snowplow or otherwise) tables that are being generated from the Snowplow models.