ScalefreeCOM / datavault4dbt

Scalefree's dbt package for a Data Vault 2.0 implementation congruent to the original Data Vault 2.0 definition by Dan Linstedt including the Staging Area, DV2.0 main entities, PITs and Snapshot Tables.

Home Page:https://www.scalefree.com/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Add Option to Filter Source Data in Stage macro

bschlottfeldt opened this issue · comments

Discussed in #105

Originally posted by MatthiasWendtB24 July 26, 2023
Hi Folks,
is there a simple solution, to filter the rows processed by the stage macro?

Thanks for your response,
Kind regards,
Matthias

#105 (comment) :

Originally posted by @bschlottfeldt September 13, 2023

Might be a good idea for enhancement: allow an optional parameter in the yaml metadata of the stage called filter_source_by and allow the user to add a statement as the input.
We can add this to the list of features to be developed for enhancement, but I can't give a timeline on when it will be done as we have other features in the pipeline.

Kind regards,
Barbara