Adding the ability to override scheduling parameters on backfill
braunreyes opened this issue · comments
Currently the query backfill
command only supports {{ds}}
as a submission_date:DATE:
scheduling parameter. However, it is possible for folks to add more complex logic for the normal bqetl runs.
We need to backfill this table for a fill range of days, which means we do not need this custom logic for submission date. Given the way it is currently written, it seems as though providing the ability to completely override the list of parameters at backfill runtime is the best solution.
If the new flag is used, then scheduling parameters will be completely overridden. This will not be a 'merge' of parameters.
┆Issue is synchronized with this Jira Task