dbt-labs / dbt-core

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

Home Page:https://getdbt.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Feature] Add new global flag `--no-write-manifest`

sanromeo opened this issue · comments

Is this your first time submitting a feature request?

  • I have read the expectations for open source contributors
  • I have searched the existing issues, and I could not find an existing issue for this feature
  • I am requesting a straightforward extension of existing dbt functionality, rather than a Big Idea better suited to a discussion

Describe the feature

When running dbt build commands in Airflow in parallel, Stale File Handle error messages appear in the logs, the reason for this is the overwriting of manifest.json for each dbt build run

I would like to be able to disable the manifest rewrite when running the dbt build command and use the generated manifest at the beginning when running the dbt parse command.

--no-write-json is not suitable for this, because I want to get run_results.json for future use in Datahub or Elementary

Describe alternatives you've considered

No response

Who will this benefit?

Users of DBT Programmatic Invocation

Are you interested in contributing this feature?

No response

Anything else?

No response