duplicated output
retsys opened this issue · comments
Hello,
I'm running airflow-prometheus-exporter v1.0.8 in airflow v1.10.10
Seems to be a cartesian in the output.
Lines containing "airflow_dag_run_duration{dag_id=..." are repeated multiple times for each dag.
Seems to be one line for each dag run across all dags.
As in, airflow reports a total of y dag runs since it started if you sum up all dag runs from all dags.
Then there are y lines of "airflow_dag_run_duration{dag_id=..." in this output for each dag.
Lots of dags x lots of dag runs = lots of output and growing all the time.
Meaning scrape times are growing too.
Cheers
confirm that I also encountered the same issue.
We are running into this as well. When it runs for long enough, the result is that metrics take so long to return that we essentially lose our airflow metrics.
Same issue here!
I have a PR raised to fix this, but it seems that the owner of the repo is no longer active:
#25