Giters

robinhood / airflow-prometheus-exporter

Prometheus Exporter for Airflow

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Large memory spike when collecting metrics

jay-bhambhani opened this issue · comments

commented

Hi there! we've noticed when using the exporter that we have a significant jump in memory consumption when we add it to our airflow image. We understand that this is likely due to the amount of DB querying that the exporter is doing, but wanted to ask if we may have missed something here?

Screen Shot 2021-01-14 at 7 32 38 PM

@jpugliesi @devstein @bensenberner for visibility

commented

WE are also seeing the same issue , any workaround or suggestions would be greatly appreciated.

commented

Any updates on this? The exporter sidecar is using >8GB all the time. This shouldnt be the case for a container that should simply query the SQL backend.