utkuozdemir / nvidia_gpu_exporter

Nvidia GPU exporter for prometheus using nvidia-smi binary

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Running nvidia-smi multiple time is causing to hanging for GPU

eypklyc opened this issue · comments

Hello, Thank you for the great work.

First of all this not a bug report! It's related with Nvidia drivers and I'm just informing.. The story is,
We are using tool for a while. After last nvidia update unfortunately we are facing some troubles. No problem with the newer GPU's but the old ones hanging after calling nvidia-smi. Is anyone faced this weird problem in these days?

GPU: RTX Titan, driver version 450.80.02 and kernel is modules/5.4.0-124-generic

Hi, thank you for using the tool and for the information.

I haven't heard about this issue until now. I'll keep this issue open for a while so that it has some visibility. In the meantime, if you have new findings, they are the most welcome.

I think it is time to close this one. Feel free to share if you have some findings.