JSON output

[Jongwook Choi]

JSON output

[Jongwook Choi]

Partly included in v0.3.0

[Kaiyu Shi]

When the json output is stable, maybe we can detach the data collecting module and display module. Then we can request GPU usages from different remote data collecting nodes via HTTP or something else.

[Jongwook Choi]

Exactly, I am hoping to decouple them so that we can collect and display GPU usages from different machines. Working on these, so stay tuned :-)

[Ruben Vereecken]

Any news on this? Wouldn't mind giving a helping hand.

[Kaiyu Shi]

I'd like to recommend an NVML binding for Python to collect GPU information rather than nvidia-smi. This library would significantly simplify the code base for information gathering.

https://github.com/jonsafari/nvidia-ml-py

[Jongwook Choi]

@Stonesjtu Quite agree with you. It provides more information, and we could turn gpustat into a human-friendly wrapper with cleaner abstraction, providing monitoring functionalities as well. For JSON output formats, I plan to make it fully compatible with a XML format from nvidia-smi -q -x.

[Kaiyu Shi]

I'm trying to move the nvidia-smi API to nvidia-ml-py

Update: you may like to review my PR #17

[Alexandre Bury]

JSON output is a great feature!

A few notes on the current implementation:

• Fields with a dot (like utilization.gpu) make them harder to use in many JSON clients (like jq).
• Numeric fields could use numeric values instead of strings

[Kaiyu Shi]

@gyscos I think fileds with dot can be naturally organized into sub-dict. e.g.

{
'utilization': 
  {
  'gpu': 40,
  'memory': 30,
  }
}

[Jongwook Choi]

I plan to make a few of breaking changes towards 1.0, such as units and use of numerical values.

[Ceyda Cinarel (재이다)]

would it be possible to get driver_version and cuda_version (if available) in the json output?

[Jongwook Choi]

@cceyda driver version has been added into the JSON output.

However, cuda version isn't something gpustat cannot retrieve from querying nvidia driver. The cuda runtime may vary by applications and dynamic libraries being loaded. Please refer to https://stackoverflow.com/questions/9727688/how-to-get-the-cuda-version for how to get the cuda version.

[Jongwook Choi]

There won't be breaking changes in the units (e.g. MB vs bytes) but later we will add a flag/option to specify the units or to customize the JSON schema.