Giters

microsoft / nn-Meter

A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Using NNI with nn-Meter

singagan opened this issue · comments

commented

Hi, seems like your ProxylessNAS example is not supported by NNI anymore as they have moved to a completely different backend (instead of retiarri). Please, do you have an updated example that works with the newer version?
https://github.com/microsoft/nni/blob/master/nni/nas/hub/pytorch/proxylessnas.py

Thanks.

commented

Thanks for raising this issue. Here is the latest version of Hardware-aware NAS, and nn-meter performs as a (profiler)[https://nni.readthedocs.io/en/latest/reference/nas.html#nni.nas.profiler.pytorch.nn_meter.NnMeterProfiler] in new architecture. You can try newer versions of NnMeterProfiler now. Notice that you should use the dev version of nn-Meter and NNI.

Thanks.
Jiahang

commented

Thanks a lot! I have two questions:

  1. Is it possible to add multiple objectives like both latency (using nn-meter) and model size which doing search with ProxylessNAS?
  2. Is there a significant difference between the new nni architecture and retiarrii for HW-aware NAS?
commented

Hi, thanks for your interests to NNI and nn-Meter. Let me defer to my colleague as the main maintainer of NNI NAS module to answer these questions. @ultmaster Thanks a lot Yuge!

commented
  1. You need a new (probably custom defined profiler).
  2. NNI NAS 3.0 is an upgraded version of Retiarii NAS. The old version is out-of-date and won't be maintained any more.