microsoft / nn-Meter

A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

how to get all model to generate datasets on my device?

cosperypf opened this issue · comments

I want to generate my training dataset (including model and corresponding latency) on my own device, I have read the article here (https://github.com/microsoft/nn-Meter/blob/ffd51e32c31026896fe2bda198b49fe5d756f184/docs/dataset.md ), it mentioned there is no model files but only the structure(in .jsonl files) of these model, so I havn't find any way to get the delay data of these model files running on my device.

So how can I get these models?

For example, you mentioned in the article that "it requires hundreds of GB storage to store the full dataset", is it possible to store these data in the network disk and open for download, or is there any other way for me to get my own dataset, so that I can get valuable datasets for me, thanks very much!

I knew that I can generate kernel dataset just like here https://github.com/microsoft/nn-Meter/blob/ffd51e32c31026896fe2bda198b49fe5d756f184/docs/builder/build_kernel_latency_predictor.md, but this is not what I want, I want to get the datasets like here https://github.com/microsoft/nn-Meter/releases/download/v1.0-data/datasets.zip, but the latency should be on my device

I have the same question, I want to get the models in datasets.zip, and infer them by myself. How can I get the models?