A simple Python harness to run an ONNX model in various concurrency and replication configurations against MLCommon's LoadGen to measure throughput.
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool