kibae / onnxruntime-server

ONNX Runtime Server: The ONNX Runtime Server is a server that provides TCP and HTTP/HTTPS REST APIs for ONNX inference.

Repository from Github https://github.comkibae/onnxruntime-server

kibae/onnxruntime-server Issues

ONNX model outputs an array of null
Updated a month ago5
Error "tried creating tensor with negative value in shape"
Updated 2 months ago9
Feature request: Provide support for concurrent HTTP requests
Closed 2 months ago9
Feature request: Add options for post inference work e.g. Softmax
Updated 2 months ago1
Explore/implement a faster JSON library
Updated 2 months ago1
Threadpool query and performance tweaking
Updated 2 months ago
can't create a session
Closed 2 months ago6
Logging query - single POST shows as 3 entries in log
Closed 2 months ago2
OAI dynamic address and port
Closed 2 months ago2
Any hints on how to use the TCP API?
Updated 3 months ago2
From cv2.Mat to image
Updated 6 months ago2
How can I send an image data when requesting an Execute session?
Updated 6 months ago8
What mean model version
Closed 6 months ago1
v1.2.1 compile error
Closed a year ago9