jack139 / multinfer

Go实现多模型推理和api服务

测试

编译

make

启动 dispatcher

LD_LIBRARY_PATH=/usr/local/lib64:/usr/local/lib build/multinfer server 0

启动 http

LD_LIBRARY_PATH=/usr/local/lib64:/usr/local/lib build/multinfer http

启动 demo

cd demo
python3 app.py

测试脚本

python3 test_api.py 127.0.0.1 ner _