ELS-RD / transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀

Home Page:https://els-rd.github.io/transformer-deploy/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

I faced with Stub process is unhealthy and it will be restarted.

OleksandrKorovii opened this issue · comments

I tried to implement token-classification task but faced a problem like:
{"error": "Failed to process the request(s) for model instance 'transformer_tensorrt_inference_0', message: Stub process is not healthy."}

For the model I used RobertaForTokenClassification fine-tuned on my own dataset. I build docker container from main.