jina-ai / langchain-serve

⚡ Langchain apps in production using Jina & FastAPI

Home Page:https://cloud.jina.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Feature Request] HuggingFace Agents as a service

danny-avila opened this issue · comments

@danny-avila do you want to use transformers agents with the model hosted via huggingface inference endpoint, or are looking for langchain-serve to host the model in addition to the agent?

The former. HF Agents has a unique way of chaining that I think would be awesome to have the option to serve. Also I’ve tested langchain with HF inference models and seems there’s a lack of support for a lot of it

We'll look into implementing this next week @danny-avila

Amazing, thanks for the quick reply and great work with this project!