Giters

protectai / llm-guard

The Security Toolkit for LLM Interactions

Home Page:https://llm-guard.com/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Implement an API and give me the ability to deploy with docker.

9876691 opened this issue · comments

commented

When implementing an LLM pipeline I'm generally deploying to kubernetes.

Other parts of our pipeline are already containerized, for example unstructured has an API and they build a docker container.

So it would be nice if llm-guard also had a Docker file and an API that we can integrate with.

commented

Hey @ianpurton , thanks for contacting us and sharing the idea! It's in development actually and should be deployed this week. It will be a dockerized API using fastapi. I will update you once it's done.

commented

Hey @ianpurton , there is an update. API version is Live and there is Docker image available: https://llm-guard.com/usage/api/

Thanks for raising this :)