phospho's repositories
fastassert
Dockerized LLM inference server with constrained output (JSON mode), built on top of vLLM and outlines. Faster, cheaper and without rate limits. Compare the quality and latency to your current LLM API provider.
knowledgeable-agent
This is an exemple of an agent you can deploy using phospho. It will answer questions based on the knowledge it has in the document you provided it.
agent-basic-chatgpt
This is an exemple of a basic agent behaving like chatGPT, that can be deployed on phospho.
agent-template
This a template of an agent that can be deployed to phospho. The project is in Alpha, expect frequent updates.
phospho-ui-react
React components to leverage user feedbacks and phospho logging
events-demo
A demo of phospho event detection for text and chat messages