There are 2 repositories under llm-ops topic.
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
AIConfig is a config-based framework to build generative AI applications.
Open-source alternative to Assistant's API with a managed backend for memory, RAG, tools and tasks. ~Supabase for building AI agents.
An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
Python SDK for running evaluations on LLM generated responses
Firebase for AI Agents: Open-source backend platform that puts powerful generative models at the core of your database. With managed memory and RAG capabilities, developers can easily build AI agents, enhance their apps with generative tables, and create magical UI experiences.
Friendli: the fastest serving engine for generative AI
Miscellaneous codes and writings for MLOps
Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring
The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.