llm-ops

There are 2 repositories under llm-ops topic.

bentoml / OpenLLM
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
llm llmops model-inference falcon fine-tuning stablelm llm-serving llama mpt vicuna bentoml llama2 llm-inference llm-ops open-source-llm openllm ai mistral ml mlops
Language:Python 9021
cognita
truefoundry / cognita
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
ai deep-learning generative-ai llmops machine-learning mlops model-deployment python rag retrieval-augmented-generation typescript agent application data fine-tuning framework llm llm-ops
Language:Python 2009
aiconfig
lastmile-ai / aiconfig
AIConfig is a config-based framework to build generative AI applications.
ai developer-tools generative-ai llm llm-ops
Language:Python 869
astronomer / ask-astro
An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
airflow astronomer llm llm-ops
Language:Python 160
athina-ai / athina-evals
Python SDK for running evaluations on LLM generated responses
evaluation evaluation-framework evaluation-metrics llm-eval llm-evaluation llm-evaluation-toolkit llm-ops llmops
Language:Python 140
friendliai / friendli-client
Friendli: the fastest serving engine for generative AI
generative-ai llm llm-inference llmops serving gpt gpt3 inference llama2 llm-serving llms inference-engine inference-server ai llm-ops mistral ml mlops stable-diffusion
Language:Python 37
YeonwooSung / MLOps
Miscellaneous codes and writings for MLOps
ai ai-as-a-service aws llm llm-inference llm-ops ml-serving mlops multimodal bentoml triton-inference-server apache-iceberg data-intensive-applications docker kubernetes spark spark-nlp rag vector-database vectordb
Language:Jupyter Notebook 4
AndrMoura / streamlit-chatbot-analytics
Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring
analytics chatbot chatbot-application chatbots langchain llama3 llm llm-ops ollama streamlit llm-observability
Language:Python 3
langgenius / dify-conversation
[🚧🚧🚧WIP🚧🚧 🚧]Rework of webapp-conversation
llm-ops
Language:TypeScript 1