Giters

openlit / openlit

OpenLIT: Complete Observability and Evals for the Entire GenAI Stack, from LLMs to GPUs. Improve your LLM apps from playground to production 📈. Supports 20+ monitoring integrations like OpenAI & LangChain. Collect and Send GPU performance, costs, tokens, user activity, LLM traces and metrics to any OpenTelemetry endpoint in just one line of code.

Home Page:https://docs.openlit.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Feat]: Add Monitoring Integration for LiteLLM framework

patcher99 opened this issue · comments

commented

🚀 What's the Problem?

Currently we support LLM Observability integration when directly using official SDKs. LiteLLM is a popular choice when to use giving a unified usage for any LLM Model

💡 Your Dream Solution

Similar setup as OpenAI Observability, Build a LLM Observability integration for LangChain

🤔 Seen anything similar?

NA

🖼️ Pictures or Drawings

NA

👐 Want to Help Make It Happen?

  • Yes, I'd like to volunteer and help out with this!