Giters

openlit / openlit

OpenLIT: Complete Observability and Evals for the Entire GenAI Stack, from LLMs to GPUs. Improve your LLM apps from playground to production 📈. Supports 20+ monitoring integrations like OpenAI & LangChain. Collect and Send GPU performance, costs, tokens, user activity, LLM traces and metrics to any OpenTelemetry endpoint in just one line of code.

Home Page:https://docs.openlit.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Feat]: Support Tracing for RAG based Applications

patcher99 opened this issue · comments

commented

🚀 What's the Problem?

Currently for direct use of OpenAI and similar models, We are able to gather metrics. But when using a RAG based approach in our LLM Applications, We don't get a full overview of the steps taken by the model

💡 Your Dream Solution

DokuMetry SDK has a flag for collecting OpenTelemetry based Traces and spans

🤔 Seen anything similar?

OpenTelemetry libraries already support tracing and these can be visualised easily in any of the observability tools.

🖼️ Pictures or Drawings

NA

👐 Want to Help Make It Happen?

  • Yes, I'd like to volunteer and help out with this!