openlit / openlit

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. 📈🔥 Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. 🖥️

https://docs.openlit.io

[Feat]: Add OpenTelemetry instrumentation for Monitoring LLM Applications using Groq

patcher9 opened this issue a month ago · comments

patcher9 commented a month ago

🚀 What's the Problem?

OpenTelemetry Instrumentation for Monitoring Groq usage.

💡 Your Dream Solution

Similar OpenTelemetry Auto instrumentation for Groq as provided for monitoring other LLM stack like OpenAI and Pinecone

🤔 Seen anything similar?

NA

🖼️ Pictures or Drawings

NA

👐 Want to Help Make It Happen?

Yes, I'd like to volunteer and help out with this!