openlit / openlit

OpenLIT: Complete Observability and Evals for the Entire GenAI Stack, from LLMs to GPUs. Improve your LLM apps from playground to production 📈. Supports 20+ monitoring integrations like OpenAI & LangChain. Collect and Send GPU performance, costs, tokens, user activity, LLM traces and metrics to any OpenTelemetry endpoint in just one line of code.

https://docs.openlit.io

[Feat]: Add OpenTelemetry instrumentation for Monitoring LLM Applications using Vertex AI

patcher9 opened this issue 3 months ago · comments

patcher9 commented 3 months ago

🚀 What's the Problem?

OpenTelemetry Instrumentation for Monitoring Vertex AI usage.

💡 Your Dream Solution

Similar OpenTelemetry Auto instrumentation for Vertex AI as provided for monitoring other LLM stack like OpenAI and Pinecone

🤔 Seen anything similar?

NA

🖼️ Pictures or Drawings

NA

👐 Want to Help Make It Happen?

Yes, I'd like to volunteer and help out with this!