openlit / openlit

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. πŸ“ˆπŸ”₯ Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. πŸ–₯️

Home Page:https://docs.openlit.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Feat]: Add OpenTelemetry instrumentation for Monitoring LLM Applications using Milvus

patcher9 opened this issue Β· comments

πŸš€ What's the Problem?

OpenTelemetry Instrumentation for Monitoring Milvus usage.

πŸ’‘ Your Dream Solution

Similar OpenTelemetry Auto instrumentation for Milvus as provided for monitoring other LLM stack like ChromaDB and Pinecone

πŸ€” Seen anything similar?

NA

πŸ–ΌοΈ Pictures or Drawings

NA

πŸ‘ Want to Help Make It Happen?

  • Yes, I'd like to volunteer and help out with this!