openlit / openlit

OpenLIT is an open-source LLM Observability tool built on OpenTelemetry. πŸ“ˆπŸ”₯ Monitor GPU performance, LLM traces with input and output metadata, and metrics like cost, tokens, and user interactions along with complete APM for LLM Apps. πŸ–₯️

Home Page:https://docs.openlit.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Feat]: Add Monitoring Integration for Amazon Bedrock

patcher9 opened this issue Β· comments

πŸš€ What's the Problem?

Users using Amazon Bedrock to call their base models like Claude currently cannot access monitor their LLM Applications properly using OpenLIT

πŸ’‘ Your Dream Solution

Add a OpenTelemetry native Auto instrumentation for Amazon Bedrock usage via boto3

πŸ€” Seen anything similar?

NA

πŸ–ΌοΈ Pictures or Drawings

NA

πŸ‘ Want to Help Make It Happen?

  • Yes, I'd like to volunteer and help out with this!