openlit / openlit

OpenLIT: Complete Observability and Evals for the Entire GenAI Stack, from LLMs to GPUs. Improve your LLM apps from playground to production πŸ“ˆ. Supports 20+ monitoring integrations like OpenAI & LangChain. Collect and Send GPU performance, costs, tokens, user activity, LLM traces and metrics to any OpenTelemetry endpoint in just one line of code.

Home Page:https://docs.openlit.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Feat]: Support Cost Monitoring for fine-tuned LLM Models

patcher99 opened this issue Β· comments

πŸš€ What's the Problem?

Fine tuned models cannot be calculated currently in Doku

πŸ’‘ Your Dream Solution

Show costs even for fine-tuned models

πŸ€” Seen anything similar?

NA

πŸ–ΌοΈ Pictures or Drawings

NA

πŸ‘ Want to Help Make It Happen?

  • Yes, I'd like to volunteer and help out with this!