dimfeld / chronicle

LLM Proxy

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

chronicle

Chronicle is a proxy for language model API calls which

  • Provides retries and optionally falls back to other providers on a failed call
  • Records each call in a database, and sends OpenTelemetry events
  • Lets you switch model provider APIs without changing your request format.
  • Supports both SQLite and PostgreSQL databases
  • Comes with a drop-in fetch function that will redirect OpenAI SDK calls to Chronicle instead.

See the roadmap for the current status and other notes.

About

LLM Proxy

License:Apache License 2.0


Languages

Language:Rust 86.6%Language:TypeScript 12.2%Language:Shell 0.7%Language:Dockerfile 0.4%Language:Just 0.1%