bricks-cloud / BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

https://trybricks.ai/

More granular metrics

CrazyPython opened this issue 8 months ago · comments

CrazyPython commented 8 months ago

Per-user ID (user parameter in OpenAI)
Per-model

Spike Lu commented 4 months ago

we added support for these two fields which means that you can query data using userId and model as filters for /api/reporting/events API