evals

There are 0 repository under evals topic.

• langfuse

  langfuse / langfuse

  🪢 Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

  analyticsevalsevaluationgptlangchainlarge-language-modelsllama-indexllmllm-evaluationllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
  Language:TypeScript 4058

• AgentOps-AI / agentops

  Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen

  agentagentopsaievalsevaluation-metricsllmanthropicautogencost-estimationcrewaigroqlangchainmistralollamaopenai
  Language:Python 842

• nstankov-bg / oaievals-collector

  The OAIEvals Collector: A robust, Go-based metric collector for EVALS data. Supports Kafka, Elastic, Loki, InfluxDB, TimescaleDB integrations, and containerized deployment with Docker. Streamlines OAI-Evals data management efficiently with a low barrier of entry!

  chatgptdevopsdockergoopenaievals
  Language:Go 3

• zeus-fyi / mockingbird

  Mockingbird Front End Code | Zeus + SciFi = Power of the gods (cloud + ai | Zeus) Meets the power of SciFi (human ingenuity | SfYi) At the intersection of intelligent design (systems engineering excellence) For your intelligence —ZeusFYI.

  aicontrolevalsreactredux
  Language:TypeScript 2

• gokayfem / dspy-ollama-colab

  dspy with ollama and llamacpp on google colab

  agentscolab-notebookdspyevalsevaluationllamacppllmollamavlm
  Language:Jupyter Notebook 1

• openlayer-ai / templates

  Our curated collection of templates. Use these patterns to set up your AI projects for evaluation with Openlayer.

  aievalsexamples
  Language:Python 1

• noah-art3mis / crucible

  Develop better LLM apps by testing different models and prompts in bulk.

  evalsllmaiprompt-engineering
  Language:Python