ishaan-jaff

litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

litellm-test3

openai-proxy-4

anthropic-cookbook

A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.

Auto-GPT

An experimental open-source attempt to make GPT-4 fully autonomous.

autoevals

AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.

bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

chainlit

Build Conversational AI in minutes ⚡️

ChatFred

Alfred workflow using ChatGPT, DALL·E 2 and other models for chatting, image generation and more.

cookbook

dify-docs

The open-source repo for docs.dify.ai

docs

FastEval

Fast evaluation of chat language models. Includes leaderboard.

fiddler-auditor

Fiddler Auditor is a tool to evaluate language models.

FlowiseDocs

Docs for Flowise

GPT-Fathom

GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well as OpenAI's earlier models on 20+ curated benchmarks under aligned settings.

groq-api-cookbook

langchainjs

🦜🔗 Build context-aware reasoning applications 🦜🔗

LibreChat

Enhanced ChatGPT Clone: Features OpenAI, GPT-4 Vision, Bing, Anthropic, OpenRouter, PaLM 2, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. More features in development

llm_rules

RuLES: a benchmark for evaluating rule-following in language models

LLMeBench

Benchmarking Large Language Models

llmperf

LLMPerf is a library for validating and benchmarking LLMs

LLMZoo

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

logfire

Uncomplicated Observability for Python and beyond! 🪵🔥

LongBench

LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding

openai-proxy2

openinference

Auto-Instrumentation for AI Observability

presidio

Context aware, pluggable and customizable data protection and de-identification SDK for text and images

rbot

rbot is an AI assistant and chatbot developed by Rajiv Pant

susi_shell

This suite of tools enables users to interact with AI services directly from their terminal.