ishaan-jaff

autogen

Enable Next-Gen Large Language Model Applications. Join our Discord: https://discord.gg/pAbnFJrkgZ

litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

litellm-test3

openai-proxy-4

postgresml

The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models.

Auto-GPT

An experimental open-source attempt to make GPT-4 fully autonomous.

autoevals

AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.

bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

ChatFred

Alfred workflow using ChatGPT, DALL·E 2 and other models for chatting, image generation and more.

evalplus

EvalPlus for rigourous evaluation of LLM-synthesized code

FastAPI

FastEval

Fast evaluation of chat language models. Includes leaderboard.

fiddler-auditor

Fiddler Auditor is a tool to evaluate language models.

GPT-Fathom

GPT-Fathom is an open-source and reproducible LLM evaluation suite, benchmarking 10+ leading open-source and closed-source LLMs as well as OpenAI's earlier models on 20+ curated benchmarks under aligned settings.

LibreChat

Enhanced ChatGPT Clone: Features OpenAI, GPT-4 Vision, Bing, Anthropic, OpenRouter, PaLM 2, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. More features in development

litellm-CodeGen-server

llama_index

LlamaIndex (GPT Index) is a data framework for your LLM applications

llm_rules

RuLES: a benchmark for evaluating rule-following in language models

LLMeBench

Benchmarking Large Language Models

llmperf

LLMPerf is a library for validating and benchmarking LLMs

LLMZoo

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

LongBench

LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding

MemGPT

Teaching LLMs memory management for unbounded context 📚🦙

openai-proxy2

rbot

rbot is an AI assistant and chatbot developed by Rajiv Pant

susi_shell

This suite of tools enables users to interact with AI services directly from their terminal.

swirl-search

Swirl is open-source software that uses AI to simultaneously search multiple content and data sources and return AI ranked results which can be used to prompt Generative AI, enabling you to get answers based on your own data.

test-proxy

test-proxy2

vocode-python

🤖 Build voice-based LLM agents. Modular + open source.