wwwcojp

promptbench

A unified evaluation framework for large language models

Custom-Rate-Limiter-API

awesome-ai-agents

A list of AI autonomous agents

Efficient-LLMs-Survey

[TMLR 2024] Efficient Large Language Models: A Survey

LLMCompiler

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

Pearl

A Production-ready Reinforcement Learning AI Agent Library brought by the Applied Reinforcement Learning team at Meta.

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

mamba

Mamba SSM architecture

TaskWeaver

A code-first agent framework for seamlessly planning and executing data analytics tasks.

ProAgent

An LLM-based Agent for the New Automation Paradigm - Agentic Process Automation

UltraEval

[ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.

Awesome-LLMs-in-Graph-tasks

A curated collection of research papers exploring the utilization of LLMs for graph-related tasks.

DB-GPT

An LLM Based Diagnosis System (https://arxiv.org/pdf/2312.01454.pdf)

draw-a-ui

Draw a mockup and generate html for it

exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

slidev

Presentation Slides for Developers

Transkribo

Speech-to-text using Whisper

biome

A toolchain for web projects, aimed to provide functionalities to maintain them. Biome offers formatter and linter, usable via CLI and LSP.

openai-log-helper-proxy

llmstep

llmstep: [L]LM proofstep suggestions in Lean 4.

math-lm

dspy

DSPy: The framework for programming—not prompting—foundation models

OpenAgents

OpenAgents: An Open Platform for Language Agents in the Wild

ManimML

ManimML is a project focused on providing animations and visualizations of common machine learning concepts with the Manim Community Library.

OpenPipe

Turn expensive prompts into cheap fine-tuned models

litellm

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

data-juicer

A one-stop data processing system to make data higher-quality, juicier, and more digestible for LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大语言模型提供更高质量、更丰富、更易”消化“的数据！

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

LLMLingua

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.