Hins

llama.cpp

LLM inference in C/C++

LLaMA-Factory

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

autogen

A programming framework for agentic AI 🤖

Langchain-Chatchat

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

babyagi

MoneyPrinterTurbo

利用AI大模型，一键生成高清短视频 Generate short videos with one click using AI LLM.

generative_agents

Generative Agents: Interactive Simulacra of Human Behavior

Llama-Chinese

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

mamba

Mamba SSM architecture

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

falcon

The no-magic web data plane API and microservices framework for Python developers, with a focus on reliability, correctness, and performance at scale.

embedchain

Memory for AI agents

re2

RE2 is a fast, safe, thread-friendly alternative to backtracking regular expression engines like those used in PCRE, Perl, and Python. It is a C++ library.

xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

streaming-llm

[ICLR 2024] Efficient Streaming Language Models with Attention Sinks

InternLM

Official release of InternLM2.5 base and chat models. 1M context support

agentscope

Start building LLM-empowered multi-agent applications in an easier way.

ReAgent

A platform for Reasoning systems (Reinforcement Learning, Contextual Bandits, etc.)

LongLoRA

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

InternLM-XComposer

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

promptbench

A unified evaluation framework for large language models

LLM-eval-survey

The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

KwaiAgents

A generalized information-seeking agent system with Large Language Models (LLMs).

SwissArmyTransformer

SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.

BMInf

Efficient Inference for Big Models

rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

SwiftInfer

Efficient AI Inference & Serving

InterfaceTest

接口自动化测试框架，Python脚本，可与Jenkins持续集成系统结合。

websocket-benchmarker

Benchmark a WebSocket server's message throughput ⌛