Linjiahua

DRL

Deep Reinforcement Learning

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

or-tools

Google's Operations Research tools:

simbert

a bert for retrieval and generation

open-interpreter

A natural language interface for computers

MetaGPT

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

jvector

JVector: the most advanced embedded vector search engine

tts-vue

🎤 微软语音合成工具，使用 Electron + Vue + ElementPlus + Vite 构建。

modelscope-agent

ModelScope-Agent: An agent framework connecting models in ModelScope with the world

wonderful-prompts

🔥中文 prompt 精选🔥，ChatGPT 使用指南，提升 ChatGPT 可玩性和可用性！🚀

Mr.-Ranedeer-AI-Tutor

A GPT-4 AI Tutor Prompt for customizable personalized learning experiences.

Novel-GPT

基于自回归模型与现有的开源大模型，训练小说大模型

WanJuan1.0

万卷1.0多模态语料

awesome-chatgpt-prompts-zh

ChatGPT 中文调教指南。各种场景使用指南。学习怎么让它听你的话。

Baichuan2

A series of large language models developed by Baichuan Intelligent Technology

llama.cpp

LLM inference in C/C++

text-generation-inference

Large Language Model Text Generation Inference

OpenBuddy

Open Multilingual Chatbot for Everyone

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

OpenLLM

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

langflow

⛓️ Langflow is a visual framework for building multi-agent and RAG applications. It's open-source, Python-powered, fully customizable, model and vector store agnostic.

LargeLanguageModel-and-GPT-4-ResourceMap

XVERSE-13B

XVERSE-13B: A multilingual large language model developed by XVERSE Technology Inc.

llm-action

本项目旨在分享大模型相关技术原理以及实战经验。