Trangle

mxnet

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.

caffe

Caffe: a fast framework for deep learning. For the most recent version checkout the dev branch. For the latest stable release checkout the master branch.

minerva

Minerva: a fast and flexible tool for deep learning. It provides ndarray programming interface, just like Numpy. Python bindings and C++ bindings are both available. The resulting code can be run on CPU or GPU. Multi-GPU support is very easy. Please refer to the examples to see how multi-GPU setting is used.

Noah-s-ark

protobuf

Protocol Buffers - Google's data interchange format

trl

Train transformer language models with reinforcement learning.

AIApps

test

alpaca_eval

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

awesome-pretrained-chinese-nlp-models

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

axolotl

Go ahead and axolotl questions

DeepCTR

Easy-to-use,Modular and Extendible package of deep-learning based CTR models .

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

dify

One API for plugins and datasets, one interface for prompt engineering and visual operation, all for creating powerful AI applications.

EQ-Bench

A benchmark for emotional intelligence in large language models

FastGPT

FastGPT is a knowledge-based question answering system based on the LLM language model, providing out-of-the-box capabilities for data processing, model invocation, and more. It also allows for complex question answering scenarios through visual workflow orchestration using Flow!

flashinfer

FlashInfer: Kernel Library for LLM Serving

goagent

a gae proxy

kubernetes

Container Cluster Manager

LLM-Blender

[ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the diverse strengths of multiple open-source LLMs. LLM-Blender cut the weaknesses through ranking and integrate the strengths through fusing generation to enhance the capability of LLMs.

one-api

OpenAI 接口管理 & 分发系统，支持 Azure、Anthropic Claude、Google PaLM 2、智谱 ChatGLM、百度文心一言、讯飞星火认知以及阿里通义千问，可用于二次分发管理 key，仅单可执行文件，已打包好 Docker 镜像，一键部署，开箱即用. OpenAI key management & redistribution system, using a single API for all LLMs, and features an English UI.

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

PiPPy

Pipeline Parallelism for PyTorch

pubmed-mapper

PubMed Mapper: A Python library that map PubMed XML to Python object

qmk_firmware

Open-source keyboard firmware for Atmel AVR and Arm USB families

sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with LLMs faster and more controllable.

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

webapp-conversation

webapp-text-generator