liuyhwangyh

FasterTransformer

Transformer related optimization, including BERT, GPT

xFasterTransformer

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

udlbook

Understanding Deep Learning - Simon J.D. Prince

dash-cookbook

Receipts for creating AI Applications with APIs from DashScope (and friends)!

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

lm-evaluation-harness

A framework for few-shot evaluation of language models.

Docker-OSX

Run macOS VM in a Docker! Run near native OSX-KVM in Docker! X11 Forwarding! CI/CD for OS X Security Research! Docker mac Containers.

GPTs

leaked prompts of GPTs

llama2.c

Inference Llama 2 in one file of pure C

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

x-transformers

A simple but complete full-attention transformer with a set of promising experimental features from various papers

llm-continuous-batching-benchmarks

modelscope-agent

ModelScope-Agent: An agent framework connecting models in ModelScope with the world

latent-consistency-model

Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference

velox

A C++ vectorized database acceleration library aimed to optimizing query engines and data processing systems.

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

Gymnasium

An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

LLMSurvey

The official GitHub page for the survey paper "A Survey of Large Language Models".

google-maps-services-java

Java client library for Google Maps API Web Services

pipreqs

pipreqs - Generate pip requirements.txt file based on imports of any project. Looking for maintainers to move this project forward.

baselines

OpenAI Baselines: high-quality implementations of reinforcement learning algorithms

ggml

Tensor library for machine learning

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

seamless_communication

Foundational Models for State-of-the-Art Speech and Text Translation

crun

A fast and lightweight fully featured OCI runtime and C library for running containers

audiocraft

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

swift

ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 40+ MLLMs. (Qwen2, GLM4, Internlm2, Yi, Llama3, Llava, MiniCPM-V, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)