wm901115nwpu

ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

jax

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

generative-models

Generative Models by Stability AI

mlx

MLX: An array framework for Apple silicon

Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

yolov9

Implementation of paper - YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information

text-generation-inference

Large Language Model Text Generation Inference

guided-diffusion

gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.

trlx

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

DiffSinger

DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (SVS & TTS); AAAI 2022; Official code

alignment-handbook

Robust recipes to align language models with human and AI preferences

LLaMA2-Accessory

An Open-source Toolkit for LLM Development

Qwen-Agent

Agent framework and applications built upon Qwen1.5, featuring Function Calling, Code Interpreter, RAG, and Chrome extension.

GaLore

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

OpenDiT

OpenDiT: An Easy, Fast and Memory-Efficient System for DiT Training and Inference

LlamaEdge

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

tensorrtllm_backend

The Triton TensorRT-LLM Backend

flash-linear-attention

Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton

SoraReview

The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models".

ring-flash-attention

Ring attention implementation with flash attention

piecewise-rectified-flow

LLM_MultiAgents_Survey_Papers

Large Language Model based Multi-Agents: A Survey of Progress and Challenges

OCR_ICDAR_label_revise

BitDelta

self-speculative-decoding

Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**

fp6_llm

An efficient GPU support for LLM inference with 6-bit quantization (FP6).

flash-linear-rnn

Implementations of various linear RNN layers using pytorch and triton

QLLM

[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"

ComPEFT