Yiming Liu's repositories
llm.c
LLM training in simple, raw C/CUDA
Lumina-T2X
Lumina-T2X is a unified framework for Text to Any Modality Generation
Open-Sora
Open-Sora: Democratizing Efficient Video Production for All
sglang
SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
triton
Development repository for the Triton language and compiler
VILA
VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)
cambrian
Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
CogVLM
a state-of-the-art-level open visual language model | 多模态预训练模型
ComfyUI
A powerful and modular stable diffusion GUI with a graph/nodes interface.
ComfyUI-AnimateDiff-Evolved
Improved AnimateDiff for ComfyUI
CUDALibrarySamples
CUDA Library Samples
cutlass
CUDA Templates for Linear Algebra Subroutines
EAGLE
Official Implementation of EAGLE-1 and EAGLE-2
flash-attention
Fast and memory-efficient exact attention
hivemind
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
lilianweng.github.io
My personal page
llama_index
LlamaIndex (formerly GPT Index) is a data framework for your LLM applications
Megatron-LM
Ongoing research training transformer models at scale
mem0
The memory layer for Personalized AI
mergekit
Tools for merging pretrained large language models.
minbpe
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
Open-Sora-Plan
This project aim to reproducing Sora (Open AI T2V model), but we only have limited resource. We deeply wish the all open source community can contribute to this project.
pykan
Kolmogorov Arnold Networks
ring-attention-pytorch
Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
Spec-Bench
Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
TensorRT-Model-Optimizer
TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization and sparsity. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs