Yizhou Lu's starred repositories
Youku-mPLUG
Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks
patch_conv
Patch convolution to avoid large GPU memory usage of Conv2D
distrifuser
[CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models
gemma_pytorch
The official PyTorch implementation of Google's Gemma models
Awesome-Multimodal-Large-Language-Models
:sparkles::sparkles:Latest Advances on Multimodal Large Language Models
Long-Context
This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and benchmark tasks that evaluate a model’s information retrieval capabilities with context expansion. We also include key experimental results and instructions for reproducing and building on them.
llm-hallucination-survey
Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models"
audiocraft
Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.
Awesome-LLM
Awesome-LLM: a curated list of Large Language Model
Large-Audio-Models
Keep track of big models in audio domain, including speech, singing, music etc.
audio-ai-timeline
A timeline of the latest AI models for audio generation, starting in 2023!
FasterTransformer
Transformer related optimization, including BERT, GPT
tiny-training
On-Device Training Under 256KB Memory [NeurIPS'22]
CoFiPruning
[ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
public_talks
Materials of public talks given By SJTU X-LANCE members
retraining-free-pruning
[NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers
Speech-Backbones
This is the main repository of open-sourced speech technology by Huawei Noah's Ark Lab.