Zhenrui's starred repositories
Ask-Anything
[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
fsdp_qlora
Training LLMs with QLoRA + FSDP
llm-rankers
Zero-shot Document Ranking with Large Language Models.
TokenReduction
Official PyTorch implementation of Which Tokens to Use? Investigating Token Reduction in Vision Transformers presented at ICCV 2023 NIVT workshop
matmulfreellm
Implementation for MatMul-free LM.
LLMTest_NeedleInAHaystack
Doing simple retrieval from LLM models at various context lengths to measure accuracy
low-bit-optimizers
Low-bit optimizers for PyTorch
torchtitan
A native PyTorch Library for large model training
sentence-transformers
Multilingual Sentence & Image Embeddings with BERT
LLaMA-Factory
Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)
how-to-optim-algorithm-in-cuda
how to optimize some algorithm in cuda.