zeyuanyin

Zeyuan's starred repositories

grok-1

Grok open release

Language:PythonApache-2.049462 562 209

llama3

The official Meta Llama 3 GitHub site

Language:PythonNOASSERTION26392 217 242

full-stack-fastapi-template

Full stack, modern web application template. Using FastAPI, React, SQLModel, PostgreSQL, Docker, GitHub Actions, automatic HTTPS and more.

Language:TypeScriptMIT25019 269 410

CLIP

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

Language:Jupyter NotebookMIT24959 323 394

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

Language:PythonApache-2.021742 185 487

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Language:PythonApache-2.015983 107 1039

Megatron-LM

Ongoing research training transformer models at scale

Language:PythonNOASSERTION10129 162 726

trl

Train transformer language models with reinforcement learning.

Language:PythonApache-2.09557 74 1124

Gymnasium

An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)

Language:PythonMIT6900 38 448

Loop

Window management made elegant.

Language:SwiftGPL-3.06699 27 374

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

Language:PythonNOASSERTION6064 45 80

DeepSpeedExamples

Example models using DeepSpeed

Language:PythonApache-2.06015 74 534

alignment-handbook

Robust recipes to align language models with human and AI preferences

Language:PythonApache-2.04524 108 133

gdown

Google Drive Public File Downloader when Curl/Wget Fails

Language:PythonMIT4205 23 173

torchtune

A Native-PyTorch Library for LLM Fine-tuning

Language:PythonBSD-3-Clause4048 46 578

xtuner

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

Language:PythonApache-2.03795 33 513

MGM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

Language:PythonApache-2.03188 28 131

llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Language:PythonMIT2375 24 169

webdataset

A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

Language:PythonBSD-3-Clause2228 22 322

pycls

Codebase for Image Classification Research, written in PyTorch.

Language:PythonMIT2136 61 81

direct-preference-optimization

Reference implementation for DPO (Direct Preference Optimization)

Language:PythonApache-2.02050 19 81

DeepSeek-VL

DeepSeek-VL: Towards Real-World Vision-Language Understanding

Language:PythonMIT2026 19 46

VILA

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

Language:PythonApache-2.01838 27 119

penzai

A JAX research toolkit for building, editing, and visualizing neural networks.

Language:PythonApache-2.01648 17 15

MeZO

[NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333

Language:PythonMIT1026 19 36

x-clip

A concise but complete implementation of CLIP with various experimental improvements from recent papers

Language:PythonMIT678 25 14

vstar

PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"

Language:PythonMIT507 11 17

MMBench

Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"

Apache-2.0150 3 32

vlm-evaluation

VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning

Language:PythonNOASSERTION77 6 9

llm-vision-datasets

Collection of image and video datasets for generative AI and multimodal visual AI

18 10