Bin Zhu's repositories
MotionCtrl
Official Code for MotionCtrl [SIGGRAPH 2024]
Dlink_Parse
解析 优酷，腾讯，哔哩哔哩，抖音，芒果TV，爱奇艺，PP视频，咪咕视频，AcFun，快手，搜狐视频，QQ音乐，网易云音乐，酷我音乐，腾讯课堂，西瓜视频等下载地址
lux
👾 Fast and simple video download library and CLI tool written in Go
LLMBind
LLMBind: A Unified Modality-Task Integration Framework
Open-Sora-Plan
This project aim to reproducing Sora (Open AI T2V model), but we only have limited resource. We deeply wish the all open source community can contribute to this project.
MagicTime
MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators
Video-Bench
A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
Latte
Latte: Latent Diffusion Transformer for Video Generation.
AnimateDiff
Official implementation of AnimateDiff.
LISA
Project Page for "LISA: Reasoning Segmentation via Large Language Model"
SEED-Bench
A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models (LLaMA, LLaMa2, ChatGLM2, ChatGPT, Claude, etc) over 50+ datasets.
LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning: LLaVA (Large Language-and-Vision Assistant) built towards GPT-4V level capabilities.
diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
fastmoe
A fast MoE impl for PyTorch
LaVIN
[NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"
minGPT
A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
Video-LLaMA
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
VALOR
Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
ControlNet
Let us control diffusion models!
TaiSu
TaiSu（太素）--a large-scale Chinese multimodal dataset（亿级大规模中文视觉语言预训练数据集）
chatgpt-on-wechat
Wechat robot based on ChatGPT, which using OpenAI api and itchat library. 使用ChatGPT搭建微信聊天机器人，基于GPT3.5/4.0 API实现，支持个人微信、公众号、企业微信部署，能处理文本、语音和图片，访问操作系统和互联网。
Grounded-Segment-Anything
Marrying Grounding DINO with Segment Anything & Stable Diffusion & Tag2Text & BLIP & Whisper & ChatBot - Automatically Detect , Segment and Generate Anything with Image, Text, and Audio Inputs
denoising-diffusion-pytorch
Implementation of Denoising Diffusion Probabilistic Model in Pytorch
consistency_models
Official repo for consistency models.
hfai-models
HFAI deep learning models
taming-transformers
Taming Transformers for High-Resolution Image Synthesis