CHUNYUWANG

gradio

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

pytorch-image-models

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

sentencepiece

Unsupervised text tokenizer for Neural Network-based text generation.

PhotoMaker

PhotoMaker [CVPR 2024]

lora

Using Low-rank adaptation to quickly fine-tune diffusion models.

GroundingDINO

[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

Wonder3D

Single Image to 3D using Cross-Domain Diffusion for 3D Generation

MiDaS

Code for robust monocular depth estimation described in "Ranftl et. al., Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer, TPAMI 2022"

PySceneDetect

:movie_camera: Python and OpenCV-based scene cut/transition detection program & library.

DWPose

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

DeepSeek-VL

DeepSeek-VL: Towards Real-World Vision-Language Understanding

GLIGEN

Open-Set Grounded Text-to-Image Generation

RPG-DiffusionMaster

[ICML 2024] Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs (PRG)

Emu

Emu Series: Generative Multimodal Models from BAAI

composer

Official implementation of "Composer: Creative and Controllable Image Synthesis with Composable Conditions"

TimeSformer

The official pytorch implementation of our paper "Is Space-Time Attention All You Need for Video Understanding?"

MotionCtrl

Official Code for MotionCtrl [SIGGRAPH 2024]

CoCa-pytorch

Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch

ToMe

A method to increase the speed and lower the memory footprint of existing vision transformers.

SyncDreamer

[ICLR 2024 Spotlight] SyncDreamer: Generating Multiview-consistent Images from a Single-view Image

LLaMA-VID

LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)

LaViLa

Code release for "Learning Video Representations from Large Language Models"

MVDiffusion

MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion, NeurIPS 2023 (spotlight)

objaverse-rendering

📷 Scripts for rendering Objaverse

Pro-Motion

Plan, Posture and Go: Towards Open-World Text-to-Motion Generation

ART.V

MVGFormer

This is the official implementation of the work presented at CVPR 2024, titled Multiple View Geometry Transformers for 3D Human Pose Estimation (MVGFormer).

BannerGen

SBT