MinghanLi

make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

TarViS

vision_transformer

yolact

A simple, fully convolutional model for real-time instance segmentation.

LaGOT

We enrich the LaSOT validation set with annotations of additional object tracks, up to 10 object tracks per video in total. Tracks consist of precise bounding box annotations of moving objects. Annotations are provided at 10 fps. The original LaSOT validation set annotations and video can be downloaded from: https://vision.cs.stonybrook.edu/~lasot/

pytracking

Visual tracking library based on PyTorch.

FDL

[CVPR-2024] Pytorch implementation of "Misalignment-Robust Frequency Distribution Loss for Image Transformation"

CCSR

Official codes of CCSR: Improving the Stability of Diffusion Models for Content Consistent Super-Resolution

SeeSR

[CVPR2024] SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution

UVO_Challenge

gradio

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

VIPOSeg-Benchmark

The benchmark for "Video Object Segmentation in Panoptic Wild Scenes".

Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

LaVIT

LaVIT: Empower the Large Language Model to Understand and Generate Visual Content

POPE

The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''

LLMTest_NeedleInAHaystack

Doing simple retrieval from LLM models at various context lengths to measure accuracy

LWM

dataset

The Open Images dataset

magvit

Official JAX implementation of MAGVIT: Masked Generative Video Transformer

VGen

Official repo for VGen: a holistic video generation ecosystem for video generation building on diffusion models

ControlVideo

[ICLR 2024] Official pytorch implementation of "ControlVideo: Training-free Controllable Text-to-Video Generation"

CogVideo

Text-to-video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

webvid

Large-scale text-video dataset. 10 million captioned short videos.

LanguageBind

【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment

Video-LLaVA

PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models

unified-io-2

gigagan-pytorch

Implementation of GigaGAN, new SOTA GAN out of Adobe. Culmination of nearly a decade of research into GANs

Vary

[ECCV 2024] Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.

dinov2

PyTorch code and models for the DINOv2 self-supervised learning method.