Beast code in Giters

Hyun-Bin Oh's starred repositories

MMM

Official repository for "MMM: Generative Masked Motion Model"

Language:Jupyter Notebook5400

VDT

[ICLR2024] The official implementation of paper "VDT: General-purpose Video Diffusion Transformers via Mask Modeling", by Haoyu Lu, Guoxing Yang, Nanyi Fei, Yuqi Huo, Zhiwu Lu, Ping Luo, Mingyu Ding.

Language:Jupyter NotebookNOASSERTION20000

av2av

[CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation

Language:PythonMIT1600

Video-LLaVA

Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

Language:PythonApache-2.0100

paig

Code for the paper Physics-as-Inverse-Graphics: Joint Unsupervised Learning of Objects and Physics from Video

Language:PythonMIT3800

kubric

A data generation pipeline for creating semi-realistic synthetic multi-object videos with rich annotations such as instance segmentation masks, depth maps, and optical flow.

Language:Jupyter NotebookApache-2.0225700

Multimodal-AND-Large-Language-Models

Paper list about multimodal and large language models, only used to record papers I read in the daily arxiv for personal needs.

48800

SAiD

SAiD: Blendshape-based Audio-Driven Speech Animation with Diffusion

Language:PythonApache-2.06900

Awesome-Talking-Face

📖 A curated list of resources dedicated to talking face.

MIT121800

Korean-FastSpeech2-Pytorch

Implementation of Korean FastSpeech2

Language:PythonMIT20600

ComfyUI

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

Language:PythonGPL-3.04637700

ml-papers

My collection of machine learning papers

MIT25800

FLAME-Universe

Summary of publicly available ressources such as code, datasets, and scientific papers for the FLAME 3D head model

36700

awesome-audiovisual-learning

A curated list of audio-visual learning methods and datasets.

21500

video-physics-sound-diffusion

Language:PythonApache-2.04400

One-sentence_Diffusion_summary

The repo for studying and sharing diffusion models.

37800

3DOI

[ICCV 2023] Understanding 3D Object Interaction from a Single Image

Language:Python3600

Track-Anything

Track-Anything is a flexible and interactive tool for video object tracking and segmentation, based on Segment Anything, XMem, and E2FGVI.

Language:PythonMIT635900

sam-hq

Segment Anything in High Quality [NeurIPS 2023]

Language:PythonApache-2.0360200

Word-As-Image

Language:PythonNOASSERTION110000

Scene-Text-Recognition-Recommendations

Papers, Datasets, Algorithms, SOTA for STR. Long-time Maintaining

Language:PythonMIT31300

playground

A central hub for gathering and showcasing amazing projects that extend OpenMMLab with SAM and other exciting features.

Language:PythonApache-2.0107700

OCR-SAM

Combining MMOCR with Segment Anything & Stable Diffusion. Automatically detect, recognize and segment text instances, with serval downstream tasks, e.g., Text Removal and Text Inpainting

Language:Python50800