mkocabas

Segment-Everything-Everywhere-All-At-Once

[NeurIPS 2023] Official implementation of the paper "Segment Everything Everywhere All at Once"

VAR

[GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4V. 接近GPT-4V表现的可商用开源多模态对话模型

llm

Access large language models from the command-line

NExT-GPT

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

InternImage

[CVPR 2023 Highlight] InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions

LISA

Project Page for "LISA: Reasoning Segmentation via Large Language Model"

Awesome-CLIP

Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).

Metric3D

The repo for "Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Image" and "Metric3Dv2: A Versatile Monocular Geometric Foundation Model..."

flowmap

Code for "FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descent" by Cameron Smith*, David Charatan*, Ayush Tewari, and Vincent Sitzmann

momask-codes

Official implementation of "MoMask: Generative Masked Modeling of 3D Human Motions (CVPR2024)"

dift

[NeurIPS'23] Emergent Correspondence from Image Diffusion

RADIO

Official repository for "AM-RADIO: Reduce All Domains Into One"

MVDiffusion

MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion, NeurIPS 2023 (spotlight)

record3d

Accompanying library for the Record3D iOS app (https://record3d.app/). Allows you to receive RGBD stream from iOS devices with TrueDepth camera(s).

gaussian_surfels

Implementation of the SIGGRAPH 2024 conference paper "High-quality Surface Reconstruction using Gaussian Surfels".

DiffMOT

code for CVPR2024 paper: DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Prediction

PIP

A real-time system that captures physically correct human motion, joint torques, and ground reaction forces with only 6 inertial measurement units

idisc

iDisc: Internal Discretization for Monocular Depth Estimation [CVPR 2023]

ZipIt

A framework for merging models solving different tasks with different initializations into one multi-task model without any additional training

flowsam

Official Implementation of "Moving Object Segmentation: All You Need Is SAM (and Flow)" Junyu Xie, Charig Yang, Weidi Xie, Andrew Zisserman

dot

Dense Optical Tracking: Connecting the Dots

ml-hugs

Official repository of HUGS: Human Gaussian Splats (CVPR 2024)

ml-4m

4M: Massively Multimodal Masked Modeling (NeurIPS 2023 Spotlight)

TokenHMR

[CVPR 2024] TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representation

SiTH

[CVPR 2024] SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion

MultiSlam_DiffPose

SCOPE

Reviatalizing Optimization for 3D Human Pose and Shape Estimation: A Sparse Constrained Formulation

stmc

Implementation of "Multi-Track Timeline Control for Text-Driven 3D Human Motion Generation" from CVPR Workshop on Human Motion Generation 2024.

EgoDepthNormal