s9xie

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

ControlNet

Let us control diffusion models!

Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

ConvNeXt

Code release for ConvNeXt model

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

img2dataset

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

scenic

Scenic: A Jax Library for Computer Vision Research and Beyond

zero123

Zero-1-to-3: Zero-shot One Image to 3D Object (ICCV 2023)

Painter

Painter & SegGPT Series: Vision Foundation Models from BAAI

PixArt-alpha

PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis

SuGaR

[CVPR 2024] Official PyTorch implementation of SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering

X-Decoder

[CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and language

deepscatter

Zoomable, animated scatterplots in the browser that scales over a billion points

MCC

Multiview Compressive Coding for 3D Reconstruction

SiT

Official PyTorch Implementation of "SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers"

IBRNet

ott

Optimal transport tools implemented with the JAX framework, to get differentiable, parallel and jit-able computations.

vstar

PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"

flip

Official Open Source code for "Scaling Language-Image Pre-training via Masking"

VIRL

Code for V-IRL: Grounding Virtual Intelligence in Real Life

just-the-class

A modern, highly customizable, responsive Jekyll template for course websites.

mix3d

Mix3D: Out-of-Context Data Augmentation for 3D Scenes (3DV 2021 Oral)

long_seq_mae

code release of research paper "Exploring Long-Sequence Masked Autoencoders"

Mean_Shift_Diffusion

Hate-LLaMA

An Instruction-tuned Audio-Visual Language Model for Hate Content Detection

LLVM-Project

LLVM_project_code

prompt_autohint