SheffieldCao

Phased-Consistency-Model

Boosting the performance of consistency models with PCM!

3DGM

Official PyTorch implementation of 3D Gaussian Mapping (3DGM)

OccSora

OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Driving

MapUncertaintyPrediction

[CVPR 2024 Award Candidate] Producing and Leveraging Online Map Uncertainty in Trajectory Prediction

PaSCo

[CVPR 2024 Oral - Best paper award candidate] Official repository of "PaSCo: Urban 3D Panoptic Scene Completion with Uncertainty Awareness"

egtr

[CVPR 2024 Best paper award candidate] EGTR: Extracting Graph from Transformer for Scene Graph Generation

RepAdapter

Official implementation of "Towards Efficient Visual Adaption via Structural Re-parameterization".

3D-LLM

Code for 3D-LLM: Injecting the 3D World into Large Language Models

Segment-and-Track-Anything

An open-source project dedicated to tracking and segmenting any objects in videos, either automatically or interactively. The primary algorithms utilized include the Segment Anything Model (SAM) for key-frame segmentation and Associating Objects with Transformers (AOT) for efficient tracking and propagation purposes.

Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

LiDAR-Diffusion

[CVPR 2024] Official implementation of "Towards Realistic Scene Generation with LiDAR Diffusion Models"

CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型

Awesome-LLM4AD

A curated list of awesome LLM for Autonomous Driving resources (continually updated)

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

LLaMA-Factory

A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

Depth-Anything

[CVPR 2024] Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data. Foundation Model for Monocular Depth Estimation

PixArt-alpha

PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis

General-World-Models-Survey

LLaVA-NeXT

pykan

Kolmogorov Arnold Networks

FilmRemoval

[CVPR 2024] Official Implementation of Learning to Remove Wrinkled Transparent Film with Polarized Prior

mmdit

Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch

MovieChat

[CVPR 2024] 🎬💭 chat with over 10K frames of video!

VILA

VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and laptops)

Vim

[ICML 2024] Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

LLMGA

This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024

LLaVA-pp

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

audacity-manual

A complete copy of the Audacity manual

QA-ViT

LLaVA-RLHF

Aligning LMMs with Factually Augmented RLHF