1170300714

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

ARC-AGI

The Abstraction and Reasoning Corpus

MambaOut

MambaOut: Do We Really Need Mamba for Vision?

X-Decoder

[CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and language

PETR

[ECCV2022] PETR: Position Embedding Transformation for Multi-View 3D Object Detection & [ICCV2023] PETRv2: A Unified Framework for 3D Perception from Multi-Camera Images

GLUE-baselines

[DEPRECATED] Repo for exploring multi-task learning approaches to learning sentence representations

FedProx

Federated Optimization in Heterogeneous Networks (MLSys '20)

DoRA

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

VisionLLaMA

VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks

SparseBEV

[ICCV 2023] SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videos

Spike-Driven-Transformer

Offical implementation of "Spike-driven Transformer" (NeurIPS2023)

NExT-Chat

The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".

FedNova

PyTorch implementation of FedNova (NeurIPS 2020), and a class of federated learning algorithms, including FedAvg, FedProx.

squad

Starter code for Stanford CS224n default final project on SQuAD 2.0

VisionLearningGroup.github.io

Endo-FM

[MICCAI'23] Foundation Model for Endoscopy Video Analysis via Large-scale Self-supervised Pre-train

commonsenseqa

Author implementation of the paper "CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge"

TPT

Test-time Prompt Tuning (TPT) for zero-shot generalization in vision-language models (NeurIPS 2022))

GenerateU

[CVPR2024] Generative Region-Language Pretraining for Open-Ended Object Detection

Overcoming-Catastrophic-forgetting-in-Neural-Networks

Elastic weight consolidation technique for incremental learning.

BlackVIP

Official implementation for CVPR'23 paper "BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning"

talk2bev

Talk2BEV: Language-Enhanced Bird's Eye View Maps (Accepted to ICRA'24)

POP3D

Source code for NeurIPS paper "POP-3D: Open-Vocabulary 3D Occupancy Prediction from Images"

MineDreamer

This repo is the official implementation of "MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Control "

nuscenes-download

script for downloading nuscenes

CoMFormer

Official implementation of "CoMFormer: Continual Learning in Semantic and Panoptic Segmentation"

GMM

Generative Multi-modal Models are Good Class Incremental Learners, CVPR 2024 [PyTorch Code]

GS-LoRA

Continual Forgetting for Pre-trained Vision Models (CVPR 2024)

DualCross

[IROS 2023] DualCross: Cross-Modality Cross-Domain Adaptation for Monocular BEV Perception

annotation2mask

Converting coco-like annotation json files to png masks