ZCMax

Awesome-3D-Vision-and-Language

A collection of 3D vision and language (e.g., 3D Visual Grounding, 3D Question Answering and 3D Dense Caption) papers and datasets.

P3Former

[IJCV 2024] P3Former: Position-Guided Point Cloud Panoptic Segmentation Transformer

Refer-it-in-RGBD

Repository of our paper 'Refer-it-in-RGBD' in CVPR 2021

3D-VisTA

Official implementation of ICCV 2023 paper "3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment"

NeRF-Det

[ICCV 2023] Code for NeRF-Det: Learning Geometry-Aware Volumetric Representation for Multi-View 3D Object Detection

gradslam

gradslam is an open source differentiable dense SLAM library for PyTorch

3D-LLM

Code for 3D-LLM: Injecting the 3D World into Large Language Models

concept-fusion

Code release for ConceptFusion [RSS 2023]

3D-CLR-Official

[CVPR 2023] Code for "3D Concept Learning and Reasoning from Multi-View Images"

tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

InternLM

Official release of InternLM2.5 7B base and chat models. 1M context support

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Segment-Any-Point-Cloud

[NeurIPS'23 Spotlight] Segment Any Point Cloud Sequences by Distilling Vision Foundation Models

OVO-Open-Vocabulary-Occupancy

Semantic-SAM

[ECCV 2024] Official implementation of the paper "Semantic-SAM: Segment and Recognize Anything at Any Granularity"

MVT-3DVG

Multi-View Transformer for 3D Visual Grounding [CVPR 2022]

llama.cpp

LLM inference in C/C++

vlmaps

[ICRA2023] Implementation of Visual Language Maps for Robot Navigation

EmbodiedQA

Train embodied agents that can answer questions in environments

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

LAMM

[NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents

LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

Multi-Modality-Arena

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!

awesome-instruction-dataset

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

ScanQA

3RScan

3RScan Toolkit

OmniObject3D

[ CVPR 2023 Award Candidate ] OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generation

Scan2Cap

[CVPR 2021] Scan2Cap: Context-aware Dense Captioning in RGB-D Scans