swtju14

Vary

[ECCV2024] Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

DreamLLM

[ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation

Qwen-VL

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.

webdataset

A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.

wit

WIT (Wikipedia-based Image Text) Dataset is a large multimodal multilingual dataset comprising 37M+ image-text sets with 11M+ unique images across 100+ languages.

Awesome-Multimodality

A Survey on multimodal learning research.

Chinese-CLIP

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

GPT4Tools

GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the user to interact with images during a conversation.

AGIEval

MOSS

An open-source tool-augmented conversational language model from Fudan University

LLMZoo

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

mmc4

MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.

mmpretrain

OpenMMLab Pre-training Toolbox and Benchmark

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

VoxelNeXt

VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Tracking (CVPR 2023)

TaskMatrix

Birds-eye-view-Perception

[IEEE T-PAMI] Awesome BEV perception research and cookbook for all level audience in autonomous diriving

FlexGen

Running large language models on a single GPU for throughput-oriented scenarios.

CMT

[ICCV 2023] Cross Modal Transformer: Towards Fast and Robust 3D Object Detection

RevCol

Official Code of Paper "Reversible Column Networks" "RevColv2"

RAM-multiprocess-dataloader

Demystify RAM Usage in Multi-Process Data Loaders

BEVStereo

Official code for BEVStereo

EVA

EVA Series: Visual Representation Fantasies from BAAI

DINO

[ICLR 2023] Official implementation of the paper "DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection"

detrex

detrex is a research platform for DETR-based object detection, segmentation, pose estimation and other visual recognition tasks.

BEVDepth

Official code for BEVDepth.

vidt

MIMDet

[ICCV 2023] You Only Look at One Partial Sequence

YOLOX

YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/