luogen1996

LaVIN

[NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"

RepAdapter

Official implementation of "Towards Efficient Visual Adaption via Structural Re-parameterization".

LLaVA-HR

LLaVA-HR: High-Resolution Large Language-Vision Assistant

MCN

[CVPR2020] Multi-task Collaborative Network for Joint Referring Expression Comprehension and Segmentation, CVPR2020 (oral)

OneTeacher

SimREC

A lightweight codebase for referring expression comprehension and segmentation

LWTransformer

Lightweight Transformer for Multi-modal Tasks

MoIL

datasets

TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...

detectron2

Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.

detr

End-to-End Object Detection with Transformers

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

FGD

Focal and Global Knowledge Distillation for Detectors (CVPR 2022)

LaConvNet

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

lmbxmu

luogen1996

luogen1996.github.io

MAttNet

MAttNet: Modular Attention Network for Referring Expression Comprehension

mmf

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

openvqa

A lightweight, scalable, and general framework for visual question answering research

RealGIN-Keras

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

SeqTR

SeqTR: A Simple yet Universal Network for Visual Grounding

Swin-Transformer

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

TencentPretrain

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

TRAR-VQA

This is the official pytorch implementation for our ICCV 2021 paper "TRAR: Routing the Attention Spans in Transformers for Visual Question Answering" on VQA Task

VC-R-CNN

The official pytorch implementation of CVPR 2020 ``Visual Commonsense R-CNN''

vision_transformer

zhiweichen0012