ZJHTerry18

MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

LLaMA-Adapter

[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

mmtracking

OpenMMLab Video Perception Toolbox. It supports Video Object Detection (VID), Multiple Object Tracking (MOT), Single Object Tracking (SOT), Video Instance Segmentation (VIS) with a unified framework.

LLaMA2-Accessory

An Open-source Toolkit for LLM Development

computer-vision-in-action

A computer vision closed-loop learning platform where code can be run interactively online. 学习闭环《计算机视觉实战演练：算法与应用》中文电子书、源码、读者交流社区（持续更新中 ...） 📘 在线电子书 https://charmve.github.io/computer-vision-in-action/ 👇项目主页

InternLM-XComposer

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

GLIP

Grounded Language-Image Pre-training

LISA

Project Page for "LISA: Reasoning Segmentation via Large Language Model"

awesome-openai-vision-api-experiments

Must-have resource for anyone who wants to experiment with and build on the OpenAI vision API 🔥

open-images-dataset

Open Images is a dataset of ~9 million images that have been annotated with image-level labels and bounding boxes spanning thousands of classes.

VisionLLM

VisionLLM Series

GPT4RoI

GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest

fromage

🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".

Cheetah

MIC

MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU

PCT

This is an official implementation of our CVPR 2023 paper "Human Pose as Compositional Tokens" (https://arxiv.org/pdf/2303.11638.pdf)

LAMM

[NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents

unified-io-inference

ContextDET

Contextual Object Detection with Multimodal Large Language Models

APTM

The official code of "Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search Benchmark"

ISR_ICCV2023_Oral

The code for ICCV2023 Oral paper: Identity-Seeking Self-Supervised Representation Learning for Generalizable Person Re-identification

UAL

The code for ECCV2022 paper: Reliability-Aware Prediction via Uncertainty Learning for Person Image Retrieval

RegionBLIP

DistributionNet

PVIT

Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models

UniPT

pointingqa

Code for paper "Point and Ask: Incorporating Pointing into Visual Question Answering"

Pix2SeqV2-Pytorch

Simple Implementation of Pix2seqV2(multi-task)