WeidiXie

GroundVQA

Official PyTorch code of "Grounded Question-Answering in Long Egocentric Videos", accepted by CVPR 2024.

EgoExoLearn

Data and benchmark code for the EgoExoLearn dataset

CAMEVAL

[ICCV23] The Making and Breaking of Camouflage. Hala Lamdouar, Weidi Xie, Andrew Zisserman.

StoryGen

[CVPR 2024] Intelligent Grimm - Open-ended Visual Storytelling via Latent Diffusion Models

MMedLM

The official codes for "Towards Building Multilingual Language Model for Medicine"

Video-Text-Alignment

ml-aim

This repository provides the code and model checkpoints of the research paper: Scalable Pre-training of Large Autoregressive Image Models

RP3D-Diag

Code implementation of RP3D-Diag

SAT

The official repository for "One Model to Rule them All: Towards Universal Segmentation for Medical Images with Text Prompts"

RP3D-Diag

Code implementation of RP3D-Diag

SimpleSDM-Video

A simple and flexible PyTorch implementation of Video StableDiffusion (ZeroScope_v2) based on diffusers.

LVVIS

Large-Vocabulary Video Instance Segmentation dataset

KAD

K-Diag

storybench

RadFM

The official code for "Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Data".

med-flamingo

ZS-CIR

[BMVC 2023] Zero-shot Composed Text-Image Retrieval

awesome-camouflaged-object-detection

A curated list of awesome resources for camouflaged/concealed object detection (COD).

Youku-mPLUG

Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks

ChatGLM-6B

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

PMC-VQA

PMC-VQA is a large-scale medical visual question-answering dataset, which contains 227k VQA pairs of 149k images that cover various modalities or diseases.

PickScore

Huatuo-26M

The Largest-scale Chinese Medical QA Dataset： with 26,000,000 question answer pairs.

dinov2

PyTorch code and models for the DINOv2 self-supervised learning method.

GPT-4-LLM

Instruction Tuning with GPT-4

PMC-CLIP

The official codes for "PMC-CLIP: Contrastive Language-Image Pre-training using Biomedical Documents"

AutoAD

[CVPR'23 Highlight] AutoAD: Movie Description in Context.

open_flamingo

An open-source framework for training large multimodal models.

viper

Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"