linhuixiao

DynRefer

DynRefer: Delving into Region-level Multi-modality Tasks via Dynamic Resolution

Books

My book list

ShiArthur03

Awesome-Visual-Dialog

A curated publication list on visual dialog

CVPR2022-FTCL

[CVPR 2022] Fine-grained Temporal Contrastive Learning for Weakly-supervised Temporal Action Localization

CVPR2023-OWTAL

[CVPR 2023] Cascade Evidential Learning for Open-world Weakly-supervised Temporal Action Localization

ECCV2022-DELU

[ECCV 2022] Dual-Evidential Learning for Weakly-supervised Temporal Action Localization

CVPR2023-CMPAE

[CVPR 2023] Collecting Cross-Modal Presence-Absence Evidence for Weakly-Supervised Audio-Visual Event Perception

ICLR2024-REDL

[ICLR 2024 Spotlight] R-EDL: Relaxing Nonessential Settings of Evidential Deep Learning

Awesome-Visual-Grounding

A Survey on Open Visual Grounding

awesome-described-object-detection

A curated list of papers and resources related to Described Object Detection, Open-Vocabulary/Open-World Object Detection and Referring Expression Comprehension. Updated frequently and pull requests welcomed.

llama

Inference code for Llama models

Libra

Simple PyTorch implementation of "Libra: Building Decoupled Vision System on Large Language Models" (accepted by ICML 2024)

HiVG

Hierarchical Multimodal Fine-grained Modulation for Visual Grounding.

COMM

Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models

MAE-pytorch

Unofficial PyTorch implementation of Masked Autoencoders Are Scalable Vision Learners

FlagAI

FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.

s4

Structured state space sequence models

flash-attention

Fast and memory-efficient exact attention

mamba

Mamba SSM architecture

Awesome-Mamba-Papers

Awesome Papers related to Mamba.

MultiModalMamba

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

Vim

[ICML 2024] Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

r-mae

PyTorch implementation of R-MAE https//arxiv.org/abs/2306.05411

DataOptim

A collection of visual instruction tuning datasets.

MaskCLIP

NExT-Chat

The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".

Lenna

SCLIP

Official implementation of SCLIP: Rethinking Self-Attention for Dense Vision-Language Inference

SceneGraphParser

A python toolkit for parsing captions (in natural language) into scene graphs (as symbolic representations).