jasongief

ShiArthur03

Micro-Action

[TCSVT 2024] Official implementation of the paper: Benchmarking Micro-action Recognition: Dataset, Methods, and Applications

LFAV

Towards Long Form Audio-visual Video Understanding

APL

APL for AVQA task

CVPR2023-CMPAE

[CVPR 2023] Collecting Cross-Modal Presence-Absence Evidence for Weakly-Supervised Audio-Visual Event Perception

MiGA2023_Track1

[IJCAI 2023]The Champion of Micro-gesture Classification sub-challenge in MiGA@IJCAI2023.

CPSP

[2023 TPAMI] Contrastive Positive Sample Propagation along the Audio-Visual Event Line

OGM-GE_CVPR2022

The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)

DG-SCT

NeurIPS'2023 official implementation code

Non-local_pytorch

Implementation of Non-local Block.

cross_modal_adaptation

Cross-modal few-shot adaptation with CLIP

LM4VisualEncoding

[ICLR 2024 (Spotlight)] "Frozen Transformers in Language Models are Effective Visual Encoder Layers"

AudioGPT

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head

TransnormerLLM

Official implementation of TransNormerLLM: A Faster and Better LLM

ALBEF

Code for ALBEF: a new vision-language pre-training method

up-to-date-Vision-Language-Models

Up-to-date Vision Language Models collection. Mainly focus on computer vision

LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

FNAC_AVL

[CVPR 2023] Official implementation of our paper - Learning Audio-Visual Source Localization via False Negative Aware Contrastive Learning

FAVDBench

[CVPR 2023] Official implementation of the paper: Fine-grained Audible Video Description

Grounded-Segment-Anything

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

UniDetector

Code release for our CVPR 2023 paper "Detecting Everything in the Open World: Towards Universal Object Detection".

EditAnything

Edit anything in images powered by segment-anything, ControlNet, StableDiffusion, etc. (ACM MM)

Awesome-Masked-Autoencoders

A collection of literature after or concurrent with Masked Autoencoder (MAE) (Kaiming He el al.).

Transnormer

[EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer

Tnn

[ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling

awesome-self-supervised-learning

A curated list of awesome self-supervised methods

SSL-TIE

Official code for ACMMM2022 paper, "Exploiting Transformation Invariance and Equivariance for Self-supervised Sound Localisation"

MockingBird

🚀AI拟声: 5秒内克隆您的声音并生成任意语音内容 Clone a voice in 5 seconds to generate arbitrary speech in real-time

TemporalPyramidRouting

Temporal Pyramid Routing For Video Instance Segmentation-T-PAMI-2022

CaFo

[CVPR 2023] Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners