audio-visual-learning

There are 6 repositories under audio-visual-learning topic.

ali-vilab / dreamtalk
Official implementations for paper: DreamTalk: When Expressive Talking Head Generation Meets Diffusion Probabilistic Models
audio-visual-learning face-animation talking-head video-generation
Language:Python 1306
OpenNLPLab / AVSBench
[ECCV 2022] Official implementation of the paper: Audio-Visual Segmentation
audio-visual-learning audio-visual-segmentation multi-modal-segmentation segmentation-benchmark
Language:Python 430
YapengTian / AVE-ECCV18
Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018
audio-visual-events ave-dataset audio-visual-learning eccv-2018
Language:Python 158
alvinliu0 / HA2G
[CVPR 2022] Code for "Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation"
audio-visual-learning co-speech-gesture cvpr2022
Language:Python 115
rhgao / co-separation
Co-Separating Sounds of Visual Objects (ICCV 2019)
audio-visual-learning sound-separation cross-modality
Language:Python 90
yanbeic / CCL
PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning
compositional-contrastive-learning audio-teacher-models multi-modal-distillation distillation audio-visual-learning cvpr2021 contrastive-learning pytorch video-recognition
Language:Python 84
ttgeng233 / UnAV
Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)
audio-visual-events audio-visual-learning multi-modal-learning
Language:Python 50
jasongief / PSP_CVPR_2021
[2021 CVPR] Positive Sample Propagation along the Audio-Visual Event Line
audio-visual-learning audio-visual-events
Language:Python 39
kyuyeonpooh / objects-that-sound
The unofficial implementation of paper, "Objects that Sound", from ECCV 2018.
eccv2018 cross-modal-retrieval sound-localization audioset deep-learning audio-visual-learning
Language:Python 32
roger-tseng / av-superb
A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)
audio-visual-learning representation-learning
Language:Python 32
stoneMo / AVGN
Official implementation for AVGN
audio-visual-correspondence audio-visual-learning visual-sound-localization weakly-supervised-learning
Language:Python 27
stoneMo / EZ-VSL
Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)
self-supervised-learning audio-visual-learning audio-visual-correspondence visual-sound-localization
Language:Python 26
MengyuanChen21 / CVPR2023-CMPAE
[CVPR 2023] Collecting Cross-Modal Presence-Absence Evidence for Weakly-Supervised Audio-Visual Event Perception
audio-visual audio-visual-learning audio-visual-video-parsing cvpr2023 video-understanding
Language:Python 22
jasongief / CPSP
[2022 TPAMI] Contrastive Positive Sample Propagation along the Audio-Visual Event Line
audio-visual-events audio-visual-learning audio-visual-parsing
Language:Python 19
stoneMo / MGN
Official implementation for MGN
audio-visual-learning audio-visual-parsing weakly-supervised-learning multimodal-learning
Language:Python 19
Tinglok / avstyle
Codebase for the Paper: Learning Visual Styles from Audio-Visual Associations (ECCV 2022, in PyTorch)
audio-visual-learning computer-vision gans generative-adversarial-network image-generation image-manipulation
Language:Python 15
stoneMo / SLAVC
Official Codebase of "A Closer Look at Weakly-Supervised Audio-Visual Source Localization" (NeurIPS 2022)
audio-visual-correspondence audio-visual-learning overfitting self-supervised-learning silence visual-sound-localization
Language:Python 12
stoneMo / CIGN
Official implementation for CIGN
audio-visual-correspondence audio-visual-learning class-incremental-learning continual-learning
Language:Python 11
ly-zhu / Leveraging-Category-Information-for-Single-Frame-Visual-Sound-Source-Separation
PyTorch implementation of "Leveraging Category Information for Single-Frame Visual Sound Source Separation"
audio-visual-learning sound-separation appearance-attention sound-source-localization
Language:Python 6
stoneMo / OneAVM
Official Codebase of "A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition" (ICML 2023)
audio-visual-correspondence audio-visual-learning multimodal-learning self-supervised-learning sound-source-localization sound-source-separation
6
ly-zhu / cof-net
Code for the paper: Visually Guided Sound Source Separation using Cascaded Opponent Filter Network
audio-visual-sound-separation audio-visual-learning self-supervised-learning sound-source-separation sound-source-localization multi-model-learning
Language:Python 4
stoneMo / DeepAVFusion
Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
attention-mechanism audio-visual-correspondence audio-visual-learning multimodal-learning self-supervised-learning sound-source-localization sound-source-separation transformer-architecture masked-autoencoder masked-image-modeling
4
dkurzend / ClipClap-GZSL
Audio-Visual Generalized Zero-Shot Learning using Large Pre-Trained Models
clap clip generalized-zero-shot-learning gzsl zero-shot-learning zsl audio-visual-generalized-zero-shot-learning audio-visual audio-visual-learning learning
Language:Python 3
aromanusc / SoundQ
Enhanced sound event localization and detection in real 360-degree audio-visual soundscapes (DCASE task3 format)
audio-visual-learning detic seld seldnet sound-detection sound-localization yolov5 yolov8 dcase2023 audio-visual-seld
Language:Python 2
chaseottofy / congruent-chords
Tonejs sampler. Visualize the congruence of the circle of fifths with the circle of fourths.
audio audio-visual-learning audio-visualizer music music-theory tonejs vanilla vanilla-javascript vanilla-js chord-progressions
Language:JavaScript 2
ly-zhu / ly-zhu.github.io
Projects webpage
audio-visual-learning sound-source-localization semantic-segmentation portrait-segmentation computer-vision audio-visual-applications self-supervision sound-source-separation machine-learning representation-learning
Language:HTML 2
Huntersxsx / AVVP-Learning-List
Related papers about Weakly-supervised Audio-Visual Video Parsing (AVVP) & Audio-Visual Event Localization (AVE)
audio-visual-learning weakly-supervised-learning audio-visual-event-localization audio-visual-video-parsing
1
kvilouras / AV-SSRL
MSc Thesis "Audio-Visual Self-Supervised Representation Learning in-the-wild"
audio-visual-learning self-supervised-learning
Language:Jupyter Notebook 0