AndreJJXu

blended-latent-diffusion

Official implementation for "Blended Latent Diffusion" [SIGGRAPH 2023]

SyncDiffusion

Official implementation of SyncDiffusion.

MultiDiffusion

Official Pytorch Implementation for "MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation" presenting "MultiDiffusion" (ICML 2023)

ModalBiasAVSR

Offical implementation of the CVPR 2024 paper: A Study of Dropout-Induced Modality Bias on Robustness to Missing Video.

clotho-dataset

Python code for handling the Clotho dataset.

ClipClap-GZSL

Audio-Visual Generalized Zero-Shot Learning using Large Pre-Trained Models

AudioCLIP

Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)

lyrebird-wav2clip

Official implementation of the paper WAV2CLIP: LEARNING ROBUST AUDIO REPRESENTATIONS FROM CLIP

PerceptualSimilarity

LPIPS metric. pip install lpips

FPD

Generating-Realistic-Images-from-In-the-wild-Sounds

Official Code Repository for the paper "Generating Realistic Images from In-the-wild Sounds", ICCV 2023

latent-consistency-model

Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference

UniS-MMC

Code for UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning (ACL 2023)

PSL-MOBO

GALIP

[CVPR2023] A faster, smaller, and better text-to-image model for large-scale training

Sound2Scene

TPoS

This repository is for The Power of Sound(TPoS): Audio Reactive Video Generation with Stable Diffusion (ICCV2023)

DiT

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

Shifted_Diffusion

Code for Shifted Diffusion for Text-to-image Generation (CVPR 2023)

AlphaCLIP

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want