yhzhouowo's starred repositories
ego-AV-spatial-correspondence
[CVPR 2024] Code and datasets for 'Learning Spatial Features from Audio-Visual Correspondence in Egocentric Videos'
seamless_communication
Foundational Models for State-of-the-Art Speech and Text Translation
Awesome-Simultaneous-Translation
Paper list of simultaneous translation / streaming translation, including text-to-text machine translation and speech-to-text translation.
Video_Call_MOS
A video quality MOS prediction model for videoconferencing calls that takes temporal distortions into account
Multimodal-AND-Large-Language-Models
Paper list about multimodal and large language models, only used to record papers I read in the daily arxiv for personal needs.
audio-retrieval-benchmark
Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".
Visionary-Vids
Multi-modal transformer approach for natural language query based joint video summarization and highlight detection
moment_detr
[NeurIPS 2021] Moment-DETR code and QVHighlights dataset
awesome-speech-to-speech-translation
List of direct speech-to-speech translation papers.
AV-Deepfake1M
[ACM MM] AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Dataset
images-that-sound
Official repo for Images that sound: a special spectrogram that can be seen as images and played as sound generated by diffusions
TempoTokens
This repo contains the official PyTorch implementation of: Diverse and Aligned Audio-to-Video Generation via Text-to-Video Model Adaptation
efficient-kan
An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).
SAM-Adapter-PyTorch
Adapting Meta AI's Segment Anything to Downstream Tasks with Adapters and Prompts