There are 1 repository under audio-captioning topic.
Reading list for research topics in Sound AI
Using pretrained encoder and language models to generate captions from multimedia inputs.
Audio Captioning datasets for PyTorch.
Source code for "MusCaps: Generating Captions for Music Audio" (IJCNN 2021)
Python code for handling the Clotho dataset.
Song Describer is a data collection platform for annotating music with textual descriptions.
Code base for WaveTransformer: A novel architecture for automated audio captioning
Audio captioning baseline system for DCASE 2020 challenge.
Tracking states of the arts and recent results (bibliography) on sound tasks.
2nd place solution for 2020 DCASE challenge task 6 audio captioning. http://dcase.community/challenge2020/task-automatic-audio-captioning-results#wuyusong2020_t6
Metrics for evaluating Automated Audio Captioning systems, designed for PyTorch.
Fluency ENhanced Sentence-bert Evaluation (FENSE), metric for audio caption evaluation. And Benchmark dataset AudioCaps-Eval, Clotho-Eval.
Official Implementation of "Prefix tuning for Automated Audio Captioning(ICASSP 2023)"
PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Supervision, and LLM Mix-up Augmentation"
[NeurIPS 2023 - ML for Audio Workshop (Oral)] Zero-shot audio captioning with audio-language model guidance and audio context keywords
Tools for the evaluation of audio captioning.
Workshop on Detection and Classification of Acoustic Scenes and Events
PyTorch dataloader for Clotho dataset.
CoNeTTE: An efficient Audio Captioning system leveraging multiple datasets with Task Embedding
6-th task solution of DCASE2020
Code for using with the Clotho dataset
IRIT-UPS DCASE 2021 AUDIO CAPTIONING SYSTEM