xzllxls / NES-VMDB

FDG 2024 NES project.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

The NES Video-Music Database

The NES Video-Music Database (NES-MVDB) is a dataset of 98,940 short (15 seconds) gameplay videos from 386 NES games, each paired with its original music piece in symbolic format (MIDI). NES-MVDB is built upon the Nintendo Entertainment System Music Database (NES-MDB).

Dataset structure

The dataset is organized into 4 directories:

  • Midi: all the original midi files from NES-MDB.
  • Audio: all the original midi files from NES-MDB synthesized as MP3 with the original NES synth.
  • Videos: all gameplay videos in the dataset, organized by game id, and sliced in fragments of 15 seconds
  • Video-Midi: a csv file with the game id, name, and metadata of each game in the dataset.

The mapping csv file has the following structure:

alt text

  • sliced query: contains the sliced fragment of the gameplay video extracted previously from YouTube.
  • midi suggested: file is related to the suggested music from NES-MDB which Dejavu (Shazam algorithm-based) did the match.
  • sliced query and sliced query are confidence values related to the Dejavu score. Great values mean better confidence between the sliced query fragment and the midi suggested.

Citing this Dataset

This dataset was presented in the paper The NES Video-Music Database: A Dataset of Symbolic Video Game Music Paired with Gameplay Videos, so if you use the dataset, please cite:

@article{cardoso2024nes,
  title={The NES Video-Music Database: A Dataset of Symbolic Video Game Music Paired with Gameplay Videos},
  author={Cardoso, Igor and Moraes, Rubens O and Ferreira, Lucas N},
  journal={arXiv preprint arXiv:2404.04420},
  year={2024}
}

About

FDG 2024 NES project.


Languages

Language:Python 99.4%Language:Shell 0.6%