toni-heittola / dcase2020_task1_submission_validator

DCASE2020 Challenge Task 1 submission validator

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

DCASE2020 - Task 1 - Submission validator

Author:

Toni Heittola, Tampere University Email, Homepage, GitHub

This is an automatic validation tool for DCASE2020 Challenge task1 submission. The tool helps challenge participants to prepare correctly formatted submission packages, which in turn will speed up the submission processing in the challenge evaluation stage.

Files are validated as strictly as possible against submission instructions. However, it is quite tricky to take into account all possible error combinations. So if you get a validation error, but you feel that formatting is in fact correct, just proceed with submission.

Validator is made for Python version >= 3.7.

Usage

To validate full submission package (in ZIP format):

python main.py -p submission_package.zip

To validate single entry (a pair of system output and associated meta information files) for subtask A (Acoustic Scene Classification with Multiple Devices ):

 python main.py -t A -o Test_TAU_task1a_1.output.csv -m Test_TAU_task1a_1.meta.yaml

And same for subtask B (Low-Complexity Acoustic Scene Classification):

python main.py -t B -o Test_TAU_task1b_1.output.csv -m Test_TAU_task1b_1.meta.yaml

About

DCASE2020 Challenge Task 1 submission validator

License:MIT License


Languages

Language:Python 100.0%