wzk1015 / video-bgm-generation

[ACM MM 2021 Best Paper Award] Video Background Music Generation with Controllable Music Transformer

Home Page:https://wzk1015.github.io/cmt/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

How to control the genre of the generated music

LebudiPrince opened this issue · comments

I would like to consult that how can I control the genre of the generated music.
I notice that the paper mentions that one can control the instrument and genre by adding conditions before the input sequence. Also, in the train an inference code there are initial tokens.
However, the genre in initial tokens are always "5" which map to "pop". I try to modify the genre and instrument tokens during the training procedure while it doesn't work well.

The author replied to others, music training data, it was canceled, but it was kept, so it didn't work