calclavia / DeepJ

A deep learning model for style-specific music generation.

Home Page:https://arxiv.org/abs/1801.00887

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

multi instrument?

DefinitlyEvil opened this issue · comments

can it possibly support multi-instruments in the future?

@DefinitlyEvil Yes, definitely! It's a difficult research task though which will require some smart solution to get working.

@calclavia I though we could create multiple network for each instrument and combine them to a central network then split them back into multiple. It's like seq2seq problem but I guess it's more complex. As for unused instrument we just set them inactivated, output 0 directly?

@calclavia I am a undergraduate student majoring music composition and I love Bach's music. May I have your Skype or discord? I think I can give some suggestions to the model. ;)

@DefinitlyEvil Discord Calclavia#9037
It's not as simple as just multiple networks, because each instrument needs to be conditioned on another instrument for harmony. It'll have to be done somewhat efficiently.

@calclavia then more inputs will be provided to the network, the instrumentation data. ;)