lukewys / ISMIR2022-tutorial

Repository for ISMIR 2022 tutorial T3(M): Designing Controllable Synthesis System for Musical Signals

ISMIR2022-tutorial

This is a resource repository for ISMIR 2022 tutorial T3(M): Designing Controllable Synthesis System for Musical Signals.

Presenters: Hyeong-Seok Choi and Yusong Wu.

Slides

Please find the slides for each part below:

Part 1 (1st hour): https://docs.google.com/presentation/d/1hrvXR6sm56U_I4hn9HOXCUf-hNZO2FDJg227GvvoyH8/edit?usp=sharing

Part 2 (2nd hour): https://docs.google.com/presentation/d/1AbQfIUfWWcFIS7QO6A-nJJm4zIvXzbhG/edit?usp=share_link&ouid=110105229055630204908&rtpof=true&sd=true

Part 3 (3rd hour): https://docs.google.com/presentation/d/1xrzeAIMnVOumSql_L2oIfVMXcJxOKd3F2u4_DEIkmbY/edit?usp=sharing

References

Please find the references for each part below:

Part 1 (1st hour): ref_hour1.md

Part 2 (2nd hour): ref_hour2.md

Part 3 (3rd hour): ref_hour3.md

Colab for DDSP and MIDI-DDSP in part 3

Unfortunately Yusong cannot come to the conference in person due to visa restrictions. Thus, we will not be able to run the walk-through of Colab codes for part 3 of the tutorial. We included all the links to the Colab regarding how to build and use DDSP and MIDI-DDSP. They should be straightforward and easy to follow.

DDSP Colabs (all): https://github.com/magenta/ddsp/tree/main/ddsp/colab

DDSP Tutorial Colabs:

(excerpt from DDSP Tutorial Colabs):

• 0_processor: Introduction to the Processor class.

• 1_synths_and_effects: Example usage of processors.

• 2_processor_group: Stringing processors together in a ProcessorGroup.

• 3_training: Example of training on a single sound.

• 4_core_functions: Extensive examples for most of the core DDSP functions.

MIDI-DDSP Colab: an example of how to use MIDI-DDSP controls.

For details of MIDI-DDSP, please refer to MIDI-DDSP Training and MIDI-DDSP Code Examples.

Acknowledgments

We would like to thank Halley Young for pointers to literatures on controllable symbolic music generation.