👶Pacifier💤 is a tool for converting the melody of any song into a lullaby to put your baby to sleep. For a quickstart demo on how to use 👶 Pacifier 💤, have a look at this notebook.
It was developed by Bryan, Chi-Chun, Marta, and Mike as a project for the 1st The Sound of AI Hackaton.
To use 👶Pacifier💤, first create a virtual environment by typing
python3 -m venv lullaby-venv
and then install the required packages as
python3 -m pip install -r requirements.txt
This will install the following packages to your virtual environment (and dependencies thereof):
You also need to have ffmpeg, libsndfile, and sox installed on your computer.
Additionally, the first time you run 👶Pacifier💤, it needs download the spleeter pre-trained model
for isolating the melody. Those will be stored in a subfolder named pretrained_models.
The conversion to lullaby consists of several steps:
- Separating the melody from the accompaniment with spleeter
- Converting the melody to midi with basic pitch
- Slow-down the melody
- Synthesize the melody
- Add post-processing effect (low-pass filter, reverb, wave effects)
For a quickstart demo on how to use 👶Pacifier💤, have a look at this notebook
👶Pacifier💤 converts .wav, .mp3, and .mid files. To turn a song into a lullaby, run
python3 pycifier_prototype.py --input_audio=<PATH_TO_YOUR_SONG>This will execute 👶Pacifier💤 with its default parameters. Additionally, you can customize the conversion parameters by passing the following optional arguments:
| Parameter | Command |
|---|---|
Note onset threshold (float=0.6) |
--onset_threshold |
Minimum note length (int=58) |
--minimum_note_length |
Minimum note frequency (Optional[float]=None) |
--minimum_frequency |
Maximum note frequency(Optional[float]=None) |
--maximum_frequency |
Include pitch bends (bool=None) |
--include_pitch_bends |
Slowdown rate (float=2.0) |
--slowdown_rate |
By default, 👶Pacifier💤 will create several additional files in the folder where the original audio is stored. The final
lullaby is stored in the very same directory, with the name lullaby_final.wav. Additionally, files from the intermediate
steps are stored, so feel free to explore them to investigate the individual steps!
There are many ways in which you can contribute to 👶Pacifier💤! As a rule of thumb, first have a look at the issue to check which ones are open. We are still in the development/brainstorming process, so the issues are nonexhaustive and, of course, we are open to suggestions!