chg0901 / IMelodist

Music model based on InternLM2-chat.

IMelodist

Music is a higher revelation than all wisdom and philosophy. — Ludwig van Beethoven

Melodist large model based on InternLM2-chat.

📖Technical Report | 🌐Video Demo

Basic Framework

How to start

安装依赖

#此处我们使用的环境是ubuntu20.04
sudo apt install $(echo -e $(cat packages.txt))
pip install -r requirements.txt

下载模型

git lfs install
git clone https://code.openxlab.org.cn/EchoPeter/IMelodist.git

运行web_demo

将IMelodist_demo.py文件中第42行的model_path改成本地IMelodist模型所在路径后，运行以下指令。

# 确保terminal所在位置为repo主目录
streamlit run chat/IMelodist_demo.py --server.address=0.0.0.0 --server.port 7860

Future

• 扩展 Internlm2-7B 的能力，接入音乐生成功能
• 更高质量的音乐知识、自我认知等数据
• 通用的 ABC 乐谱模板匹配
• 支持 ABC 乐谱格式转换 (wav, midi, etc.)

BibTeX entry and citation info

@inproceedings{DBLP:conf/hcmir/WuLY023,
  author       = {Shangda Wu and
                  Xiaobing Li and
                  Feng Yu and
                  Maosong Sun},
  editor       = {Lorenzo Porcaro and
                  Roser Batlle{-}Roca and
                  Emilia G{\'{o}}mez},
  title        = {TunesFormer: Forming Irish Tunes with Control Codes by Bar Patching},
  booktitle    = {Proceedings of the 2nd Workshop on Human-Centric Music Information
                  Retrieval 2023 co-located with the 24th International Society for
                  Music Information Retrieval Conference {(ISMIR} 2023), Milan, Italy,
                  November 10, 2023},
  series       = {{CEUR} Workshop Proceedings},
  volume       = {3528},
  publisher    = {CEUR-WS.org},
  year         = {2023},
  url          = {https://ceur-ws.org/Vol-3528/paper1.pdf},
  timestamp    = {Tue, 19 Dec 2023 17:15:12 +0100},
  biburl       = {https://dblp.org/rec/conf/hcmir/WuLY023.bib},
  bibsource    = {dblp computer science bibliography, https://dblp.org}
}

@misc{yuan2024chatmusician,
      title={ChatMusician: Understanding and Generating Music Intrinsically with LLM}, 
      author={Ruibin Yuan and Hanfeng Lin and Yi Wang and Zeyue Tian and Shangda Wu and Tianhao Shen and Ge Zhang and Yuhang Wu and Cong Liu and Ziya Zhou and Ziyang Ma and Liumeng Xue and Ziyu Wang and Qin Liu and Tianyu Zheng and Yizhi Li and Yinghao Ma and Yiming Liang and Xiaowei Chi and Ruibo Liu and Zili Wang and Pengfei Li and Jingcheng Wu and Chenghua Lin and Qifeng Liu and Tao Jiang and Wenhao Huang and Wenhu Chen and Emmanouil Benetos and Jie Fu and Gus Xia and Roger Dannenberg and Wei Xue and Shiyin Kang and Yike Guo},
      year={2024},
      eprint={2402.16153},
      archivePrefix={arXiv},
      primaryClass={cs.SD}

Acknowledgement

• 上海人工智能实验室

• 书生·浦语开源训练营 的技术指导以及算力支持

• sander-wood 和 m-a-p 的开源数据集

Contributors

Star History