facebookresearch / labgraph

LabGraph is a Python framework for rapidly prototyping experimental systems for real-time streaming applications. It is particularly well-suited to real-time neuroscience, physiology and psychology experiments.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

LabGraph AudioGen

jfResearchEng opened this issue · comments

commented

🚀 Feature

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

A command-line interface (CLI) is a means of interacting with a computer program by inputting lines of text called command-lines.

This project focuses on the following use cases using python-based CLI (i.e. python command) in a Windows environment:
Given a text input (e.g. a dog is barking in a restaurant), generates the audio using musicGen
Given a text input (e.g. happy mood in a rainy day), generates the music using audioGen
Given a text description of a person’s daily activities, generate a series of music and audio
Given a high fidelity audio input, conduct audio reconstruction using EnCodec

Additional context

Example application can be found here
The code should be added at folder is https://github.com/facebookresearch/labgraph/tree/main/extensions/labgraph_audiogen
Create setup.py and README.md, where example can be found at: https://github.com/facebookresearch/labgraph/tree/main/extensions/labgraph_viz
Add github action support, reference: https://github.com/facebookresearch/labgraph/actions/workflows/main.yml
Add proper license header.