NVIDIA NeMo
Introduction
NeMo is a toolkit for creating Conversational AI applications.
The toolkit comes with extendable collections of pre-built modules and ready-to-use models for Automatic Speech Recognition (ASR), Natual Language Processing (NLP) and Text-to-Speech (TTS).
Built for speed, NeMo can utilize NVIDIA's Tensor Cores and scale out training to multiple GPUs and multiple nodes.
Requirements
- Python 3.6, 3.7 or 3.8
- Pytorch 1.7.1. WARNING: This version currently does not support Pytorch 1.8.0
- NVIDIA GPU for training
Documentation
Version | Status | Description |
---|---|---|
Latest | Documentation of the latest (i.e. main) branch. | |
Next | Documentation of the most recent release: r1.0.0rc1 | |
Stable | Documentation of the stable (i.e. stable) branch. |
Tutorials
A great way to start with NeMo is by checking one of our tutorials.
Getting help with NeMo
FAQ can be found on NeMo's Discussions board. You are welcome to ask questions or start discussions there.
Installation
Pip
Use this installation mode if you want the latest released version.
apt-get update && apt-get install -y libsndfile1 ffmpeg
pip install Cython
pip install nemo_toolkit['all']==1.0.0rc1
Pip from source
Use this installation mode if you want the a version from particular GitHub branch (e.g main).
apt-get update && apt-get install -y libsndfile1 ffmpeg
pip install Cython
python -m pip install git+https://github.com/NVIDIA/NeMo.git@{BRANCH}#egg=nemo_toolkit[all]
From source
Use this installation mode if you are contributing to NeMo.
apt-get update && apt-get install -y libsndfile1 ffmpeg
git clone https://github.com/NVIDIA/NeMo
cd NeMo
./reinstall.sh
Docker containers:
The easiest way to start training with NeMo is by using NeMo's container. It has all requirements and NeMo 1.0.0b3 already installed.
docker run --gpus all -it --rm --shm-size=8g \
-p 8888:8888 -p 6006:6006 --ulimit memlock=-1 --ulimit \
stack=67108864 --device=/dev/snd nvcr.io/nvidia/nemo:1.0.0rc1
If you chose to work with main branch, we recommend using NVIDIA's PyTorch container version 20.11-py3 and then installing from GitHub.
docker run --gpus all -it --rm -v <nemo_github_folder>:/NeMo --shm-size=8g \
-p 8888:8888 -p 6006:6006 --ulimit memlock=-1 --ulimit \
stack=67108864 --device=/dev/snd nvcr.io/nvidia/pytorch:21.03-py3
Examples
Many example can be found under "Examples" folder.
Contributing
We welcome community contributions! Please refer to the CONTRIBUTING.md CONTRIBUTING.md for the process.
License
NeMo is under Apache 2.0 license.