How to do voice cloning with Tortoise TTS?
Gushousekai195 opened this issue · comments
How can I clone a voice using Tortoise TTS in this webui? Please help?
Tortoise has more than one way to do it.
The "cheapest" way is to give it some mp3 files, you can do it with this UI.
If you want to fine-tune/train the voice, you need another UI as well. Once you have trained it, you can use the new voice in this UI.
Which one do you want?
The cheapest way
Get some mp3 files of the voice you want, then put them in a folder. Next you will need to put these in the tortoise voices folder. I can't access my workstation at the minute but I think it was voices-tortoise inside the tts-generation-webui directory.
Then you can see the folder name as a voice in the drop-down selection.
Uhh... is this normal?
Yes, but I can't see if you selected a voice
Default means it's not a fine-tuned version
Yes, but I can't see if you selected a voice
Default means it's not a fine-tuned version
I mean the time it takes to generate autoregressive samples. Is it supposed to take that long?
That's slow. Might be using CPU not GPU. Also might have a lot of autoregressive samples too.
You can check the task manager to see if GPU is even moving from this.
That's slow. Might be using CPU not GPU. Also might have a lot of autoregressive samples too.
You can check the task manager to see if GPU is even moving from this.
CPU usage was at 70%.
How do I make it use GPU?
Might be an installation issue. I'll need my workstation, talk to you tomorrow. The core issue is usually pytorch being the wrong version.
…
On Wed, Jan 10, 2024, 12:14 AM Gushousekai195 @.> wrote: That's slow. Might be using CPU not GPU. Also might have a lot of autoregressive samples too. You can check the task manager to see if GPU is even moving from this. CPU usage was at 70%. How do I make it use GPU? — Reply to this email directly, view it on GitHub <#242 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXI5WKOSC2DWN3WGKMHDYNW6K7AVCNFSM6AAAAABBTYYDGSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBTHA4DMNRTHA . You are receiving this because you modified the open/close state.Message ID: @.>
So if it's pytorch being the wrong version, how do I install the right version then?
Did you use the one click installer? And select NVidia GPU?
Did you use the one click installer? And select NVidia GPU?
Yes, I believe I did.
Right, then it sounds like an installation issue.
We can try to find what went wrong, or we can try to fix it.
Also, there's always the option of just trying to install again.
If you do install again or retry, the logs are very important.
Right, then it sounds like an installation issue. We can try to find what went wrong, or we can try to fix it. Also, there's always the option of just trying to install again. If you do install again or retry, the logs are very important.
Like this?
installation log.txt
Ok, I can see some errors and confirm that it's a cpu only install:
InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\pytorch-2.0.0-py3.10_cuda11.7_cudnn8_0.tar.bz2. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\pytorch-2.0.0-py3.10_cuda11.7_cudnn8_0\\\\Lib\\\\site-packages\\\\torch\\\\distributed\\\\_shard\\\\sharding_spec\\\\chunk_sharding_spec_ops\\\\__pycache__\\\\__init__.cpython-310.pyc'")
First time seeing this error, so this might just be an unlucky/interrupted download or a corrupt file cache etc.
What you could do is a clean reinstall, where you delete the installer files directory.
Please let me know if that's what you already did, maybe there's some other issue happening here. Also, do you have enough space on your hard disk, is it not full?
I get to this point and it just stops
Downloading and Extracting Packages
libwebp-1.3.2 | 73 KB | ############################################################################ | 100%
mpir-3.0.0 | 1.3 MB | ############################################################################ | 100%
libcublas-11.10.1.25 | 24 KB | ############################################################################ | 100%
cffi-1.16.0 | 244 KB | ############################################################################ | 100%
libcurand-10.2.10.50 | 3 KB | ############################################################################ | 100%
freetype-2.12.1 | 490 KB | ############################################################################ | 100%
cuda-sanitizer-api-1 | 12.6 MB | ############################################################################ | 100%
pytorch-2.0.0 | 1.17 GB | ###########################################################################6 | 99%
certifi-2023.11.17 | 159 KB | ############################################################################ | 100%
tbb-2021.8.0 | 149 KB | ############################################################################ | 100%
pyopenssl-23.2.0 | 97 KB | ############################################################################ | 100%
lerc-3.0 | 120 KB | ############################################################################ | 100%
urllib3-1.26.18 | 200 KB | ############################################################################ | 100%
libcusolver-11.3.5.5 | 29 KB | ############################################################################ | 100%
libuv-1.44.2 | 288 KB | ############################################################################ | 100%
mpfr-4.0.2 | 1.5 MB | ############################################################################ | 100%
cuda-visual-tools-11 | 1 KB | ############################################################################ | 100%
git-2.40.1 | 69.2 MB | ############################################################################ | 100%
mkl_fft-1.3.8 | 170 KB | ############################################################################ | 100%
cuda-cccl-11.7.58 | 1.2 MB | ############################################################################ | 100%
lz4-c-1.9.4 | 143 KB | ############################################################################ | 100%
libtiff-4.5.1 | 1.1 MB | ############################################################################ | 100%
cuda-tools-11.7.0 | 1 KB | ############################################################################ | 100%
cuda-nsight-compute- | 1 KB | ############################################################################ | 100%
cuda-nvrtc-dev-11.7. | 14.3 MB | ############################################################################ | 100%
libcublas-dev-11.10. | 286.3 MB | ############################################################################ | 100%
cryptography-41.0.7 | 1.1 MB | ############################################################################ | 100%
networkx-3.1 | 2.7 MB | ##########################################################################8 | 99%
... (more hidden) ...
And then after a while this happens:
InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\networkx-3.1-py310haa95532_0.conda. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\networkx-3.1-py310haa95532_0\\\\Lib\\\\site-packages\\\\networkx\\\\algorithms\\\\centrality\\\\tests\\\\__pycache__\\\\test_current_flow_betweenness_centrality_subset.cpython-310.pyc'")
InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\cuda-nvvp-11.7.50-0.tar.bz2. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [WinError 206] The filename or extension is too long: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\cuda-nvvp-11.7.50-0\\\\libnvvp\\\\features\\\\org.eclipse.rse.local_2.1.500.201406020016\\\\META-INF\\\\maven\\\\org.eclipse.tm.features\\\\org.eclipse.rse.local'")
InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\pytorch-2.0.0-py3.10_cuda11.7_cudnn8_0.tar.bz2. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\pytorch-2.0.0-py3.10_cuda11.7_cudnn8_0\\\\Lib\\\\site-packages\\\\torch\\\\distributed\\\\_shard\\\\sharding_spec\\\\chunk_sharding_spec_ops\\\\__pycache__\\\\__init__.cpython-310.pyc'")
I even redownloaded the installers.
That's quite something.. it freezes at 99% and then crashes? Wow.
You can try manually installing just the pytorch by using cmd_windows.bat then
conda install pytorch==2.0.0 torchvision==0.15.0 torchaudio==2.0.0 pytorch-cuda=11.8 -c pytorch -c nvidia
That's quite something.. it freezes at 99% and then crashes? Wow. You can try manually installing just the pytorch by using cmd_windows.bat then
conda install pytorch==2.0.0 torchvision==0.15.0 torchaudio==2.0.0 pytorch-cuda=11.8 -c pytorch -c nvidia
Still having problems
Downloading and Extracting Packages
InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\networkx-3.1-py310haa95532_0.conda. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\networkx-3.1-py310haa95532_0\\\\Lib\\\\site-packages\\\\networkx\\\\algorithms\\\\centrality\\\\tests\\\\__pycache__\\\\test_current_flow_betweenness_centrality_subset.cpython-310.pyc'")
InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\pytorch-2.0.0-py3.10_cuda11.8_cudnn8_0.tar.bz2. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\pytorch-2.0.0-py3.10_cuda11.8_cudnn8_0\\\\Lib\\\\site-packages\\\\torch\\\\distributed\\\\_shard\\\\sharding_spec\\\\chunk_sharding_spec_ops\\\\__pycache__\\\\__init__.cpython-310.pyc'")
Sounds like something is wrong with conda, their project is here: https://github.com/conda/conda/issues
There might be an alternative way to install using pip not conda, but I'm a bit surprised that it failed so consistently.
Sounds like something is wrong with conda, their project is here: https://github.com/conda/conda/issues There might be an alternative way to install using pip not conda, but I'm a bit surprised that it failed so consistently.
Do you know how it can be done using pip then?
This might work, but I am not 100% sure:
with cmd_windows.bat:
pip3 install torch==2.0.0 torchvision==0.15.0 torchaudio==2.0.0 --index-url https://download.pytorch.org/whl/cu118
I'm not sure if 2.0.0 will install the right torch in this case. It might be 2.0.0+cu118
Now I cannot start the webui at all:
Traceback (most recent call last):
File "C:\Users\mattb\Desktop\one-click-installers-tts-6.0\one-click-installers-tts-6.0\tts-generation-webui\server.py", line 40, in <module>
from src.tortoise.generation_tab_tortoise import generation_tab_tortoise
File "C:\Users\mattb\Desktop\one-click-installers-tts-6.0\one-click-installers-tts-6.0\tts-generation-webui\src\tortoise\generation_tab_tortoise.py", line 7, in <module>
from src.tortoise.gen_tortoise import (
File "C:\Users\mattb\Desktop\one-click-installers-tts-6.0\one-click-installers-tts-6.0\tts-generation-webui\src\tortoise\gen_tortoise.py", line 7, in <module>
from tortoise.api import TextToSpeech, MODELS_DIR
File "C:\Users\mattb\Desktop\one-click-installers-tts-6.0\one-click-installers-tts-6.0\installer_files\env\lib\site-packages\tortoise\api.py", line 10, in <module>
import torchaudio
File "C:\Users\mattb\Desktop\one-click-installers-tts-6.0\one-click-installers-tts-6.0\installer_files\env\lib\site-packages\torchaudio\__init__.py", line 1, in <module>
from torchaudio import ( # noqa: F401
File "C:\Users\mattb\Desktop\one-click-installers-tts-6.0\one-click-installers-tts-6.0\installer_files\env\lib\site-packages\torchaudio\_extension\__init__.py", line 43, in <module>
_load_lib("libtorchaudio")
File "C:\Users\mattb\Desktop\one-click-installers-tts-6.0\one-click-installers-tts-6.0\installer_files\env\lib\site-packages\torchaudio\_extension\utils.py", line 61, in _load_lib
torch.ops.load_library(path)
File "C:\Users\mattb\Desktop\one-click-installers-tts-6.0\one-click-installers-tts-6.0\installer_files\env\lib\site-packages\torch\_ops.py", line 643, in load_library
ctypes.CDLL(path)
File "C:\Users\mattb\Desktop\one-click-installers-tts-6.0\one-click-installers-tts-6.0\installer_files\env\lib\ctypes\__init__.py", line 374, in __init__
self._handle = _dlopen(self._name, mode)
FileNotFoundError: Could not find module 'C:\Users\mattb\Desktop\one-click-installers-tts-6.0\one-click-installers-tts-6.0\installer_files\env\Lib\site-packages\torchaudio\lib\libtorchaudio.pyd' (or one of its dependencies). Try using the full path with constructor syntax.
Done!
Press any key to continue . . .
try
conda install pytorch==2.0.0 torchvision==0.15.0 torchaudio==2.0.0 pytorch-cuda=11.8 -c pytorch -c nvidia
then update_windows.bat
installing pytorch is a pain, even more so with pip. I really wish conda would fix their issue or provide you with a solution.
I just want a webui I can voice clone with tortoise-tts with!
try
conda install pytorch==2.0.0 torchvision==0.15.0 torchaudio==2.0.0 pytorch-cuda=11.8 -c pytorch -c nvidiathen update_windows.bat
Downloading and Extracting Packages
InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\networkx-3.1-py310haa95532_0.conda. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\networkx-3.1-py310haa95532_0\\\\Lib\\\\site-packages\\\\networkx\\\\algorithms\\\\centrality\\\\tests\\\\__pycache__\\\\test_current_flow_betweenness_centrality_subset.cpython-310.pyc'")
InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\pytorch-2.0.0-py3.10_cuda11.8_cudnn8_0.tar.bz2. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\pytorch-2.0.0-py3.10_cuda11.8_cudnn8_0\\\\Lib\\\\site-packages\\\\torch\\\\distributed\\\\_shard\\\\sharding_spec\\\\chunk_sharding_spec_ops\\\\__pycache__\\\\__init__.cpython-310.pyc'")
I just want a webui I can voice clone with tortoise-tts with!
try
conda install pytorch==2.0.0 torchvision==0.15.0 torchaudio==2.0.0 pytorch-cuda=11.8 -c pytorch -c nvidiathen update_windows.bat
Downloading and Extracting Packages InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\networkx-3.1-py310haa95532_0.conda. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\networkx-3.1-py310haa95532_0\\\\Lib\\\\site-packages\\\\networkx\\\\algorithms\\\\centrality\\\\tests\\\\__pycache__\\\\test_current_flow_betweenness_centrality_subset.cpython-310.pyc'") InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\pytorch-2.0.0-py3.10_cuda11.8_cudnn8_0.tar.bz2. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\pytorch-2.0.0-py3.10_cuda11.8_cudnn8_0\\\\Lib\\\\site-packages\\\\torch\\\\distributed\\\\_shard\\\\sharding_spec\\\\chunk_sharding_spec_ops\\\\__pycache__\\\\__init__.cpython-310.pyc'")
I just want conda to work without mysterious errors for an user of my webui.
I just want a webui I can voice clone with tortoise-tts with!
try
conda install pytorch==2.0.0 torchvision==0.15.0 torchaudio==2.0.0 pytorch-cuda=11.8 -c pytorch -c nvidiathen update_windows.bat
Downloading and Extracting Packages InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\networkx-3.1-py310haa95532_0.conda. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\networkx-3.1-py310haa95532_0\\\\Lib\\\\site-packages\\\\networkx\\\\algorithms\\\\centrality\\\\tests\\\\__pycache__\\\\test_current_flow_betweenness_centrality_subset.cpython-310.pyc'") InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\pytorch-2.0.0-py3.10_cuda11.8_cudnn8_0.tar.bz2. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\pytorch-2.0.0-py3.10_cuda11.8_cudnn8_0\\\\Lib\\\\site-packages\\\\torch\\\\distributed\\\\_shard\\\\sharding_spec\\\\chunk_sharding_spec_ops\\\\__pycache__\\\\__init__.cpython-310.pyc'")
I think there are some youtube tutorials for installing other tortoise-tts projects like MRQ, those installations might just work.
I just want a webui I can voice clone with tortoise-tts with!
try
conda install pytorch==2.0.0 torchvision==0.15.0 torchaudio==2.0.0 pytorch-cuda=11.8 -c pytorch -c nvidiathen update_windows.bat
Downloading and Extracting Packages InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\networkx-3.1-py310haa95532_0.conda. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\networkx-3.1-py310haa95532_0\\\\Lib\\\\site-packages\\\\networkx\\\\algorithms\\\\centrality\\\\tests\\\\__pycache__\\\\test_current_flow_betweenness_centrality_subset.cpython-310.pyc'") InvalidArchiveError("Error with archive C:\\Users\\mattb\\Desktop\\one-click-installers-tts-6.0\\one-click-installers-tts-6.0\\installer_files\\conda\\pkgs\\pytorch-2.0.0-py3.10_cuda11.8_cudnn8_0.tar.bz2. You probably need to delete and re-download or re-create this file. Message was:\n\nfailed with error: [Errno 2] No such file or directory: 'C:\\\\Users\\\\mattb\\\\Desktop\\\\one-click-installers-tts-6.0\\\\one-click-installers-tts-6.0\\\\installer_files\\\\conda\\\\pkgs\\\\pytorch-2.0.0-py3.10_cuda11.8_cudnn8_0\\\\Lib\\\\site-packages\\\\torch\\\\distributed\\\\_shard\\\\sharding_spec\\\\chunk_sharding_spec_ops\\\\__pycache__\\\\__init__.cpython-310.pyc'")I think there are some youtube tutorials for installing other tortoise-tts projects like MRQ, those installations might just work.
Anything with a ui?
MRQ has UI afaik
MRQ has UI afaik
Can you give me a link to it please?
For training a voice (I assume this is similar to training a LoRA a la Stable Diffusion?), you mentioned that there might be a UI somewhere... Pointers? A lot of this stuff is still word-of-mouth it seems.
EDIT: I think this is what @rsxdalv was referring to: https://git.ecker.tech/mrq/ai-voice-cloning