haoheliu / AudioLDM2

Text-to-Audio/Music Generation

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Will there be models for AudioLDM2 that run on 12GB VRAM Cards?

CRCODE22 opened this issue · comments

return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking)
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 20.00 MiB (GPU 0; 12.00 GiB total capacity; 11.29 GiB already allocated; 0 bytes free; 11.32 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

The model seems to require about 20GB of memory.