haoheliu / AudioLDM2

Text-to-Audio/Music Generation

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

RAM issue: MPS backend out of memory

davidkamp opened this issue · comments

Hi,
I am running AUDIOLDM2 on a M1 macbook air with 16GB of Ram on Ventura 13.5.

On my second test I ran out of memory quickly:
RuntimeError: MPS backend out of memory (MPS allocated: 18.02 GB, other allocations: 107.10 MB, max allowed: 18.13 GB). Tried to allocate 4.50 MB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure).

Is there any way to prevent this, especially when using the inputtext list option?

Is there a workaround or trick to keep this from crashing on my machine?

Thank you!