RAM issue: MPS backend out of memory
davidkamp opened this issue · comments
dadadadadada commented
Hi,
I am running AUDIOLDM2 on a M1 macbook air with 16GB of Ram on Ventura 13.5.
On my second test I ran out of memory quickly:
RuntimeError: MPS backend out of memory (MPS allocated: 18.02 GB, other allocations: 107.10 MB, max allowed: 18.13 GB). Tried to allocate 4.50 MB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure).
Is there any way to prevent this, especially when using the inputtext list option?
Is there a workaround or trick to keep this from crashing on my machine?
Thank you!