How can I reduce GPU memory usage?
sanbuphy opened this issue · comments
Hello, I think this model works very well, but the GPU memory usage is too high during refinement. Could you please advise me on how to reduce the memory usage during refinement? Thank you!
@sanbuphy You can reduce the GPU memory by changing the batch size while training the model.
Example: python bin/train.py -cn lama-fourier data.batch_size=8
You can adjust the batch size as per your memory usage.