got Out of GPU memory when learning
A-Cepheus opened this issue · comments
A-Cepheus commented
A-Cepheus commented
Maybe I should continue reduce batch size?
Jonathan Laurent commented
You should probably reduce batch size indeed.
A-Cepheus commented
Jonathan Laurent commented
Out of memory errors are often shown as other errors. I would reduce the batch size and/or network size even further.
A-Cepheus commented
I feel that the problem with OOM is indeed accompanied by mem_ buff Appearing as the size increases.
A-Cepheus commented
This is a possible reason that I am researching: FluxML/FluxTraining.jl#148