[CUDA out of memory] ResNet18 & Cifar100

[Hoang-Chau Luong]

Hi logancyang, I have successfully run your code using ResNet18 on Cifar100 with bs=16, epochs=200. However, during the 4th epoch, the GPU VRAM overflowed. Upon reviewing the code, I found that this line is causing the GPU RAM to accumulate at each step. Do you have a solution for this problem?

loss-landscape-anim/loss_landscape_anim/model.py

Line 180 in a8d5610

 flat_w = self.get_flat_params() 

[Logan Yang]

hi @lhchau, thanks for checking this out. This project is not actively maintained at the moment, but feel free to make your own fork if you have time to implement a solution.

[alqurri77]

I also had the same issue. any solution @lhchau