When I cycled through multiple images, and for each image, I cycled through multiple layers of the model, I saw an abnormal increase in memory.

Question

When I cycled through multiple images, and for each image, I cycled through multiple layers of the model, I saw an abnormal increase in memory.

LeonNerd opened this issue a year ago · comments

When I cycled through multiple images, and for each image, I cycled through multiple layers of the model, I saw an abnormal increase in memory.
I just increased the outer loop, and I found that every time I run self.model(images), it causes it to grow

AdrianCiotinga · Answer 1 · Mon Nov 27 2023 08:20:05 GMT+0800 (China Standard Time)

There is a memory leak in the forward function of YOLOV5TorchObjectDetector when assigning sliced tensors back to the original tensor, since the computational graph is kept. Going to submit a PR to fix it (since I need the computational graph), but if you don't need the computational graph wrapping your code in with torch.no_grad(): should fix the issue.