Giters

XLechter / SDT

Codes for Point Cloud Completion via Skeleton-Detail Transformer

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

memory keep increasing in training

MillyMaMa opened this issue · comments

commented

I ran the training code directly ,during my training, the memory usage(RAM, not GPU memory) kept increasing (at begining 1.8%, after training 3 epochs, it increased to 40%). After training several epochs ,the memory occupied too much, and the system killed the training process.

commented

This project is borrowed from https://github.com/paul007pl/ECG.git. I only add a model file to the project. RAM issues ususally happened due to repeated data loading. I checked the codes but did not find redundant data loading operations. So I am also not sure why this happened.