How much memory of GPU is needed for training?

Question

How much memory of GPU is needed for training?

garrisonz opened this issue a year ago · comments

I train Monohuman on a single 16G P100, but it fail with error "cuda out of memory".
May I know how much memory of GPU is needed when training. thanks

Yupeng Zhang · Answer 1 · Wed May 24 2023 15:10:58 GMT+0800 (China Standard Time)

around 30G. 32G v100 is good enough.

Zhengming Yu · Answer 2 · Fri May 26 2023 13:58:42 GMT+0800 (China Standard Time)

I train Monohuman on a single 16G P100, but it fail with error "cuda out of memory". May I know how much memory of GPU is needed when training. thanks

Hi, if your CUDA memory is not enough, you can reduce the N_patches and size configs and increase sample_subject_ratio configs in https://github.com/Yzmblog/MonoHuman/blob/main/configs/default.yaml#LL132C1-L135C40 to fit your machine.