lucidrains / DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

batchsize affects the quality of reconstructed images when training dvae

CCchenxiaoxue opened this issue · comments

when I set batch=512, the quality of reconstructed images is worse compared with batch=8, does anyone know how to fix it? thank you~

Batch size and learning rate should be adjusted accordingly to each other. For optimizers like Adam it may not be that important but try to reduce your learning rate when you increase your batch size and vice versa