perceptual Loss and sync loss cannot be used at the same time during training

[dy0829]

When I train the Wav2Lip model, adding the sync expert loss on top of the perceptual loss causes the training to collapse. I noticed that you also use perceptual loss in your training process, and I'm wondering if you have encountered a similar situation. If so, how did you solve it?

[Sahil Goyal]

I didn't encounter such a situation during training. Also, I cannot think of a reason why perceptual loss and sync loss cannot be used simultaneously. However, I did encounter a situation where my training collapsed even before adding perceptual loss. I changed the optimizer's hyperparameters a bit for the same (here).

[dy0829]

Thanks for your reply. I will check my code again.