phillipi / pix2pix

Image-to-image translation with conditional adversarial nets

Home Page:https://phillipi.github.io/pix2pix/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Guidance Needed for Selecting Best Epoch/Weights in Pix2Pix Training

yagobilel opened this issue · comments

Hello,

I've been training a Pix2Pix model for an image-to-image translation task and have reached a point where I need some advice on selecting the best epoch/weights based on the training metrics. My main goal is to achieve high-quality image generation that closely matches the target domain while maintaining a good balance in the adversarial training process.

Here are the types of metrics I'm observing at various epochs (example from epoch 1):
(epoch: 1, iters: 8000, time: 0.019, data: 0.003) G_GAN: 3.125 G_L1: 25.956 D_real: 0.038 D_fake: 0.073

I understand that lower G_GAN, G_GAN_Feat, and G_VGG values are desirable as they indicate that the generator is effectively fooling the discriminator and generating images that are close in feature and perceptual quality to the target images. However, I'm unsure how to balance these metrics optimally and what to consider an acceptable range for D_real and D_fake to ensure the discriminator is functioning effectively without overpowering the generator.

Questions:

1-How should I interpret the balance between G_GAN, G_GAN_Feat, and G_VGG losses in selecting the best epoch for my model?
2-What are the ideal ranges or balance for D_real and D_fake losses to ensure effective learning without causing the discriminator to overpower the generator or vice versa?
3-Beyond the numeric metrics, what visual quality aspects should I prioritize in the generated images when manually reviewing them for selecting the best model weights?
4-Are there any community recommendations or best practices for monitoring and deciding on the best epoch/weights in Pix2Pix or similar GAN-based models?
Any insights, recommendations, or references to relevant resources would be greatly appreciated. Thank you for your time and assistance.

Best regards,