yunyu / wav2lip_sam

Better wav2lip model version.

Original repo: https://github.com/Rudrabha/Wav2Lip

• model size 288x288, 384x384, 512x512
• PRelu
• LeakyRelu
• Gradient penalty
• Wasserstein Loss
• SAM-UNet: https://github.com/1343744768/Multiattention-UNet

Each line on filelist should be full path

First, Train syncnet

python3 train_syncnet_sam.py

Second, train wav2lip-Sam

python3 hq_wav2lip_sam_train.py

Some demo from chinese users: primepake#89 (comment)

New Features: DINet full pipeline training

Original repo: https://github.com/MRzzm/DINet

• Syncnet training using deepspeech
• DINet frame training using deepspeech
• DINet clip training using deepspeech

Citing

To cite this repository:

@misc{Wav2Lip,
  author={Rudrabha},
  title={Wav2Lip: Accurately Lip-syncing Videos In The Wild},
  year={2020},
  url={https://github.com/Rudrabha/Wav2Lip}
}