liutaocode / DiffDub

[ICASSP 2024] DiffDub: Person-generic visual dubbing using inpainting renderer with diffusion auto-encoder

DiffDub

For demos, please Visit https://liutaocode.github.io/DiffDub/

Data Processing

Please refer to Here

Inference Code

Updating...

Apologies for the delay. We are currently preparing another talking face project and considering merging the code into this project. As soon as we complete the preparations, we will provide a link to the new repository.

Reference

@inproceedings{liu2024diffdub,
  title={DiffDub: Person-Generic Visual Dubbing Using Inpainting Renderer with Diffusion Auto-Encoder},
  author={Liu, Tao and Du, Chenpeng and Fan, Shuai and Chen, Feilong and Yu, Kai},
  booktitle={ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
  pages={3630--3634},
  year={2024},
  organization={IEEE}
}