ashispapu / persona

Talking head video AI generator

Persona

Tool for creating talking head videos using generative AI. Uses the following projects/libraries:

1. Tortoise-TTS - generating speech
2. SDXL-Turbo - generating the digital avatar image
3. One-Shot Free-View Neural Talking Head Synthesis - animating the face
4. Wav2Lip - using speech to generate lip movement and superimposing it on the animated face
5. Real ESRGAN - improving the image and scaling it

Examples

Santa Claus Christmas Greetings

christmas.mp4

Chinese New Year Greetings

1703560064_small.mp4

NORAD Tracking Santa

norad.mp4

Taking photos and videos

1703509324_small.mp4

Apple closing its Infinite Loop retail store

1703517174_small.mp4

Apple closing its Infinite Loop retail store (2)

1703522290_small.mp4