hnhparitosh / ParakeetLipSync

An automatic lipsync tool for 2d animations.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Parakeet Lip Sync

Parakeet Lip Sync is an automatic lip-syncing tool that helps to create 2d mouth animations from the audio recordings.

It is inspired from the existing lip-sync softwares like Papagayo, Yolo and Rhubarb. Currently, the existing lip-sync softwares do not use the latest deep learning techniques to generate the lip-syncs or they are not open-source.

Parakeet Lip Sync is an attempt to solve this problem. It uses the latest deep learning techniques to generate the qood quality lip-syncs and is open-source.

This project is under development. Don't be suprised if it crashes, burns, eats your lunch, or fails to behave as it's supposed to.

A video tutorial on how to use Parakeet Lip sync is coming soon.

Todos for the project

  • A minimalistic GUI.
  • Automatic lip-sync.
  • Support for exporting Moho Timesheet (.dat).
  • Common keyboard shortcuts ctrl + o, ctrl + s, etc.
  • Support for exporting Toei Digital Exposure Sheet (.xdts).
  • A MouthView to view the generated output.
  • A WaveformView to edit the generated output.

How to use

  • Clone this repository.
  • Install the dependencies using pip install -r requirements.txt
  • Run the application using python main.py

Screenshot

Screentshot

About

An automatic lipsync tool for 2d animations.


Languages

Language:Python 100.0%