mdotstrange / AutoLipSync

A simple Unity C# script that will drive a lower jaw based on audio amplitude from an audio clip. It uses a low pass filter to smooth the output. A custom SLATE action is included called "PlayAudioWithLipSync" use it in Slate to drive the jaw in your cutscenes.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Simple auto lip sync script for Unity

alt text

Made using AutoLipSync

A simple Unity C# script that will drive a lower jaw based on audio amplitude from an audio clip. It uses a low pass filter to smooth the output. A custom SLATE action is included called "PlayAudioWithLipSync" use it in Slate to drive the jaw in your cutscenes.

AutojawSync script alt text

*Set the audio source and adjust the sensitivity and min/max to your liking

Slate action alt text

*When using the Slate action, Slate will populate the Audiosource variable so you can leave it empty. Don't forget to drag/drop the AutoJawSync script into the field at the bottom of the Slate action.

SLATE cutscene editor is much nicer than Timeline imo as a professional animation filmmaker

Speechblend action alt text

Speechblend is a Unity asset that does basic lip sync with visemes- it works nicely with Daz Models

NOTES

-The "Live jaw rotation output" variable is just for debugging purposes, it is the output of the jaw rotation so changing it won't do anything -This script works best with audio files that have been compressed and don't have any background noise, so use gate + compression on your audio files for best results. -Package includes working example head model from above gif(Includes texture hence the large file size)

About

A simple Unity C# script that will drive a lower jaw based on audio amplitude from an audio clip. It uses a low pass filter to smooth the output. A custom SLATE action is included called "PlayAudioWithLipSync" use it in Slate to drive the jaw in your cutscenes.


Languages

Language:C# 100.0%