With Auto Lip-Sync you can create a mouth that automatically animates according to your voice recording.

Features

Automatic Animation Fully automatic movement of the mouth - no need for keyframes

Step by Step Wizard The step by step wizard guides you though the process.

Mouth Interior Animation Optional animation of teeth and tongue - fully automatic and easy to adjust.

Fine Tuning Easy and quick fine-tuning on top of the automatic animation: Control with convenient slider controls how wide the mouth opens and how it deforms, adjust the shape of the opened or closed mouth and set markers at points where you feel the mouth should have more of an O-shape.

Talking tree with Auto Lip-Sync

Examples

"Froggy Girl" by Eric D. Kirk, winner of the Auto Lip-Sync contest

"A Story of Hope" by Funky Medics. Auto Lip-Sync can also create a sketchy, cartoon like mouth animation. And its a good team player with other AE plugins - in this case with FreeForm Pro.

"Robin, the talking Chipmunk"

300 Mashed Potatoes

300 Mashed Potatoes, re-enactment of a scene from 300.

Speechless

Speechless by Senzagiridiparole (won second prize in Auto Lip-Sync contest).

A Bagels Life

A Bagels Life by Aaron Waller (won third prize in Auto Lip-Sync contest).

User Interface: 

Comments

Can you please make a tutorial how to create a similar Project like "A Bagels Life by Aaron Waller" with moving eyes?
Thanks

Hi James,

thank you for this suggestion. I will put it on my list for tutorial ideas.

For blinking eyes, you can check out the tutorial for the change at marker 2D iExpression:

http://mamoworld.com/after-effects-expression/change-marker-2d

 

Cheers,

Mathias

Hi,

I'm getting a message saying I can update my 1.01 version of Auto-Lip-Sync to 1.03 by going to the website. However, I can't seem to find how? Will I have to buy the update or is it free for registered users?

Best regards,
Bas van den Biggelaar

Found it ;-)

Hi Bas, its a free update. To install it, you can simply download and install the trial from here:

http://aescripts.com/auto-lip-sync

Your existing license will automatically be determined such that it turns into the full version.

Cheers,

Mathias

Hi I downloaded the auto-lip-sync to try. I have a stop frame animation with a moving mouth and a soundtrack to go with it. Just now the mouth opens and closes but not in sync. How do I work out the timing if the mouth already moves?

Thanks Jo

The three masks re not getting creating in the animation layer. V1.03. I got the masks once, but I have tried a very simple mouth rig with very little warps several times and they won't show under the layer.

What am missing?

Hi Gregg, sorry for the late reply. The masks should be created. If it does not work, create a support ticket here and give me as many details as possible. Best upload some screenshots of what you are doing - the better I understand your project, the quicker I will be able to help. http://aescripts.com/contact/ Cheers, Mathias

Hi, if my footage is already smiling with open mouth and teeth, how can I animate it thru the plug in?

Hi Amir,

in the first step, with the "Straighten Mouth Liquify" effect, you need to get rid of the smile and make sure the mouth is a straight line. When forming the final mouth shapes later, you can reintroduce the smile. For the teeth, you need to create new teeth on a layer below the actual mouth.

Thanks, but what if my mouth is like in this photo:

https://www.google.co.il/search?q=emoji+smile&safe=off&es_sm=119&tbm=isc...

I can't really straighten/reintroduce it.

Is there any solution for this?

Then better choose another footage or experiment with any other warping or painting technique in AE to make the mouth look closed before applying Auto Lip-Sync.

How can I do a 3/4 view of a mouth? When I applied the plugin, it looks like the character is talking from the side of his mouth.

Hi Chris,

3/4 view is complicated.
Depending on how much the head is visible from the side do the following: If both ends of the mouth are still visible, just try to shape the open and closed mouth in step 3 and 4 of Auto Lip-Sync such that it looks good. Don't hesitate to heavily deform the mouth shape.

If one corner of the mouth is not visible anymore, in addition do what is shown for a mouth visible from the side in this tutorial:
http://mamoworld.com/tutorials/how-we-created-robin-talking-chipmunk

Cheers,
Mathias

PS: Here is such an example: http://mamoworld.com/tutorials/behind-scenes-what-my-dog-thinks-about-cr... It is done like the chipmunk, but it is not half of the mouth that is "outside of the character" but only a small part of it. Apart from that is is all just done with heavy reshaping in steps 3 and 4 (the left part of the mouth is reshaped to open much more than the right part etc). Also note that you can finetune the keyframes of the Shape Mouth Liquify effect at any time later to improve what you did in steps 3 and 4. Just make sure to do not add additional keyframes but only modify the two existing ones (open and closed mouth shape).

Does the LIp-Sync program work with any audio file format? Also can you make a short tutorial with two people talking using the program.

Hi Joseph,
yes, Auto Lip-Sync works with any audio format supported by After Effects, also with the audio track of a video, for example.

To create a dialog of two people talking, the main thing you need to understand is that Auto Lip-Sync always uses all audio that is currently audible when you run it. This means if you have the voices of the two people on two separate audio files, you just need to mute person B when creating the mouth of person A and vice versa.
If you have the voice of both people in the same audio file, I recommend to duplicate the audio layer and keyframe the audio levels of it such that only one of them is audible (i.e. set to silence where the other person is talking).

Cheers,
Mathias

Thanks a lot. Also one more question. I did my first conversion. But the markers aren't doing anything to make the O and other sounds. Any suggestions. I did move the masks around some. I tried playing with the Effect Controls and still nothing.

Hi Joseph,

please make sure that 

  • you set markers on this layer, not composition markers,
  • the slider "additional O-Shape at markers" has a value that is large enough,
  • the O-Shape deformation effect is not disabled

If all of this doesn't help, please send me the project to info@mamoworld.com and I will take a look.

Cheers,

Mathias

Hi
Is it possible to replace an audio track after the rig has already been set up? I have a character that shows up in multiple scenes, I would love to rig her head only one time.
Thanks for a great plugin!

Hi Mike,

yes, here is a tutorial that shows how to do this:

http://mamoworld.com/tutorials/auto-lip-sync-how-replace-audio-after-cre...

Cheers,

Mathias

How do you control facial expressions with Auto Lipsync? eg: smiling, fretting, etc... Also, it would be nice to include some screen shots of the interface on this page (might have made my question redundant). Many thanks

For facial expressions you best add additional warp effects (like Mesh Warp or Liquify) on top of Auto Lip-Sync.
To keep everything clean and organized, I recommend to apply such additional effects on a separate adjustment layer on top of the Auto Lip-Sync layer.

If you keyframe the distortion mesh of Mesh Warp or Liquify, you can transition from one expression to another one.

Thank you for replying so quickly, and for the tip. Are there any plans to introduce a slider control for curving the mouth up or down at the ends? So as to allow for basic control over the mood of the character during speech. I'm sure such a feature would be of interest to many of your customers (and potential customers).
Thanks again

Thank you for this suggestion. I like it, just have to check whether it can be done in a general and robust way automatically. It is on my feature request list now, but I cannot promise anything soon - too many projects :-).

Can you easily swap in a new audio track for the same character, or do you need to go through all the re-morphing the mouth stuff EVERY time you get a new audio track, even if the head has not changed? I don't see a way to have it reanalyze my audio? thanks!

Add new comment

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
By submitting this form, you accept the Mollom privacy policy.