Skip to main content

Six Lip Sync Animation Tips for Cartoon Animator (That Really Apply to Any Auto Lip Syncing Application)

Lip Sync Tips Black Character in front of a word cloud wall of lip sync related terms.

Animating a character's mouth talking in any form of animation is one of the more time consuming jobs of character animation. Particularly if your project is dialogue heavy or your character has the urge to sing.

Fortunately auto lip syncing in many animation software studios is becoming more common and is helping to speed up the lip syncing process. Reallusion's Cartoon Animator is no exception with a fairly good auto lip sync feature. I made a tutorial video demonstrating how to auto and manual lip sync in Cartoon Animator here.

However auto lip sync is not perfect (yet) so you'll definitely find yourself manually lip syncing a character at some point. Or maybe you just prefer to manually lip sync yourself because you like that level of control.

Whatever the reason here are Six tips to help improve your lip sync and to stop you getting bogged down into really small details that literally do not matter for the amount of screen time they'll get.


1. Auto Lip Sync is NOT as Bad as You Think

Auto lip sync is not as bad as you think. If you give it clean audio it'll usually work pretty good. If you're feeding in a voice track that includes background noises or music that's on you, it's not the auto lip sync's fault. 

Even with clean audio it's never perfect by any means, but you really only need to fix the obvious mouth shapes that jump out at you as being incorrect.

Cartoon Animator's Lip Sync features.
Cartoon Animator's Automatic/Manual lip sync tools
are pretty straight forward and easy to edit.

2. You Do Not Need to Animate Every Syllable of Every Word

You should make the title of  this second tip a mantra. You do not need to animate every syllable of every word with the correct mouth shape

When we speak our mouths do not form the shape of every single syllable in a word. If you change the mouth shape for every syllable the lips will move too fast and look unrealistic - especially if your character is talking at a casual pace. 

Cartoon Animator pro user and trainer, Eon De Bruin, talks about this in a video on his Start Animating YouTube channel titled, Get more realistic lip-syncing for your animations (highly recommend this channel for free Cartoon Animator tutorials as well).

3. Animate ahead of the audio

Start a mouth shape one or two frames before you hear the sound (sometimes even more as a character anticipates their speech before making a sound) for more realism. Because the sound is being made by the mouth we usually see the mouth move a split second before we hear the voice coming from it.

4. Pay Attention to the Closed Mouth Shapes

Lip syncing is as much about timing when the mouth is closed as when it is open. The closed mouth shapes can often be more important than the open shapes because you really notice if a character is making a B, F, or P sound and the actual mouth is open. It just looks wrong.

5. Be Your Own Reference

This is a really obvious tip but if you're not sure of a particular mouth shape for some dialogue, grab a mirror and watch yourself form the mouth shapes. Speak normally, don't emphasize the syllables (unless your character is doing this). If you have a phone camera handy you may even like to record yourself so you can replay your mouth over and over as you work. 

6. Exaggerate the Mouth Movement

Once you have the general lip sync done and it's looking pretty good, take another look at it and see if you can make it more dynamic.

If a character is showing emotion that is partly expressed through the mouth, maybe they're angry and shouting, open the mouth a little wider, show more teeth.

If, like Cartoon Animator, your animation software uses a standard set of mouth sprites, and you don't always have access to variations on those sprites, try using Free Form Deformations (FFD) to make the mouth and jaw line more flexible and expressive.


This article was inspired by an old Plural Sight article from 2013 titled,  Proven Tips for Animating Believable Lip Sync, as well as my own knowledge from reading countless animation books. If there is one takeaway you should remember about lip syncing it's:

You do not need to animate every syllable.

Lip syncing is time consuming enough. Animating every syllable is a rookie mistake. Honestly I've seen long time animators make that mistake and, watching their characters talk feels like you've run a small marathon.

But don't take my word for it. Here's a video of former Disney Animator, Aaron Blaise giving you his tips on lip syncing (fast forward the video a few minutes - after all his promotional waffle - it's an old video from nine years ago, before people knew to get straight to the point).

 


o---o--- ---o--- o---

Did you find this article useful?
Subscribe to my newsletter and get the
latest articles delivered to your inbox.

Comments

Popular posts from this blog

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D  which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D

Wonder Unit Storyboarder - Free Storyboarding Software for People Who Can (or Can't) Draw

Wonder Unit Storyboarder.  As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder  is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu

Glif (Alpha) - Make Your Own Tiny AI Powered Niche Image Generator Apps

I  first heard about Glif through a YouTube video that mentioned you could get access to Flux Pro (the latest 'game changer AI' generative image model) through the site for free. While I had a vague notion from the video of what Glif was, I wasn't expecting it to be so easy to get started with, and so good with my very first results. Glif is an easy to use, low-code platform for creating tiny AI-powered generators called Glifs. While that may not sound inspiring, what Glifs allow you to do is create a tiny app that niches down to a specific type of AI generation that the user modifies with their own inputs. The best way to really understand is with an example.  My First Glif I've recently been using VivaGo's AI platform  (free and unlimited at the time of writing) to consistently generate full body characters in a front facing T-Pose that I can rig as front facing characters in Cartoon Animator. Unfortunately it can be a bit hit or miss maintaining the T-Pose part

Krita AI Diffusion - Generative Image AI For Krita is Seriously Useful, Powerful and Free (If You Can Install it Locally)

Generative AI sequence of a woman in a business suit. From sketch to refined image using Krita AI Diffusion - by TET G enerative image AI, where you describe an image with a text prompt to an Artificial Intelligence model and it produces a new image based on your prompt, is gaining a strong hold as a tool for many artists. Krita AI Diffusion brings generative AI image tools right into your favourite free and opensource, graphics editor, Krita. Not only that, if you have a computer with decent specs (and at least 10GB of hard drive space), Krita AI Diffusion is completely free. What If I Don't Have a Powerful Computer? If you're in my situation, with a computer that was around before anyone in the mainstream had even heard of generative AI, you can still access Krita AI Diffusion for free, using a cloud based AI server, Interstice  and 300 tokens, to get you started. Once your initial tokens run out, purchase 5000 more for 10€ (approx US$11.00). Tokens never expire. I would

The Ultimate Independent Animator's App and Resource List 2019-2023 - Animation and Video Life

Image created with Cartoon Animator 4. Being an independent animator is not like a studio animation job. There's so much more to do that is indirectly related to the actual task of animating. Over the years I've sought out many apps, tools, and services that can help me achieve that one single task, expressing myself through animation. Below is my Ultimate Independent Animator's Resource List for 2019-2022. It started out as a list of free or low cost apps that could help you in every stage of producing either 2D or 3D animation, and then just kind of grew from there. You may not have been looking for a Time Management App as much as you needed something to get you started in 3D animation but when those commissioned projects start coming in you'll have a head start on maximizing your time. All the apps and services on this list had to meet two main criteria: They had to be useful and relevant to an Indy Animator/artist. The base app/service had to be US$

Review: Headshot Plugin for Reallusion's Character Creator 3

Headshot for CC3. Quite possibly the best 3D Avatar I've made of myself in any 3D application. Creating a realistic 3D human avatar is a whole lot easier with Reallusion's new Headshot Plugin for Character Creator 3. The plugin is an AI powered extension that can generate 3D digital humans from one photo. Which sounds like an amazing proposition but, in practice, if you're trying to achieve a specific likeness to an actual person, Headshot will give you an excellent base to work from. Headshot has two modes, Auto and Pro. Auto Mode Auto is well worth a try if you have an ideal photo of a front facing person that is properly lit and posed to Headshot's optimum requirements. It's also the only mode that will take a crack at generating a hair model. I grabbed an image of Harrison Ford, dragged it into Headshot without changing any of the default settings (other than specifying 'male' and selecting an 'old male' setting) and this is what I

Using Avatar Maker with Cartoon Animator - Free Vector Cartoon Avatar Creator with Four Art Styles

I'm always on the lookout for cartoon avatar makers of any kind, whether it be ones that 'cartoonify' your photo, or ones that let you build a cartoon likeness from a library of individual features.  Free Avatar Maker  falls into the latter category and can be used for making head and shoulder cartoon avatars. While it doesn't have an extensive library of character features (you may struggle to get a good likeness), uniquely it will make your avatar in four different art styles concurrently, allowing you to save the one you like most, or even all four.  I wasn't overly impressed how my TET avatar looked in the first two styles, but style three is quite possibly the coolest looking version of my avatar I've ever seen in a third party avatar creator. It's a very contemporary style. Style four, line art, is also not too bad. Avatar Maker's User Interface. Switch between the four different art styles shown across the top at any time. I particularly like the