Six Lip Sync Animation Tips for Cartoon Animator (That Really Apply to Any Auto Lip Syncing Application)
Animating a character's mouth talking in any form of animation is one of the more time consuming jobs of character animation. Particularly if your project is dialogue heavy or your character has the urge to sing.
Fortunately auto lip syncing in many animation software studios is becoming more common and is helping to speed up the lip syncing process. Reallusion's Cartoon Animator is no exception with a fairly good auto lip sync feature. I made a tutorial video demonstrating how to auto and manual lip sync in Cartoon Animator here.
However auto lip sync is not perfect (yet) so you'll definitely find yourself manually lip syncing a character at some point. Or maybe you just prefer to manually lip sync yourself because you like that level of control.
Whatever the reason here are Six tips to help improve your lip sync and to stop you getting bogged down into really small details that literally do not matter for the amount of screen time they'll get.
1. Auto Lip Sync is NOT as Bad as You Think
Auto lip sync is not as bad as you think. If you give it clean audio it'll usually work pretty good. If you're feeding in a voice track that includes background noises or music that's on you, it's not the auto lip sync's fault.
Even with clean audio it's never perfect by any means, but you really only need to fix the obvious mouth shapes that jump out at you as being incorrect.
Cartoon Animator's Automatic/Manual lip sync tools are pretty straight forward and easy to edit.
2. You Do Not Need to Animate Every Syllable of Every Word
You should make the title of this second tip a mantra. You do not need to animate every syllable of every word with the correct mouth shape.
When we speak our mouths do not form the shape of every single syllable in a word. If you change the mouth shape for every syllable the lips will move too fast and look unrealistic - especially if your character is talking at a casual pace.
Start a mouth shape one or two frames before you hear the sound (sometimes even more as a character anticipates their speech before making a sound) for more realism. Because the sound is being made by the mouth we usually see the mouth move a split second before we hear the voice coming from it.
4. Pay Attention to the Closed Mouth Shapes
Lip syncing is as much about timing when the mouth is closed as when it is open. The closed mouth shapes can often be more important than the open shapes because you really notice if a character is making a B, F, or P sound and the actual mouth is open. It just looks wrong.
5. Be Your Own Reference
This is a really obvious tip but if you're not sure of a particular mouth shape for some dialogue, grab a mirror and watch yourself form the mouth shapes. Speak normally, don't emphasize the syllables (unless your character is doing this). If you have a phone camera handy you may even like to record yourself so you can replay your mouth over and over as you work.
6. Exaggerate the Mouth Movement
Once you have the general lip sync done and it's looking pretty good, take another look at it and see if you can make it more dynamic.
If a character is showing emotion that is partly expressed through the mouth, maybe they're angry and shouting, open the mouth a little wider, show more teeth.
If, like Cartoon Animator, your animation software uses a standard set of mouth sprites, and you don't always have access to variations on those sprites, try using Free Form Deformations (FFD) to make the mouth and jaw line more flexible and expressive.
This article was inspired by an old Plural Sight article from 2013 titled, Proven Tips for Animating Believable Lip Sync, as well as my own knowledge from reading countless animation books. If there is one takeaway you should remember about lip syncing it's:
You do not need to animate every syllable.
Lip syncing is time consuming enough. Animating every syllable is a rookie mistake. Honestly I've seen long time animators make that mistake and, watching their characters talk feels like you've run a small marathon.
But don't take my word for it. Here's a video of former Disney Animator, Aaron Blaise giving you his tips on lip syncing (fast forward the video a few minutes - after all his promotional waffle - it's an old video from nine years ago, before people knew to get straight to the point).
M obile productivity apps have become so capable that they can be great alternatives to their PC/MAC equivalents or serve as great tools in their own right when you're away from your desk. While some apps simply mimic their desktop counterparts, others offer well thought out, touch-friendly interfaces that are easier and more fun to use. Every so often I check out what's available for 2D animation for Android devices, since that's what I use, that can complement my workflow with Reallusion's Cartoon Animator 5. Some may be available for Apple devices as well. Below I've listed six free (F) apps (with optional paid (P) upgrades) on the Google Play Store that you might want to explore. Some are just fun apps on their own while others may be useful as part of your workflow on bigger animation projects. Not all are exclusively animation apps and could be used on any production. JotterPad (F/P) The name JotterPad makes this sound like a notepad application but it's ...
Scene 2 from my storyboard, Infinite Monkeys. Work on my Infinite Monkey animated short is definitely back on track since my last update and my previous part 4 post . To get things moving again I've decided not to spend time creating a final draft storyboard that uses all the actual props and characters. This is something that you'd generally do if you were planning to show the storyboard to someone else for feedback. At this point I'm not planning to do that so I'm going bypass it and create and animate each scene as I go, saving a bit of time.
Wonder Unit Storyboarder. As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu...
Random character head, Biro sketches drawn by TET (left). Render by PromeAI (right) using Prome's Sketch Render tool set to 'Comon:Cartoon, Render Mode: Outline'. W hile I don't do New Year Resolutions, one of my plans for the year ahead is to do more of my own art. Specifically character design drawn in an actual, physical sketchbook. To that end, I have been spending the last half hour of most days drawing a page or two of random biro sketches in my sketchbook and posting the pages to my Instagram account (this link will take you to one of my posts). These sketches are mostly practicing my skills because I don't really draw regularly anymore. Here is a tip, if you do this kind of sketching, and push yourself to keep doing it, you will see many drawings that could be taken further, even if you don't have anything they're suited for just at the moment. Which is where my second favorite AI Image Tool (after Leonardo.ai ) PromeAI comes into play. PromeAI ...
In part one of my deep dive into the free VTuber software, Inochi2D , I focused mainly on Inochi2D Creator, which is used for rigging your character avatar in the correct file format for use with Inochi2D Session, the puppeteering part of the software. The two sides of the software are still very much in development and the documentation, particularly for Session, is very thin on the ground. To the point where I don't think I could even do a comprehensive tutorial because I'm not sure I'm even doing things right, and the software could change significantly in a single update. As a result, in this part of my Inochi2D deep dive I'm changing tact from presenting my finished Cartoon Animator TET Avatar, and will be summarizing my experience of getting Session up and running using OpenSeeFace as the recommended webcam motion capture software. To do this I will be using the TET avatar I created in my review of Mannequin , since that can be exported as a full, ready to go r...
If you're the kind of 2D animator that needs to get high quality work out fast then you should be taking a serious look at Reallusion's Cartoon Animator 4 because that is the key feature that informs almost everything this application is capable of. Formerly known as CrazyTalk Animator 3, the release of Cartoon Animator 4 (CA4) reveals an application that goes out of its way to make high end 2D puppet rig and motion graphic animations easier to create quickly, and as intuitively as possible. That's not to say there isn't a learning curve but another great strength of CA4 is that you won't get lost in a sea of icons, tools, menus and more. The initial user interface is less complicated and more logically laid out than one may have used to put together a powerpoint presentation.
Young TET VRoid Avatar in VSeeFace. In a previous YouTube video I demonstrated how you could use a webcam, Cartoon Animator and its MotionLive 2D Facial Capture system to create a virtual avatar that you could perform live during a live stream. Unfortunately the motion capture performance of this system is very average to say the least, and is even more expensive if you want to add hand motion capture via a Leap Motion Controller . This lead me down a rabbit hole of seeing what other solutions are out there, where I bumped into the world of the VTuber or Virtual YouTuber (creators who puppet and voice an on camera avatar instead of appearing on camera themselves). Specifically VTuber software, which has been a real eye opener for how expensive and far behind Reallusion's upper body motion capture system actually is. The VTuber world is heavily entrenched in the world of Anime so you'll see a lot of 2D and 3D avatars in this style. If fact, if an Anime avatar is your thing, y...
Comments
Post a Comment
This blog is monitored by a real human. Generic or unrelated spam comments with links to sites of dubious relativity may be DELETED.
I welcome, read, and respond to genuine comments relating to each post. If your comment isn't that save me some time by not posting it.