Skip to main content

Let's Talk About 2D AI Animation and Reallusion's Cartoon Animator

TET Avatar Image generated with OpenArt AI.
From this one AI generated image I created a talking head scene with two
additional camera angles using OpenArt.AI.

As a solo creator, I didn't get into animation and making 2D animated cartoons because I just love the craft of animating. I got into it because I am a cartoonist who wanted to see my characters come alive as animated cartoons. I've always loved animated cartoons and I wanted to see my own characters in their own cartoons. 

While I love traditional hand drawn animation, I have never had any desire to sit down to draw and ink hundreds of drawings just to achieve a single minute of animation. Though I have created hand drawn, looping animations of 1 to 2 seconds every now and then and, back in the day, very low frame count digital cartoons.

Reallusion's Cartoon Animator

The Lazy Animator Guide to Animating Talking Heads in Cartoon Animator.
The Lazy Animator Guide to
Animating Talking Heads
in Cartoon Animator.

It wasn't until Reallusion came along with Cartoon Animator (then known as CrazyTalk Animator Pro), somewhere around 2012, that I found an affordable way to animate my own 2D artwork without requiring me to draw anything except the initial character designs for the character puppet rigs.

Fast forward to today and Cartoon Animator has evolved into, what I believe, to be one of the fastest, and easiest to learn, applications for creating 2D puppet rig animation - that even has the option to include hand drawn animated elements to make the puppet rig style less obvious.

I say that with some authority since I have spent time learning Cartoon Animator's nearest rival, Moho, in depth, going through two lots of Moho training, totalling more than 100 videos. I've yet to make a single, complete animated cartoon with Moho. It's too much work for me.

If you want to make animation quickly, with your own art, Reallusion's Cartoon Animator is affordable and features one of the fastest workflows of any animation software (including Adobe Animate). I can get a beginner animating to a relatively high level of competence with the software in a weekend through my Lazy Animator, Cartoon Animator Courses.

Enter 2D AI Animation

I've been following the development of generative AI animation since the very concept started to take shape a few years ago. It's gone from "Yeah, it's not going to replace Cartoon Animator any time soon" to "Do I even need Cartoon Animator?" in the last few months (basically since the release of Google's Nano Banana - which really has been a game changer).

Now we have various all in one AI tools that give you access to different AI models, and let you generate almost everything you need to make a complete animated cartoon, or even something that could pass for a live action film. I'm not talking 'AI Slop' either. I'm talking, you take the role of director and use the speed of AI to design and animate your characters in your stories.

My preferred tool is OpenArt.ai.

OpenArt.AI Home Page.
OpenArt.AI is an all-in-one AI generation platform.

A Simple Example

Animating a Talking Head in Cartoon Animator.
Screenshot from my Animating Talking Heads
Cartoon Animator course for beginners.

For years my go to lesson for Cartoon Animator beginners has been to teach them how to animate a talking head video. A character speaking to camera, with appropriate facial expressions, upper body movement, and hand gestures.

Once you have your character rigged and ready to go, you can get the bare bones of a character speaking to camera and animated in maybe 30 minutes for a ten to twenty second monologue. To do it really well, it's going to take at least an hour or so to make sure the lip sync is good, and the face and hand animations align with what is being said.

You can even vary the camera between medium and close up shots if you want to look even more accomplished.

In contrast, with OpenArt AI, I can make a consistent character of my Avatar from a single image, put them into a scene, instantly create multiple camera angles of the same scene, then turn everything into animated videos complete with pretty good character lip sync (to a recording of my own voice or AI voices) with appropriate facial expressions and hand movements.

OpenArt's Lip Sync Tool.
Once you have your various character angles, it's literally a quick prompt and one
button click to create the animation on each camera angle.

Once I have the same scene animated from multiple different angles, I just take everything into my video editor and cut them together to create a single scene filmed with multiple camera angles. See the demo video below which took maybe 20 to 30 minutes to make, starting with a single front facing image of my Avatar sitting at a desk.




OpenArt - All in One AI Character, Image, Audio, and Video Generator. 

That's pretty much where we're at with generative AI. It's not perfect but it's good enough in the right creator's hands. If I can create this from a single AI generated image of my character, what would I need Cartoon Animator for?

Given, this is a very simple example but, if you're primarily animating talking head style videos, and you just want the fastest creation method possible, AI wins, hands down.

Multiple Characters and AI

If you want to animate a scene with multiple characters speaking within the same camera shot, AI still struggles with this. It can do it but the number of useless generations certainly increases. However there are work arounds.

One method is to generate each character individually on green screen backgrounds and then composite them together into a single scene in your video editor. Which can work well and be a little more reliable.

It's not ideal but still comparable to animating the entire scene in Cartoon Animator.

Do You Even Need Cartoon Animator?

At this point Cartoon Animator is fast becoming a scene posing stage for creating first (and even last frames) that AI can animate. Except you don't even need it for that.

AI can take a bunch of elements and combine them in a scene based on your prompts too. You may not have precise control, like you would in Cartoon Animator but you're also not restricted by whatever angles you have available of your puppet rigged characters.

Thinking of generative AI's catch cry of 'This is the worst it will ever be" is there even a need for Cartoon Animator, if not now, then in a year or two?

The Answer is YES and NO

Depending upon how you feel about generative AI animation your answer will be one or the other.

If you despise anything and everything AI in creative fields, then Cartoon Animator is, arguably, the fastest way to produce 2D animated cartoons without AI. I would still highly recommend the software to you.

On the other hand, if you’re open to exploring generative AI in your workflow then you may want to keep Cartoon Animator around. However, as you get more confident in how to use AI tools, you will definitely start to question if Cartoon Animator is actually adding in extra steps to your workflow rather than making it quicker?

If Reallusion have plans to release Cartoon Animator 6 this year, it’s going to need to bring something really unique, possibly incorporating specialist AI tools, to keep the software relevant moving forward.


o---o--- ---o--- o---

Did you find this article useful?
Subscribe to my newsletter and get the
latest articles delivered to your inbox.

Comments

Popular posts from this blog

Eight 2D Animation Apps For Your Phone or Tablet Mobile Device

M obile productivity apps have become so capable that they can be great alternatives to their PC/MAC equivalents or serve as great tools in their own right when you're away from your desk. While some apps simply mimic their desktop counterparts, others offer well thought out, touch-friendly interfaces that are easier and more fun to use. Every so often I check out what's available for 2D animation for Android devices, since that's what I use, that can complement my workflow with Reallusion's Cartoon Animator 5. Some may be available for Apple devices as well. Below I've listed six free (F) apps (with optional paid (P) upgrades) on the Google Play Store that you might want to explore. Some are just fun apps on their own while others may be useful as part of your workflow on bigger animation projects. Not all are exclusively animation apps and could be used on any production. JotterPad (F/P) The name JotterPad makes this sound like a notepad application but it's ...

Infinite Monkey Theorem Animated Short - Part 5

Scene 2 from my storyboard, Infinite Monkeys. Work on my Infinite Monkey animated short is definitely back on track since my last update and my previous part 4 post . To get things moving again I've decided not to spend time creating a final draft storyboard that uses all the actual props and characters. This is something that you'd generally do if you were planning to show the storyboard to someone else for feedback. At this point I'm not planning to do that so I'm going bypass it and create and animate each scene as I go, saving a bit of time.

Creating an AI Digital Avatar and Voice Clone of Myself with Free and Low Cost AI Tools

O ver the years I've looked at various ways of creating and animating a digital avatar, from simply creating a character for Cartoon Animator and voicing and animating it myself, to creating a  live motion capture ready Vtuber avatar puppeted and voiced by me in real-time. In the last year or so, making photographic images talk, using AI and AI voice cloning has really progressed. To the point where I wondered if I could create a photographic AI avatar of myself, complete with my cloned voice, that I might use on some of my videos? Creating My Avatar: Artflow To create my avatar image, as far as I'm concerned,  Artflow.ai is the best value AI site for creating consistent digital characters (or 'actors' as Artflow calls them). That's pretty much their entire focus. Artflow's actor model training user interface. You get your first actor for free, 100 free credits per month (which equates to 100 still images per month - get an additional 50 credits if you sign...

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D  which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D...

Five AI Generative Image to Video Tools For Animation You Can Try Free Right Now

The Emo Girl Character created by Start Animating. A I generative video isn't new but it is the next big thing in the visual imaging space as various development teams work to perfect the generated output.  Just like generating still images AI video sometimes struggles with physics, arm and hand movement, and the general structure of things. However it is getting better and, as is the catch cry of all AI development, this is the worst it will ever be, because it's improving fast. If you're an animator one current potential use of generative AI video is to animate your key frames, as opposed to generating something entirely from a text prompt. Starting with an image helps to keep your characters and art style consistent across AI generations. With that in mind I tried five, free image to video AI generators to see what their potential might be and whether they can handle cartoon style characters well. Note all but the last entry on the list do not create any sound with the...

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 2 - Inochi2D Session)

In part one of my deep dive into the free VTuber software, Inochi2D , I focused mainly on Inochi2D Creator, which is used for rigging your character avatar in the correct file format for use with Inochi2D Session, the puppeteering part of the software. The two sides of the software are still very much in development and the documentation, particularly for Session, is very thin on the ground. To the point where I don't think I could even do a comprehensive tutorial because I'm not sure I'm even doing things right, and the software could change significantly in a single update. As a result, in this part of my Inochi2D deep dive I'm changing tact from presenting my finished Cartoon Animator TET Avatar, and will be summarizing my experience of getting Session up and running using OpenSeeFace as the recommended webcam motion capture software. To do this I will be using  the TET avatar I created in my review of Mannequin , since that can be exported as a full, ready to go r...

How to Become a Virtual YouTuber (VTuber) - 2D and 3D Software for Creating and Controlling Your Avatar

Young TET VRoid Avatar in VSeeFace. In a previous YouTube video I demonstrated how you could use a webcam, Cartoon Animator and its MotionLive 2D Facial Capture system to create a virtual avatar that you could perform live during a live stream. Unfortunately the motion capture performance of this system is very average to say the least, and is even more expensive if you want to add hand motion capture via a Leap Motion Controller . This lead me down a rabbit hole of seeing what other solutions are out there, where I bumped into the world of the VTuber or Virtual YouTuber (creators who puppet and voice an on camera avatar instead of appearing on camera themselves). Specifically VTuber software, which has been a real eye opener for how expensive and far behind Reallusion's upper body motion capture system actually is. The VTuber world is heavily entrenched in the world of Anime so you'll see a lot of 2D and 3D avatars in this style. If fact, if an Anime avatar is your thing, y...