Featured Animator: Latent Space - Developing a Workflow For 2D AI Animation With a Specific Art Style and Character Design

Characters From an Animated Short by Latent Space.

Characters From an Animated Short, featured in a
two part behind the scenes video by Latent Space.

Recently, I've been exploring how to create a 2D animation workflow that allows me to animate with my own art and characters, while incorporating generative AI into the process to do the 'heavy lifting' (basically all the traditionally time consuming stuff like the animation itself).

If you've seen my previous post, Reallusion's Cartoon Animator Versus PixVerse Image to Video and Lip Sync AI - Battle of the Talking Head Avatars, you may have noticed I used green screen (a.k.a. Chroma keying) with my AI output.

This was something I did because, if you want to animate a particularly long scene, especially with lip sync, you need to string a number of generations together. This is easier to do with characters if they don't have any background in the generation - which may not stay as consistent as the character across generations.

To cut a long story short, YouTube, today, randomly served up a video, Digital Diary : Reviving Animation with AI, Transforming 3D into 2D Cartoon Art, to me by animation channel Latent Space, who is primarily a 3D animator and digital artist but recently started experimenting with 2D AI animation.

That particular video was more about using AI to turn 3D characters into a specific 2D art style and is well worth watching for context but it was Part 2, embeded below, that really caught my attention.

Not only will you see a really professionally created cartoon, right at the start, you'll also see the AI incorporated workflow that I was leaning towards, but Latent Space has actually put into practice, as a proof of concept. Watch the video then read my notes below.

Digital Diary. Part 2: Reviving Animation with AI, Transforming 3D into 2D Cartoon Art.

Notable Highlights

The animated short at the start doesn't stand out as AI animated. If you have a really discerning eye there are some small giveaways but otherwise it could pass for a completely human animated short.
As noted in the video, animating all the characters separately allows for more control and flexibility when animating the scene as a whole. It's easy to swap out one character's performance without losing a great performance from your other characters. It also gives you a library of reusable performances of each character for future projects.
Having all the separate components is also beneficial for adding further effects in software like After Effects or your Video Editor.
The lip sync is done by trying to time the audio with the mouth movements of the clips rather than using actual lip syncing. The technique works fairly well as a interim technique until AI finally learns to lip sync simplistic 2D characters more accurately. Currently AI often won't even recognise a stylised human character and will refuse to even try lip sync it.

If you're looking for a 2D animation workflow that still gives you a lot of control Latent Space's two videos are a very good starting point and may well be the future of 2D animation where the vision, art style, and character design needs to be very specific.

o---o--- ---o--- o---

Did you find this article useful?
Subscribe to my newsletter and get the
latest articles delivered to your inbox.

Comments

Eight 2D Animation Apps For Your Phone or Tablet Mobile Device

M obile productivity apps have become so capable that they can be great alternatives to their PC/MAC equivalents or serve as great tools in their own right when you're away from your desk. While some apps simply mimic their desktop counterparts, others offer well thought out, touch-friendly interfaces that are easier and more fun to use. Every so often I check out what's available for 2D animation for Android devices, since that's what I use, that can complement my workflow with Reallusion's Cartoon Animator 5. Some may be available for Apple devices as well. Below I've listed six free (F) apps (with optional paid (P) upgrades) on the Google Play Store that you might want to explore. Some are just fun apps on their own while others may be useful as part of your workflow on bigger animation projects. Not all are exclusively animation apps and could be used on any production. JotterPad (F/P) The name JotterPad makes this sound like a notepad application but it's ...

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D...

Wonder Unit Storyboarder - Free Storyboarding Software for People Who Can (or Can't) Draw

Wonder Unit Storyboarder. As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu...

The Ultimate Independent Animator's App and Resource List - Animation and Video Life

Image created with Cartoon Animator 4. Being an independent animator is not like a studio animation job. There's so much more to do that is indirectly related to the actual task of animating. Over the years I've sought out many apps, tools, and services that can help me achieve that one single task, expressing myself through animation. Below is my Ultimate Independent Animator's Resource List for 2024 (last updated Oct 2024). It started out as a list of free or low cost apps that could help you in every stage of producing either 2D or 3D animation, and then just kind of grew from there. You may not have been looking for a Time Management App as much as you needed something to get you started in 3D animation but when those commissioned projects start coming in you'll have a head start on maximizing your time. All the apps and services on this list had to meet two main criteria: They had to be useful and relevant to an Indy Animator/artist. The base app/se...

Koolmoves Tutorials for GoAnimate - Parts 1 and 2

Quite a few people on GoAnimate have asked me to make a Koolmoves tutorial for creating flash props and characters suitable for use with the GoAnimate Studio. Well that day is finally here with this series of four videos that will give you more than enough learning to at least be making your own flash props - and will give you a kick start for animating characters too. Tutorial 1 The first video will step you through the process of setting up a template file suitable for using as a starting point for all your flash props and backgrounds. More than that, the way the template is set up is exactly how you need it for creating your own GoAnimate Community Characters - a feature that is currently only available to GoAnimate Beta Users but, if GoAnimate makes it widely available, you'll be ready. The tutorial finishes with showing how to upload your flash props/backgrounds/characters etc. into the GoAnimate Studio. Tutorial 2, Part 1 In part 1 I show you how to import a trace i...

Follow Me As I Build My Two Cartoon Web Series So You Can Build Your Series Too

Bat Storm and TET from Resident Dragon, Behind the Scenes on these two series. Image by Gemini AI and TET. M any cartoonists, authors, short story writers, and other types of creators find themselves aspiring to make an animated cartoon web series because, although a challenging task, it's seen to be achievable by a team of one. You don't need a big studio, a killer pitch, or a big budget, (which would all be nice) you can just start making something yourself, in your spare time, on a shoe string budget. That's what this blog, going forward, will be focusing upon. I'm going to document the behind the scenes on how I'm making my two web series, which will hopefully inspire you to say, if he can do this with almost no budget, then maybe I can too. Along the way I plan to create guides and tutorials, so you aren't just seeing behind the scenes, you also have the option of following some of my processes step by step. Full disclaimer. This is just my process. I'm...

Prome AI Sketch Render Tool - Your Tradigital Clean Up and Colorist Artist for Character and Background Design

Random character head, Biro sketches drawn by TET (left). Render by PromeAI (right) using Prome's Sketch Render tool set to 'Comon:Cartoon, Render Mode: Outline'. W hile I don't do New Year Resolutions, one of my plans for the year ahead is to do more of my own art. Specifically character design drawn in an actual, physical sketchbook. To that end, I have been spending the last half hour of most days drawing a page or two of random biro sketches in my sketchbook and posting the pages to my Instagram account (this link will take you to one of my posts). These sketches are mostly practicing my skills because I don't really draw regularly anymore. Here is a tip, if you do this kind of sketching, and push yourself to keep doing it, you will see many drawings that could be taken further, even if you don't have anything they're suited for just at the moment. Which is where my second favorite AI Image Tool (after Leonardo.ai ) PromeAI comes into play. PromeAI ...

Animation and Video Life

Search This Blog