Skip to main content

Using CrazyTalk 8 and iClone 6 to bring Cartoon Characters to Life

The Comedians - by TET. 
Over 20 years ago I had the idea to create a comic strip that was based on the stand-up comedy of three fictional comedians. It was one of those bursts of inspiration that never got any further than headshot drawings of the aforementioned cast before being filed away.

One of the reasons I bought the latest version of Reallusion's CrazyTalk 8 is that the promotional videos showed it being used to create 3D, talking head versions of cartoon characters. Something I thought might be an easy way to put my own characters into animation.


I was reminded of that recently so I thought it was time to give it a try. Remembering my comedian characters I thought, that's the ideal place to start with talking head characters.

Hat-wearing Comedian.
Of the three character designs, the one I liked the most was the hat-wearing comedian. I knew I'd purchased just the right hat in one of the content packs for CrazyTalk 8 so I felt a good character likeness was possible.

CrazyTalk 8 (Pipeline)


I've already done a kind of step by step process for creating 3D talking heads in my review of CrazyTalk 8 (Pipeline) so I won't be going through that here. Instead, I'll mention just a few points worthy of note in bringing my characters into CrazyTalk 8.

When creating 3D characters from drawings or other artworks having a side angle is optional. Although I had a side angle drawn I decided to see how things would go if I just imported the front view into CT8. Since I didn't need the character to have a hat for face fitting I erased the lines and gave him a bald head.

Importing a front view into CT8 for face fitting.

Importing a single face image causes CT8 to reproduce the face texture on the back of the head, presumably as a way of continuing the hair texture. CT8 won't let you turn a character head past a three-quarter view either way so there's no chance of seeing a face on the back.

Despite this I saved out the face texture, erased the back face and erased the drawn ears as these would be replaced with actual 3D ears.

My intention is not to create a realistic looking version of the character. As much as possible I'm trying to make it look like a black and white cartoon style animation. Once I'd created the initial 3D head I dressed it with the right hat and matching suit (but not the striped tie), changing all the texture colors to grey scales as I went.

I swapped out the drawn eyes for CT8's comic style eyes and added comic style teeth and tongue inside the mouth.

To finish the scene I added the Comic Style Atmosphere (which lights the character directly from the front for a flatter look) and added a blurred graffiti background. You can see the results below with the original drawn image inset.

The finished character in CT8. Original drawing inset.

Character Creator & iClone 6


Once I saw the final character I thought about how the animation would be. I could simply write a funny script for him and animate it in CT8. There's enough ability to move the camera around to make the visuals more interesting than one continuous shot but a stand-up comedian needs an audience. There's no real way to show that in CT8 other than to suggest it with canned laughter.

Since CT8 (pipeline version) allows you to export heads to iClone (via the Reallusion Character Creator) I thought, why not make a full body version of the character, create a scene around him of a stage with an actual audience and then use video editing software to cut in some wide shots and audience reactions? Seemed like a good idea.

Unfortunately importing a 3D head into Character Creator is just that. Importing the head only. See the image below for what that looks like.

Naked as a Ken Doll in Character Creator.
The results of importing a head from CT8.

I spent a lot of time redressing the character in the CC. Fortunately, the same content packs in CT8 also installed in both the CC and iClone 6 libraries. Although I had to settle for a collar accessory (kind of like those that male waiters wear at a strip club - collar with no actual shirt) because the tie would not sit right on any shirt in the library (with all the controls to adjust it disabled). It didn't really matter a lot as you're only going to see this model from a distance.

Here's the finished result (image below) after much adjusting of textures to make sure everything was in the same greyscale style from CT8.

The finished Comedian in Character Creator.

Once you've finished creating your character in the CC it's a one step process to transfer it to iClone and then save it to your custom Avatars folder. The image below shows the character in iClone holding a pose from an animated sequence of him checking out his clothes in a mirror (just one of the many predefined motions you can apply).

The iClone version of the Comedian Character.

I haven't yet created an actual set for his wide shots but I have looked at some of the content I've purchased and found a very cosy, premade bar room that I can repurpose as a small comedy club with a bit of work and set decoration.

Hopefully, I can bring you the finished results in a future post.

Comments

  1. This is brilliant! Massively inspirational - thanks David. Is it possible to do just a half-body in Crazytalk8 with original material or do you have to go to iClone? Have already touched on this in the other comment a few mins ago but wasn't sure it was v clear what I meant.

    ReplyDelete
    Replies
    1. I mentioned in my reply to your other comment that CrazyTalk 8 will only let you add a neck and shoulders to your head. If you want more body then you'll need to purchase Character Creator and iClone6. I don't think you can take a CT8 head straight into iClone, gotta take it in through Character Creator.

      Once you have the character fully set up in iClone you can pretty much animate it from any view you like.

      Delete
    2. Thank you for this which I've only seen now. I can't even add the neck and shoulders to my head in CT8, not sure where those instructions are. But have asked on the Reallusion forums so no worries!

      Fortunately they're currently throwing CC in with iClone Pro so am sorted now. Phew!

      Delete
    3. I saw your question on the Reallusion forum and that clarified the issue. You can't add a 3D head and shoulders to a 2D head. The head and shoulders on a 2D head must be part of the original image (don't crop the body out of your original image) or you can add it behind the head as part of the background image (though if you make it part of the background it won't move with the character).

      Delete
  2. Worry not to reply - iClone is necessary apparently. :(

    ReplyDelete

Post a Comment

This blog is monitored by a real human. Generic or unrelated spam comments with links to sites of dubious relativity may be DELETED.

I welcome, read, and respond to genuine comments relating to each post. If your comment isn't that save me some time by not posting it.

Popular posts from this blog

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D  which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D...

Learn Reallusion's Cartoon Animator 5 Fast by Creating Fun, 2D, Animated Christmas Holiday Messages - Free Course by The Lazy Animator

H ave you ever wanted to send your friends and family fun, 2D animated, holiday messages, or just create 2D animated characters that you can make move and talk without learning difficult to master animation skills or spending hours drawing frame by frame? Reallusion's Cartoon Animator 5 is a professional quality, 2D animation studio software that is also very easy to produce impressive results with, even if you've never animated before, or can't draw. Don't Have Cartoon Animator 5 Download a free, 30 day trial . Easy Beginner Course I've created a completely free beginners course that teaches you my fast, easy way to rig and animate your first 2D custom character in Cartoon Animator 5 without complicated templates or any drawing skills at all. My online video course includes everything you need, including eight AI generated character sprite graphics, and four AI generated Human voice samples, so you can start learning right away. Eight AI generated character image...

Krita AI Diffusion - Generative Image AI For Krita is Seriously Useful, Powerful and Free (If You Can Install it Locally)

Generative AI sequence of a woman in a business suit. From sketch to refined image using Krita AI Diffusion - by TET G enerative image AI, where you describe an image with a text prompt to an Artificial Intelligence model and it produces a new image based on your prompt, is gaining a strong hold as a tool for many artists. Krita AI Diffusion brings generative AI image tools right into your favourite free and opensource, graphics editor, Krita. Not only that, if you have a computer with decent specs (and at least 10GB of hard drive space), Krita AI Diffusion is completely free. What If I Don't Have a Powerful Computer? If you're in my situation, with a computer that was around before anyone in the mainstream had even heard of generative AI, you can still access Krita AI Diffusion for free, using a cloud based AI server, Interstice  and 300 tokens, to get you started. Once your initial tokens run out, purchase 5000 more for 10€ (approx US$11.00). Tokens never expire. I would...

Glif (Alpha) - Make Your Own Tiny AI Powered Niche Image Generator Apps

I  first heard about Glif through a YouTube video that mentioned you could get access to Flux Pro (the latest 'game changer AI' generative image model) through the site for free. While I had a vague notion from the video of what Glif was, I wasn't expecting it to be so easy to get started with, and so good with my very first results. Glif is an easy to use, low-code platform for creating tiny AI-powered generators called Glifs. While that may not sound inspiring, what Glifs allow you to do is create a tiny app that niches down to a specific type of AI generation that the user modifies with their own inputs. The best way to really understand is with an example.  My First Glif I've recently been using VivaGo's AI platform  (free and unlimited at the time of writing) to consistently generate full body characters in a front facing T-Pose that I can rig as front facing characters in Cartoon Animator. Unfortunately it can be a bit hit or miss maintaining the T-Pose part...

The Ultimate Independent Animator's App and Resource List - Animation and Video Life

Image created with Cartoon Animator 4. Being an independent animator is not like a studio animation job. There's so much more to do that is indirectly related to the actual task of animating. Over the years I've sought out many apps, tools, and services that can help me achieve that one single task, expressing myself through animation. Below is my Ultimate Independent Animator's Resource List for 2024 (last updated Oct 2024). It started out as a list of free or low cost apps that could help you in every stage of producing either 2D or 3D animation, and then just kind of grew from there. You may not have been looking for a Time Management App as much as you needed something to get you started in 3D animation but when those commissioned projects start coming in you'll have a head start on maximizing your time. All the apps and services on this list had to meet two main criteria: They had to be useful and relevant to an Indy Animator/artist. The base app/se...

Wonder Unit Storyboarder - Free Storyboarding Software for People Who Can (or Can't) Draw

Wonder Unit Storyboarder.  As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder  is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu...

LTX Studio (Beta): AI-Powered Visual Storytelling, From Script to Screen in One App.

LTX Studio can generate consistent characters across storyboard panels - even if one character is a dragon! W hile text to image, and text to video (and image to video) AI tend to be getting a lot of the press, the real exciting aspect of generative AI implementation is how it can be used to speed up creator workflow. Being able to realize your creative vision in a shorter length of time can lead to more ambitious projects. Particularly if you're a team of one, with a very limited budget, but you one day dream of creating your own epic animated feature film. LTX Studio (beta), a new 'all-in-one' AI film making tool, is not going to let you realize that dream from a single text prompt but, by bringing a bunch of generative AI technologies together, the developers have created a one platform workflow that can help anyone rapidly visualize and deliver a story from initial idea to finished film in days rather than weeks (depending upon how ambitious the project is). Even bette...