Skip to main content

Using CrazyTalk 8 and iClone 6 to bring Cartoon Characters to Life

The Comedians - by TET. 
Over 20 years ago I had the idea to create a comic strip that was based on the stand-up comedy of three fictional comedians. It was one of those bursts of inspiration that never got any further than headshot drawings of the aforementioned cast before being filed away.

One of the reasons I bought the latest version of Reallusion's CrazyTalk 8 is that the promotional videos showed it being used to create 3D, talking head versions of cartoon characters. Something I thought might be an easy way to put my own characters into animation.


I was reminded of that recently so I thought it was time to give it a try. Remembering my comedian characters I thought, that's the ideal place to start with talking head characters.

Hat-wearing Comedian.
Of the three character designs, the one I liked the most was the hat-wearing comedian. I knew I'd purchased just the right hat in one of the content packs for CrazyTalk 8 so I felt a good character likeness was possible.

CrazyTalk 8 (Pipeline)


I've already done a kind of step by step process for creating 3D talking heads in my review of CrazyTalk 8 (Pipeline) so I won't be going through that here. Instead, I'll mention just a few points worthy of note in bringing my characters into CrazyTalk 8.

When creating 3D characters from drawings or other artworks having a side angle is optional. Although I had a side angle drawn I decided to see how things would go if I just imported the front view into CT8. Since I didn't need the character to have a hat for face fitting I erased the lines and gave him a bald head.

Importing a front view into CT8 for face fitting.

Importing a single face image causes CT8 to reproduce the face texture on the back of the head, presumably as a way of continuing the hair texture. CT8 won't let you turn a character head past a three-quarter view either way so there's no chance of seeing a face on the back.

Despite this I saved out the face texture, erased the back face and erased the drawn ears as these would be replaced with actual 3D ears.

My intention is not to create a realistic looking version of the character. As much as possible I'm trying to make it look like a black and white cartoon style animation. Once I'd created the initial 3D head I dressed it with the right hat and matching suit (but not the striped tie), changing all the texture colors to grey scales as I went.

I swapped out the drawn eyes for CT8's comic style eyes and added comic style teeth and tongue inside the mouth.

To finish the scene I added the Comic Style Atmosphere (which lights the character directly from the front for a flatter look) and added a blurred graffiti background. You can see the results below with the original drawn image inset.

The finished character in CT8. Original drawing inset.

Character Creator & iClone 6


Once I saw the final character I thought about how the animation would be. I could simply write a funny script for him and animate it in CT8. There's enough ability to move the camera around to make the visuals more interesting than one continuous shot but a stand-up comedian needs an audience. There's no real way to show that in CT8 other than to suggest it with canned laughter.

Since CT8 (pipeline version) allows you to export heads to iClone (via the Reallusion Character Creator) I thought, why not make a full body version of the character, create a scene around him of a stage with an actual audience and then use video editing software to cut in some wide shots and audience reactions? Seemed like a good idea.

Unfortunately importing a 3D head into Character Creator is just that. Importing the head only. See the image below for what that looks like.

Naked as a Ken Doll in Character Creator.
The results of importing a head from CT8.

I spent a lot of time redressing the character in the CC. Fortunately, the same content packs in CT8 also installed in both the CC and iClone 6 libraries. Although I had to settle for a collar accessory (kind of like those that male waiters wear at a strip club - collar with no actual shirt) because the tie would not sit right on any shirt in the library (with all the controls to adjust it disabled). It didn't really matter a lot as you're only going to see this model from a distance.

Here's the finished result (image below) after much adjusting of textures to make sure everything was in the same greyscale style from CT8.

The finished Comedian in Character Creator.

Once you've finished creating your character in the CC it's a one step process to transfer it to iClone and then save it to your custom Avatars folder. The image below shows the character in iClone holding a pose from an animated sequence of him checking out his clothes in a mirror (just one of the many predefined motions you can apply).

The iClone version of the Comedian Character.

I haven't yet created an actual set for his wide shots but I have looked at some of the content I've purchased and found a very cosy, premade bar room that I can repurpose as a small comedy club with a bit of work and set decoration.

Hopefully, I can bring you the finished results in a future post.

Comments

  1. This is brilliant! Massively inspirational - thanks David. Is it possible to do just a half-body in Crazytalk8 with original material or do you have to go to iClone? Have already touched on this in the other comment a few mins ago but wasn't sure it was v clear what I meant.

    ReplyDelete
    Replies
    1. I mentioned in my reply to your other comment that CrazyTalk 8 will only let you add a neck and shoulders to your head. If you want more body then you'll need to purchase Character Creator and iClone6. I don't think you can take a CT8 head straight into iClone, gotta take it in through Character Creator.

      Once you have the character fully set up in iClone you can pretty much animate it from any view you like.

      Delete
    2. Thank you for this which I've only seen now. I can't even add the neck and shoulders to my head in CT8, not sure where those instructions are. But have asked on the Reallusion forums so no worries!

      Fortunately they're currently throwing CC in with iClone Pro so am sorted now. Phew!

      Delete
    3. I saw your question on the Reallusion forum and that clarified the issue. You can't add a 3D head and shoulders to a 2D head. The head and shoulders on a 2D head must be part of the original image (don't crop the body out of your original image) or you can add it behind the head as part of the background image (though if you make it part of the background it won't move with the character).

      Delete
  2. Worry not to reply - iClone is necessary apparently. :(

    ReplyDelete

Post a Comment

This blog is monitored by a real human. Generic or unrelated spam comments with links to sites of dubious relativity may be DELETED.

I welcome, read, and respond to genuine comments relating to each post. If your comment isn't that save me some time by not posting it.

Popular posts from this blog

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D  which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D

Eric W. Schwartz: Cartoonist, Animator and Amiga Die Hard

July 1992 Edition, CU Amiga Featuring Amy the Squirrel. American Cartoonist, Eric W. Schwartz , (whose unofficial Amiga Icon, Amy the Squirrel, is pictured on the July 92 edition of CU Amiga cover on the right) is my only real animation hero. Sure there are the big names like Disney , Chuck Jones , Tex Avery and even Preston Blair whose influences can all be seen in my own cartoons but Eric did what none of the others could. He showed that really great 2D computer animation was within my reach with little more than an Amiga Computer , a copy of Deluxe Paint and Moviesetter . This was at a time when computer based animation was in its infancy (outside of computer game animation) and Flash was something that lights did. There were many great Amiga artists but Eric was really the only one consistently making very funny, traditional style animations. His humor and drawing style is heavily influenced by classic Warner Brothers and Disney cartoons but he managed to build on this,

Wonder Unit Storyboarder - Free Storyboarding Software for People Who Can (or Can't) Draw

Wonder Unit Storyboarder.  As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder  is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu

Can You Learn Reallusion's Cartoon Animator 5 for Free Using Their 137 Official YouTube Video Tutorials Sorted Into a Logical Learning Order?

Or you could just buy The Lazy Animator Beginner's Guide to Cartoon Animator . While Reallusion's Cartoon Animator is one of the easiest 2D animation studios to get up and running with quickly, learning it from all of the official, free, video tutorials can be more overwhelming than helpful. With more than 137 videos totaling more than 28 and a half hours of tutorials, spread across three generations of the software (Cartoon Animator 3 through 5) it's hard to know if what you're learning is a current or legacy feature that you either need to know or can be skipped. Many of the official tutorials only teach specific features of the software and don't relate at all to previous or later tutorials. As a result there are many features either not mentioned or are hard to find. To make your learning easier, on this page, I've collected together all of the essential, official, free video tutorials and sorted them into a learning order that makes sense. Simply start at

Dollars Mocap: Full Body Webcam Motion Capture (Including Hands and Fingers) For iClone and Cartoon Animator

Even though I should be further away from the camera Dollars Mocap MONO still does a good job of  tracking my arms, hands and fingers. Ever since I wrote my series on becoming a VTuber , discovering it was possible to do full body motion capture, including hands and fingers, with just software and a webcam, I've been on the look out for any motion capture software that can bring that functionality to Cartoon Animator. Dollars Mocap is a low cost motion capture application with a free trial that I learned about through the YouTube Channel Digital Puppets  and their test video . It can record full body, upper body, arms and hands, and facial mocap from a live video source or pre-recorded video. Investigating further, I discovered not only does Dollars Mocap have a free iClone7, iClone8 character profile file download (look for it at the bottom of the main program download page), so you can use the saved motions with iClone8, they've also got a demo video for how to convert your

Creating an AI Digital Avatar and Voice Clone of Myself with Free and Low Cost AI Tools

O ver the years I've looked at various ways of creating and animating a digital avatar, from simply creating a character for Cartoon Animator and voicing and animating it myself, to creating a  live motion capture ready Vtuber avatar puppeted and voiced by me in real-time. In the last year or so, making photographic images talk, using AI and AI voice cloning has really progressed. To the point where I wondered if I could create a photographic AI avatar of myself, complete with my cloned voice, that I might use on some of my videos? Creating My Avatar: Artflow To create my avatar image, as far as I'm concerned,  Artflow.ai is the best value AI site for creating consistent digital characters (or 'actors' as Artflow calls them). That's pretty much their entire focus. Artflow's actor model training user interface. You get your first actor for free, 100 free credits per month (which equates to 100 still images per month - get an additional 50 credits if you sign

Moho 14 Released - Still the Best 2D Animation Software for Indy Animators on a Budget

Moho 14 Released. Regular readers know I am a Reallusion, Cartoon Animator advocate through and through. Hands down I would recommend Cartoon Animator 5 first over Lost Marble's Moho 14 to anyone who is just starting in 2D animation, is a team of one, or just needs to animate as quickly as possible. However, feature for feature, Moho is, arguably, the best 2D animation software for the rest of us who can't justify a Toon Boom Harmony , or Adobe Creative Cloud subscription (and even with their applications Moho is very competitive on features). You can get started with Moho Debut for just USD$59.99 which is a cut down version of Moho Pro but it still has the most essential features needed for 2D animation. While Moho Pro is a whopping USD$399.99 (Cartoon Animator, which only has one version, is just USD$149.00) upgrades to new version numbers come down to a quarter of the price at USD$99.00. Even though Reallusion just released features like Motion Pilot Puppet Animation and