Skip to main content

Software Review: CrazyTalk 8 Pipeline by Reallusion

Reallusion released the newest version of its CrazyTalk software during December 2015 and I was fortunate enough to get my hands on a free copy CrazyTalk 8 Pipeline version after buying a truckload of Reallusion content in order to get the special deal.

If you're not familiar with CrazyTalk it's basically specialized software for creating and animating talking heads quickly. CrazyTalk 8 extends the original capability of creating a semi 3D head from a 2D image to creating true 3D heads that can be imported into iClone and Reallusion's new 3D Character Creator (Pipeline version only).



Since the original function of creating a talking head from a 2D image is pretty much the same as CrazyTalk 7 I'll be focusing on the new to CrazyTalk 8 function of creating and animating a true 3D head/talking avatar. For a quick overview of this function watch the video below.



With anything that lets you create any kind of custom character my go to project is to try and create an avatar of myself. So that's exactly what I did.

Original Webcam Images.
I didn't have any suitable images ready to go so I took a front and side image of my head using my webcam in the recommended poses.

Unfortunately my webcam is only low-res suitable for video calls so I attempted to scale up my images using PhotoZoom Classic 6, software that is supposed to be able to scale up low-res images so they still look good and don't pixelate. It did a fairly okay job but I have no doubt you'd get better results using actual high res photos.

From there I opened CrazyTalk 8, started a new 3D character project and began running through the step by step instructions.

Prior to this I had run through all of Reallusion's video tutorials on the new functions. You don't really need to do this as everything is really clear and handled in a logical way. However you will pick up many tips for how to improve your characters and learn how to drill down into the less obvious settings of the software once you've completed your initial character.

Constructing my 3D TET head in CT8.
The majority of the process is simply placing and adjusting points on your two photos so that the program can generate a 3D version of that image (minus hair).

I won't detail the process suffice to say it wasn't hard and I thought I came up with a reasonable likeness after quite a bit of tweaking of points.

Once you have your bald, shirtless character the next thing you'll want to do is replace the eyes. You can get by with the eyes from your photo but they won't look right almost as soon as the character starts moving its eyeballs around. Time to substitute with some template eyes.

For some reason, all of the realistic human eyes in CrazyTalk 8 content appear very bloodshot and red. I added in template blue eyes and it look like my avatar had spent a very rough night on the town. I tried adjusting the brightness and contrast but the eyes still looked terrible.

In the end I saved out my eye texture and removed much of the bloodshot lines and lightened up the eyeball white considerably. A don't know about Reallusion's staff and how much sleep they must get to include eye templates so blood shot but a few clearer eyes would be nice.

After that it was time to choose some hair and clothes. Again I don't know about Reallusion's staff but how about some hair and clothes in the included content that people actually wear in the real world?

This was as close as I could get to something that
looked like me with the included content.
All the male hairstyles included seem like they were modeled from teens, surfers or hipsters and looked ridiculous on my 45 year old avatar head.

I can't tell you how disappointing it is to get a really good likeness of the head only to have it ruined by a hair style that isn't even close to my own even though I've tried to find one that kind of looks like my hair.

Same goes for the included clothes. Most outfits for the males are things that look like stuff my grandfather would wear or are better suited to surfers and hipsters. I had better luck recoloring a suit to be more like the TET Avatar I usually create but some regular business suits or even just a normal dress shirt would be nice.

To resolve the issues with the lack of male hair styles and clothes I did buy Reallusion's Party Fun and Dress Up Showtime Packs but I don't think these were worth the US$109.00 I paid for them given how few new male hair styles and clothes they added in a style that I could actually use. Come on Reallusion, where's the regular every day people packs for males and females? How often am I really going to need springy star head bands and clown noses in my talking head animations? Are all these Cos-Play accessories and clothing items really in high demand?

After buying some content packs my character's
appearance was much closer to what I wanted.
Those complaints aside, with the new content packs I was able to get much closer to my TET Avatar (that always wears circle specs) than before.

CrazyTalk 8 has predefined atmosphere templates that give your character specific lighting and weather conditions. With limited physics options that can add a little more realism such as having your character's hair blowing in the breeze.

It's easy enough to mix and match the atmospheres up by simply choosing the atmosphere you want and then changing the background to one of those from another atmosphere template or you can even upload your own.

Getting your Avatar's to talk is pretty straight forward. You can record directly into the software or upload an audio file. The lip syncing will happen automatically. For the most part it's pretty good but you can tweak it through the timeline if things are a bit off in places.

Animating is also a breeze. You can use predefined motions or manually puppet the character if you wish. My first test animation below uses only the auto-talk animation motions. I've no doubt I could improve upon this with a little more tweaking and a few more layers of motion on the timeline.



Once you're done export the animation into one of several video formats and use it as you wish in your own productions. Like Reallusion's other flagship products (iClone and CrazyTalk Animator 2) CrazyTalk 8 isn't intended as a complete animation tool. You'll need to import your finished sequences into a video editor if you want to add further elements like titles, transitions and other stuff.

An added bonus of purchasing the Pipeline version of CrazyTalk 8 is the ability to export your 3D heads into iClone or Reallusion's 3D Character Creator. In general CT8 is a much easier environment to design heads in as opposed to doing the same directly in those other two packages. It's a good way to start a character before exporting it and refining it further. It also gives you the option of giving your characters a full 3D body in iClone if you really want to expand from just animating the head.

Over all I really like CrazyTalk 8's ease of use. It does a pretty good job of producing realistic looking heads as well as caricature heads if satire is more you thing.

If you already have CrazyTalk Animator 2 then you can get by without the 2D avatar creation tools of CT8. If you already have iClone and/or Reallusion's 3D Character Creator then you could also get by without CT8's 3D head creation tools. However if you do a lot of talking head style animations then this is certainly the better tool to use as it's simpler whilst still being very versatile.

I can certainly see myself experimenting with it and using it a lot more as a starting point for character designs. I particularly want to try more comic style avatars rather than the realistic heads that I've demonstrated here.


Comments

  1. Hi David - thanks for this. I found it very useful, especially the analysis in your second-to-last paragraph.

    Have subscribed and am looking forward to more...

    ReplyDelete
    Replies
    1. Glad you found this review helpful. If you haven't read it already, I wrote a later article on creating a more illustrative style 3D head and went through the process of transferring it from CT8 to iClone6. Read it Here.

      Delete
  2. Thank you! Need to get iClone6, clearly. I have come up against a thorny little problem though. From the time you did your head, how did you get to the body stage, or didn't you do that in Crazytalk8? I see the Actor Styles icon isn't visible when I have my custom head, only when I switch to one of their models in the library.

    Somehow I thought it would be a bit easier to get a body on him. Or did you add a body via some other software? V puzzled.

    S

    ReplyDelete
    Replies
    1. CrazyTalk will only allow you to add a neck and shoulders to your character (no arms or hands though). It's specifically a 'talking heads' animation software.

      Once you complete the head it is automatically placed on a body. At which point you can add clothes etc.

      Actor styles should still work with your custom head once you've finished setting it up, though I tend to just go through all the content folders and pick and chose the things I want.

      Delete
  3. So far here is my problem with Reallusion. The product is absolutely fine with a very notable exception. First of all, I ordered CT8 "Pipeline". That term "Pipeline", as Reallusion defines it, means that you can export assets that you create to other applications. So I purchase a CT8 pipeline package that included Realistic 100 Human (heads) thinking, ok I can create in CT8 and export to my favorite apps. Wrong! First the $189 package doesn't include export rights for the content, that's another $50,which I did purchase. Next, no way to export the content unless you have Content Creator with "pipeline" which you later find out is only done if you buy IClone with "pipeline" for another $380 minimum while it is on sale. So in short. These guys have a great product but who ever is in charge of sales and explaining to the public how all the pieces fit together are killing its viability. I bought CT7 and then this product but it'll be my last if they don't correct the issues here. In short if you do not use Iclone with "Pipeline", don't bother with this product unless all you need is to use it from within CT8.

    ReplyDelete
    Replies
    1. I sometimes think people don't do adequate research on products before they buy them.

      When I purchased CT8 (Pipeline) I knew you could export the 3D heads to iClone only and that you'd need Character Creator to do it. Character Creator is a free bonus you receive with all versions of iClone.

      Usually if you want to export iClone content to other apps you need 3DXchange (pipeline) to do it and need to purchase an additional license for the content to be used in non-Reallusion apps if you haven't already paid an export license.

      All of this information is on their site and, when you buy content, you are usually given two license options iContent or Export (Choose Export if you don't want to pay additional license fees on your content when exporting to other apps).

      Delete
  4. Is there a list somewhere of all the video formats that you can create in CrazyTalk 8?

    ReplyDelete

Post a Comment

I welcome, read, and respond to genuine comments relating to each post. If your comment isn't that save me some time by not posting it.

Related Posts with Thumbnails

Popular posts from this blog

Real Human AI Text to Speech Voice App by Replica Studios - AI voice actors for games + films

Replica Studios TTS App. Image: Replica Studios It really pays to attend Reallusion's free animation demonstration Webinars. At a recent webinar, host, Kai DeNeve, featured Replica Studio's A.I. Voice Actor system . Replica uses Artificial Intelligence to learn a real voice actor's speech patterns, tone, and inflection, which can then be used with their Text To Speech (TTS) system to produce the most realistic computer generated voices yet (or at least that I've come across). You can even fine tune how individual words are said and more. Their TTS system works through a downloadable desktop app for Mac and Windows. There are also bridging apps if you want to use their system for voices in UnReal and Unity Gaming systems. Sign up for a free account and get 30 minutes of free voice downloads (that's 30 minutes of recorded audio - not 30 minutes to download audio - that you can download a line at a time). After that you can purchase 4 hour blocks for just USD$24.00.

Animating Warwick Hays Skateboarder Ed Character for Cartoon Animator - Can Ed Kickflip?

Skateboarder Ed. Character by Warwick Hays. Warwick Hays has built quite a sizeable collection of characters, props, and backgrounds for Cartoon Animator that I've yet to really explore, however, being the tragic skateboarder that I am, it was surely fate that I would buy his Skateboarder Ed G3 character as my first purchase. Now I don't know a lot about Warwick but, based on the design of the skateboard prop that comes with Skateboarder Ed I'm fairly certain Warwick doesn't know much about skateboarding, and/or probably didn't use a good reference when designing his skateboard. Bart's skateboard has changed over the years, though curiously, even later versions, barely get closer to what an actual skateboard looks like. To be fair, Warwick's holding up a tradition of animators who clearly haven't seen a skateboard or noticed how skaters actually ride them. Just check out Bart Simpson's flat plank of wood with wheels from the opening int

My First Anthropomorphic Character with Reallusion's Character Creator 3 (Pipeline) & Reviving My TETAnimations YouTube Channel

Skateboarding Cage Monster - Heelflip. Reallusion's Character Creator 3  is a pretty incredible application for creating any kind of human digital 3D character quickly. Its power comes from the way it can totally deform a standard human base template character into a seemingly infinite number of body types and shapes. While I wouldn't recommended it as a your only 3D character sculpting tool, it is very powerful with just how much you can edit a character's form at the vertex/mesh level. I've experimented a little with CC3's Edit mesh functions, mostly using it to hide areas of an object I don't want seen. Bat Storm's cape is a good example where I used the ability to hide vertices to completely remove the assassin's hood from the neckline up. Just on a whim I wondered if I could create my Cage Monster character entirely in CC3 (with exception to his skin textures which I edited in Krita). The character is basically a stylised human body with a monster

Your First Look at Bat Storm Animated and Launching My Patreon

Bat Storm. Traditionally my Bat Storm character has always been a parody of whichever movie Batman is in the limelight. Back in the GoAnimate days that was Christian Bale, but now we have a new, upcoming Batman with Robert Pattinson. What better way to greet the new guy than with Bat Storm's own 'camera test' teaser just like Robert Pattinson's suit camera test. This is actually the very first public release of my new Bat Storm character model animated. Prior to this it's only been 'leaked' still images (does it count as leaking when it's the show creator deliberately posting images publically?). Anyhow Bat Storm pays homage to two Batmen ahead of their time (Val Kilmer and George Clooney) who had the balls to wear nipples on the Batsuit. Clearly a diversionary measure designed to disarm unsuspecting bad guys with laughter.  If no one is taking you seriously that's clearly an advantage! Visit my Patreon Page for more information. L

Voice All Your Own Animated Characters with Voice Changer

Voice Changer by AVSoft is real time voice manipulation software that can be used for a wide range of purposes including (according to their website); Voice-over and voice dubbing for audio/video clips, presentations, narrations, voice messages, voice mails, E-greeting cards, broadcasting, etc.; mimic the voice of any person, create animal sounds, change/replace/remove voices in songs, videos,etc. I bought it for the specific purpose of changing my own voice, to extend my vocal range, for voicing characters in my own animations. I was fortunate enough to get this software at a significant discount that made it difficult to refuse, given that I'd never tried it, or even heard of it before. I'm not sure if I would have bought it at the full price given that much of what it can do (for my needs) can also be done with the freeware audio program, Audacity . AV Voice Changer Interface. Voice Changer is relatively easy to install and set up. Once installed simply

#XPPenanimationchallenge - How I Created My Entry for XP-Pen's First Animation Competition

XP-Pen's Mascot, Fenix, in A Change of Art by TET. XP-Pen , the makers of a range of pretty sweet pen display monitors, and Reallusion , the makers of some pretty sweet animation apps, teamed up for XP-Pen's very first Animation Challenge with the theme of 'Change'. Any form of animation was acceptable with entries needing to be a minimum of ten seconds in length. Entries closed on June 16th, 2020 (sorry, this blog isn't really a breaking news site, I probably should've mentioned it back in March when entries submissions opened) so it's too late to enter, but I wanted to tell you the tale of how I ended up creating my entry in a really late evening, the day before the deadline. Watch my entry below. Remember the theme is 'Change' and XP-Pen suggested in the rules that including their mascot, Fenix, somewhere in the animation would be looked upon favorably.   The Ideas Scenes from Skater - My First XP-Pen Competition Idea. This was not my first idea

Artbreeder - Using AI created Character and Background Content in your Animations

A selection of User/AI generated images from Artbreeder. If you're looking for an endless supply of 2D character and background images for your animations then Artbreeder , an online Artificial Intelligence (AI) that generates image mash-ups you can tweak as much as you like, could be the ultimate content library. What is Artbreeder? Artbreeder is free to use though there are various paid plans, that give you additional features, such as higher resolution download images or more settings to play with. All images created on the site are Public Domain (CC0 License) and can be used in commercial projects. Using Artbreeder's online app you can generate head shot portraits, full body characters, landscapes, and other scenes simply by choosing two or more existing images to mash together then, using a series of sliders, to select which traits from each image you wish to lean toward in the final image. Photo Comparison - Top is my original uploaded photo. Bottom is Artbreeder's ap