Tokkingheads - Make Anyone's Head Shot Talk with Artificial Intelligence

I'm increasingly fascinated by how artificial intelligence systems are being incorporated into more creative applications like visual effects, A.I. generated art, and particularly the development of human sounding voices that can interpret dialogue with more human intonation.

Tokkingheads, by Rosebud AI is an interesting application available as a mobile app in both Apple and Play stores, as well as a browser based desktop version.

The simple premise is to upload a headshot image of any person (or use one of theirs), record yourself speaking anything, and then the A.I. will work out how to animate your image saying those words.

There's the additional option of filming yourself speaking those words (or you can use one of their videos) and the A.I. will add the movement of your head and face into the mix to 'puppet' your image.

The final animation is kind of like a budget light, deep fake video, except this was created in seconds and is relatively impressive with the right image and performance. I kind of like this Elon Musk effort (below).

My own attempts were mixed, with nothing particularly worthy of reposting here. If you are trying the self recorded video option you really need to consider what kind of result you want.

The application not only tracks your facial movements but also the movement of your entire head within the frame of the video. If you move your head around the frame a lot, the head in your image will be moved around a lot - resulting in a weird giraffe, Plastic man, neck kind of effect.

Moving your head around also results in the background of the final image bleeding into areas around the animation, making it obvious that the whole thing is a digital animation. If you want a lot of head movement then make sure your image has a minimal background (something like the Elon Musk animation).

The web version of the application is free to use, allowing you to create twenty second captures at a time. For better quality and longer videos, upgrade to the paid version.

Australian Artist and YouTuber, Jazza, brought this particular application to my attention with one of his videos (embeded below) where he really put the app through its paces.

It's worth a look, as he animates some of his own artwork with some relatively good results. It also serves as a primer for your own experiments, as he gives you plenty of tips for getting better results.

As you can see, he had a lot of fun with it. I'm not sure how useful it would be for your average animator but for short satirical clips, made fast... there's definitely something here worth experimenting with.

Comments

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D

Dollars Mocap: Full Body Webcam Motion Capture (Including Hands and Fingers) For iClone and Cartoon Animator

Even though I should be further away from the camera Dollars Mocap MONO still does a good job of tracking my arms, hands and fingers. Ever since I wrote my series on becoming a VTuber , discovering it was possible to do full body motion capture, including hands and fingers, with just software and a webcam, I've been on the look out for any motion capture software that can bring that functionality to Cartoon Animator. Dollars Mocap is a low cost motion capture application with a free trial that I learned about through the YouTube Channel Digital Puppets and their test video . It can record full body, upper body, arms and hands, and facial mocap from a live video source or pre-recorded video. Investigating further, I discovered not only does Dollars Mocap have a free iClone7, iClone8 character profile file download (look for it at the bottom of the main program download page), so you can use the saved motions with iClone8, they've also got a demo video for how to convert your

Prome AI Sketch Render Tool - Your Tradigital Clean Up and Colorist Artist for Character and Background Design

Random character head, Biro sketches drawn by TET (left). Render by PromeAI (right) using Prome's Sketch Render tool set to 'Comon:Cartoon, Render Mode: Outline'. W hile I don't do New Year Resolutions, one of my plans for the year ahead is to do more of my own art. Specifically character design drawn in an actual, physical sketchbook. To that end, I have been spending the last half hour of most days drawing a page or two of random biro sketches in my sketchbook and posting the pages to my Instagram account (this link will take you to one of my posts). These sketches are mostly practicing my skills because I don't really draw regularly anymore. Here is a tip, if you do this kind of sketching, and push yourself to keep doing it, you will see many drawings that could be taken further, even if you don't have anything they're suited for just at the moment. Which is where my second favorite AI Image Tool (after Leonardo.ai ) PromeAI comes into play. PromeAI

Moho 14 Released - Still the Best 2D Animation Software for Indy Animators on a Budget

Moho 14 Released. Regular readers know I am a Reallusion, Cartoon Animator advocate through and through. Hands down I would recommend Cartoon Animator 5 first over Lost Marble's Moho 14 to anyone who is just starting in 2D animation, is a team of one, or just needs to animate as quickly as possible. However, feature for feature, Moho is, arguably, the best 2D animation software for the rest of us who can't justify a Toon Boom Harmony , or Adobe Creative Cloud subscription (and even with their applications Moho is very competitive on features). You can get started with Moho Debut for just USD$59.99 which is a cut down version of Moho Pro but it still has the most essential features needed for 2D animation. While Moho Pro is a whopping USD$399.99 (Cartoon Animator, which only has one version, is just USD$149.00) upgrades to new version numbers come down to a quarter of the price at USD$99.00. Even though Reallusion just released features like Motion Pilot Puppet Animation and

Wonder Unit Storyboarder - Free Storyboarding Software for People Who Can (or Can't) Draw

Wonder Unit Storyboarder. As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu

Can't Draw Characters? Create Highly Detailed Characters from Simple Drawings and Prompts Free with Realtime Canvas by Leonardo.AI

Leonardo.ai's Realtime Canvas. Create highly detailed images from simple drawings. I f you've had an idea for a character but don't have the artistic skill to design it yourself, or the budget to hire someone to do the design work for you, then Leonardo.ai's Realtime Canvas may be your new creative partner. Sure you could use Leonardo.ai's regular text prompt to image generator but that can be very hit and miss, and may take many generations before you finally craft a complex prompt that's getting something close to what you had in mind. Realtime Canvas, on the other hand, lets you craft a simple text prompt and draw a rough image, both of which you can keep refining until you get a final, real time, updated image that looks close to (and probably better than) what you had in mind. Using Realtime Canvas Once you've signed up for a free account with Leonardo.ai (which will give you 150 free credits, renewed daily), click on Realtime Canvas, from the side

Start Your 2D Animation Side Hustle - Sell Your Cartoon Animator Characters, Props, Scenes, and Motion Files in the Reallusion 2D/3D Marketplace

Have you thought about starting a side hustle selling your original Cartoon Animator assets in the Reallusion 2D/3D Marketplace ? In this article, the first in a series on selling in the marketplace, I'll give you an overview of what's involved, why you should give it some thought, and whether you can earn enough to quit your day job (or at least have a worthwhile side hustle). If you're an artist with any kind of drawing skills, and you're creating your own original characters, props, scenes, and even motion files for your Cartoon Animator projects, then setting up your own store in the Reallusion Marketplace should be a no brainer. You're making content already, it doesn't cost you anything to set up, and Reallusion only takes a 30% commission from each item sold. (If you think that's a lot, I'll address that further down). Don't be put off if you think your art skills aren't up to professional standards. There are plenty of artists with naïve

Animation and Video Life

Search This Blog