Tokkingheads - Make Anyone's Head Shot Talk with Artificial Intelligence

I'm increasingly fascinated by how artificial intelligence systems are being incorporated into more creative applications like visual effects, A.I. generated art, and particularly the development of human sounding voices that can interpret dialogue with more human intonation.

Tokkingheads, by Rosebud AI is an interesting application available as a mobile app in both Apple and Play stores, as well as a browser based desktop version.

The simple premise is to upload a headshot image of any person (or use one of theirs), record yourself speaking anything, and then the A.I. will work out how to animate your image saying those words.

There's the additional option of filming yourself speaking those words (or you can use one of their videos) and the A.I. will add the movement of your head and face into the mix to 'puppet' your image.

The final animation is kind of like a budget light, deep fake video, except this was created in seconds and is relatively impressive with the right image and performance. I kind of like this Elon Musk effort (below).

My own attempts were mixed, with nothing particularly worthy of reposting here. If you are trying the self recorded video option you really need to consider what kind of result you want.

The application not only tracks your facial movements but also the movement of your entire head within the frame of the video. If you move your head around the frame a lot, the head in your image will be moved around a lot - resulting in a weird giraffe, Plastic man, neck kind of effect.

Moving your head around also results in the background of the final image bleeding into areas around the animation, making it obvious that the whole thing is a digital animation. If you want a lot of head movement then make sure your image has a minimal background (something like the Elon Musk animation).

The web version of the application is free to use, allowing you to create twenty second captures at a time. For better quality and longer videos, upgrade to the paid version.

Australian Artist and YouTuber, Jazza, brought this particular application to my attention with one of his videos (embeded below) where he really put the app through its paces.

It's worth a look, as he animates some of his own artwork with some relatively good results. It also serves as a primer for your own experiments, as he gives you plenty of tips for getting better results.

As you can see, he had a lot of fun with it. I'm not sure how useful it would be for your average animator but for short satirical clips, made fast... there's definitely something here worth experimenting with.

Comments

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D

Eric W. Schwartz: Cartoonist, Animator and Amiga Die Hard

July 1992 Edition, CU Amiga Featuring Amy the Squirrel. American Cartoonist, Eric W. Schwartz , (whose unofficial Amiga Icon, Amy the Squirrel, is pictured on the July 92 edition of CU Amiga cover on the right) is my only real animation hero. Sure there are the big names like Disney , Chuck Jones , Tex Avery and even Preston Blair whose influences can all be seen in my own cartoons but Eric did what none of the others could. He showed that really great 2D computer animation was within my reach with little more than an Amiga Computer , a copy of Deluxe Paint and Moviesetter . This was at a time when computer based animation was in its infancy (outside of computer game animation) and Flash was something that lights did. There were many great Amiga artists but Eric was really the only one consistently making very funny, traditional style animations. His humor and drawing style is heavily influenced by classic Warner Brothers and Disney cartoons but he managed to build on this,

Wonder Unit Storyboarder - Free Storyboarding Software for People Who Can (or Can't) Draw

Wonder Unit Storyboarder. As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu

Can You Learn Reallusion's Cartoon Animator 5 for Free Using Their 137 Official YouTube Video Tutorials Sorted Into a Logical Learning Order?

Or you could just buy The Lazy Animator Beginner's Guide to Cartoon Animator . While Reallusion's Cartoon Animator is one of the easiest 2D animation studios to get up and running with quickly, learning it from all of the official, free, video tutorials can be more overwhelming than helpful. With more than 137 videos totaling more than 28 and a half hours of tutorials, spread across three generations of the software (Cartoon Animator 3 through 5) it's hard to know if what you're learning is a current or legacy feature that you either need to know or can be skipped. Many of the official tutorials only teach specific features of the software and don't relate at all to previous or later tutorials. As a result there are many features either not mentioned or are hard to find. To make your learning easier, on this page, I've collected together all of the essential, official, free video tutorials and sorted them into a learning order that makes sense. Simply start at

Dollars Mocap: Full Body Webcam Motion Capture (Including Hands and Fingers) For iClone and Cartoon Animator

Even though I should be further away from the camera Dollars Mocap MONO still does a good job of tracking my arms, hands and fingers. Ever since I wrote my series on becoming a VTuber , discovering it was possible to do full body motion capture, including hands and fingers, with just software and a webcam, I've been on the look out for any motion capture software that can bring that functionality to Cartoon Animator. Dollars Mocap is a low cost motion capture application with a free trial that I learned about through the YouTube Channel Digital Puppets and their test video . It can record full body, upper body, arms and hands, and facial mocap from a live video source or pre-recorded video. Investigating further, I discovered not only does Dollars Mocap have a free iClone7, iClone8 character profile file download (look for it at the bottom of the main program download page), so you can use the saved motions with iClone8, they've also got a demo video for how to convert your

Creating an AI Digital Avatar and Voice Clone of Myself with Free and Low Cost AI Tools

O ver the years I've looked at various ways of creating and animating a digital avatar, from simply creating a character for Cartoon Animator and voicing and animating it myself, to creating a live motion capture ready Vtuber avatar puppeted and voiced by me in real-time. In the last year or so, making photographic images talk, using AI and AI voice cloning has really progressed. To the point where I wondered if I could create a photographic AI avatar of myself, complete with my cloned voice, that I might use on some of my videos? Creating My Avatar: Artflow To create my avatar image, as far as I'm concerned, Artflow.ai is the best value AI site for creating consistent digital characters (or 'actors' as Artflow calls them). That's pretty much their entire focus. Artflow's actor model training user interface. You get your first actor for free, 100 free credits per month (which equates to 100 still images per month - get an additional 50 credits if you sign

Moho 14 Released - Still the Best 2D Animation Software for Indy Animators on a Budget

Moho 14 Released. Regular readers know I am a Reallusion, Cartoon Animator advocate through and through. Hands down I would recommend Cartoon Animator 5 first over Lost Marble's Moho 14 to anyone who is just starting in 2D animation, is a team of one, or just needs to animate as quickly as possible. However, feature for feature, Moho is, arguably, the best 2D animation software for the rest of us who can't justify a Toon Boom Harmony , or Adobe Creative Cloud subscription (and even with their applications Moho is very competitive on features). You can get started with Moho Debut for just USD$59.99 which is a cut down version of Moho Pro but it still has the most essential features needed for 2D animation. While Moho Pro is a whopping USD$399.99 (Cartoon Animator, which only has one version, is just USD$149.00) upgrades to new version numbers come down to a quarter of the price at USD$99.00. Even though Reallusion just released features like Motion Pilot Puppet Animation and

Animation and Video Life

Search This Blog