Skip to main content

Five AI Generative Image to Video Tools For Animation You Can Try Free Right Now

A Robot draws a video animation, viewed from above.
The Emo Girl Character created by Start Animating.

AI generative video isn't new but it is the next big thing in the visual imaging space as various development teams work to perfect the generated output. 

Just like generating still images AI video sometimes struggles with physics, arm and hand movement, and the general structure of things.

However it is getting better and, as is the catch cry of all AI development, this is the worst it will ever be, because it's improving fast.

If you're an animator one current potential use of generative AI video is to animate your key frames, as opposed to generating something entirely from a text prompt. Starting with an image helps to keep your characters and art style consistent across AI generations.

With that in mind I tried five, free image to video AI generators to see what their potential might be and whether they can handle cartoon style characters well. Note all but the last entry on the list do not create any sound with the video output.

Toon Crafter

Toon Crafter is the generative AI video everyone is currently talking about. It lets you enter a sequence of images (key frames) and it'll do a pretty good job of animating the tweens.

Toon Crafter User Interface (Free Playground).
This is Toon Crafter's free playground interface. I was never able to generate anything with it. Underwhelming given all the hype.

I tried for days to get something to generate on the free playground with no success. It would just sit there ticking over for hours on end, to the point where I could've done the animation myself faster with Cartoon Animator.

It's supposedly good but I'm not paying for something I can't even trial on my own artwork.

Leonardo Image2Motion

At this point Leonardo's Image2Motion is very much a crap shoot. You can only input images from your own image generations (or ones from the public feed). There is a hack to upload an image but I actually forgot how I did it (maybe through the Canvas Editor I think?). 

You have one control. A slider for how much motion you want to add. Then you generate and get what you get. I've found it works best on images with a distinct foreground and background for which it really excels at doing cinematic panning shots.

Anime Amee and an Alien Businessman in an office animated with Leonardo AI's Image2Motion.
I didn't have the option to prompt the action in either of these images.
Amee, on the left, uses a low motion setting which I think is giving
her gastric reflux, while the pan around the alien on the right is
the kind of shot Leonardo's Image2Motion seems to favor.

Krea AI Video Generation

Krea's AI Video Generation is not unlike Toon Crafter in that you can add in a whole series of key frames but also, you can add in different prompts for different stages of the generation too.

I've seen some fairly good results when it comes to morphing one image to another but using it to draw tweens between similar key frames is a little more tricky to get usable results. Also the 'Render' setting produced images closer to my cartoon image key frames than the 'Animation' setting did.

Of all the Generative AI's listed this one has the most options for influencing the output.

Krea's AI Generative Video User Interface.
Krea's User Interface has the most potential for fine control of the output. Unfortunately
none of the style settings would maintain the art style of my key frames.

Luma Dream Machine

With a very simple interface, where you can either enter a prompt describing what you want to see, or you can start with an image and prompt for what you want to see happen within that image, Luma Dream Machine is still quite impressive.

On the free tier you currently get five generations in any given day, and 30 generations per month total, no commercial use. Which is seriously frustrating and I hope they'll extend that daily limit again once they're better able to meet the demand.

The video output is very good but you still get some weird things happening with arms and hands if you look closely. Each generation is only five seconds. There is this nice feature where you can automatically grab the last frame from any generation and extend the clip (and the AI will automatically stitch it to the previous clip as well).

Output from Luma Dream Machine. Original stills on the left.
On the surface output from Luma Dream Machine looks exceptional. My original
still images are on the left. In both cases the character was prompted to walk to the desk.
In both she walks right past it. Despite that, the background is accurately extended
in the same art style. The character subtly changes as she moves across the room,
with questionable arm movements. (Also I did not prompt for that mysterious person
who appears in the bottom frame). 


I was quite impressed with the output though I think there's probably a learning curve for how you prompt the action. My first prompts were quite simple and I think the Enhanced Prompt check box, that I had ticked, tended to add more action than I actually wanted.

Ultimately the results are the best of those listed so far just because it stayed closest to the original look of my key frames. The down side was the AI didn't seem to follow my prompts very closely and introduced elements not even mentioned in the prompt.

Hedra

Hedra is specifically for creating animated avatars that talk in a natural, realistic way. More than just lip syncing it animates the avatar's entire head and body (to some degree so the body isn't just still).

You can actually prompt an avatar but I suspect more people will use the option to upload an image. 

There's no way to crop the image yourself. Hedra looks for a face in the image and then crops accordingly. How much body you get depends on the image but Hedra favors a fairly close crop of just the head.

Hedra clearly specializes in making photographic avatars speak. When I tried it with a very cartoony 2D image, while it recognized the face, the output was clearly using a real human model for the eyes, mouth, and face structure. The whole thing looked creepy and unusable.

However, if you have something photographic or very close to it, like an anime character rendered with a slight 3D style, the results are extremely convincing.

Hedra's User Interface.
Hedra's User Interface is very simple but produces the best results of all the services listed
provided your avatar is photographic or in a semi realistic style. You can see an example
of this character animated (from a different photo) on my Art Time Productions Facebook page.


Currently Hedra's TOS states that you can only upload images of yourself, though they have no controls for policing that, and I'm guessing uploading digital avatars of non-existent people is fine (hopefully, because I see Hedra being used by AI influencers a lot).


Small Rant Section About Generative AI

I've heard a lot of nonsense about Generative AI which I don't intend to vent about here. The fact is Generative AI is causing a shake up of all creative services. It's here to stay. 

As much as some creators think it's going to take their jobs, it's also creating new jobs, that right now, are not hard to become an authority in, if you already have years of creative experience and output behind you.

Now is the time to explore all the opportunities for increased workflow and broader creative scope that this technology brings. 

Eventually the field will become too complex to break into easily. Learning while even the people developing the technology are learning is better than letting it all pass you by out of some misguided propaganda that ALL AI is 'stealing' from real artists. 

Non creatives in the commercial sector don't actually care how their art is made. This is actually your chance to stay informed, and become a curator of the best AI generative tools, learn how to use them better than non creatives.

It's no different to photography. In a day and age where almost everyone has a camera on their person, and we have stock image libraries for days. There is still a need for professional photographers and video camera operators. AI is not coming for you, nor will it make you redundant (and, if you didn't notice, a lot of the tools in this list aren't generating any 'stolen' images or styles).

AI is just shaking up how humans create. It's not bad. It's just new. You'll always have the option to charge a premium for art created 100% by a real human, if you really do wish to not engage.


o---o--- ---o--- o---

Did you find this article useful?
Subscribe to my newsletter and get the
latest articles delivered to your inbox.

Comments

Popular posts from this blog

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D  which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D...

Learn Reallusion's Cartoon Animator 5 Fast by Creating Fun, 2D, Animated Christmas Holiday Messages - Free Course by The Lazy Animator

H ave you ever wanted to send your friends and family fun, 2D animated, holiday messages, or just create 2D animated characters that you can make move and talk without learning difficult to master animation skills or spending hours drawing frame by frame? Reallusion's Cartoon Animator 5 is a professional quality, 2D animation studio software that is also very easy to produce impressive results with, even if you've never animated before, or can't draw. Don't Have Cartoon Animator 5 Download a free, 30 day trial . Easy Beginner Course I've created a completely free beginners course that teaches you my fast, easy way to rig and animate your first 2D custom character in Cartoon Animator 5 without complicated templates or any drawing skills at all. My online video course includes everything you need, including eight AI generated character sprite graphics, and four AI generated Human voice samples, so you can start learning right away. Eight AI generated character image...

Krita AI Diffusion - Generative Image AI For Krita is Seriously Useful, Powerful and Free (If You Can Install it Locally)

Generative AI sequence of a woman in a business suit. From sketch to refined image using Krita AI Diffusion - by TET G enerative image AI, where you describe an image with a text prompt to an Artificial Intelligence model and it produces a new image based on your prompt, is gaining a strong hold as a tool for many artists. Krita AI Diffusion brings generative AI image tools right into your favourite free and opensource, graphics editor, Krita. Not only that, if you have a computer with decent specs (and at least 10GB of hard drive space), Krita AI Diffusion is completely free. What If I Don't Have a Powerful Computer? If you're in my situation, with a computer that was around before anyone in the mainstream had even heard of generative AI, you can still access Krita AI Diffusion for free, using a cloud based AI server, Interstice  and 300 tokens, to get you started. Once your initial tokens run out, purchase 5000 more for 10€ (approx US$11.00). Tokens never expire. I would...

Glif (Alpha) - Make Your Own Tiny AI Powered Niche Image Generator Apps

I  first heard about Glif through a YouTube video that mentioned you could get access to Flux Pro (the latest 'game changer AI' generative image model) through the site for free. While I had a vague notion from the video of what Glif was, I wasn't expecting it to be so easy to get started with, and so good with my very first results. Glif is an easy to use, low-code platform for creating tiny AI-powered generators called Glifs. While that may not sound inspiring, what Glifs allow you to do is create a tiny app that niches down to a specific type of AI generation that the user modifies with their own inputs. The best way to really understand is with an example.  My First Glif I've recently been using VivaGo's AI platform  (free and unlimited at the time of writing) to consistently generate full body characters in a front facing T-Pose that I can rig as front facing characters in Cartoon Animator. Unfortunately it can be a bit hit or miss maintaining the T-Pose part...

The Ultimate Independent Animator's App and Resource List - Animation and Video Life

Image created with Cartoon Animator 4. Being an independent animator is not like a studio animation job. There's so much more to do that is indirectly related to the actual task of animating. Over the years I've sought out many apps, tools, and services that can help me achieve that one single task, expressing myself through animation. Below is my Ultimate Independent Animator's Resource List for 2024 (last updated Oct 2024). It started out as a list of free or low cost apps that could help you in every stage of producing either 2D or 3D animation, and then just kind of grew from there. You may not have been looking for a Time Management App as much as you needed something to get you started in 3D animation but when those commissioned projects start coming in you'll have a head start on maximizing your time. All the apps and services on this list had to meet two main criteria: They had to be useful and relevant to an Indy Animator/artist. The base app/se...

Wonder Unit Storyboarder - Free Storyboarding Software for People Who Can (or Can't) Draw

Wonder Unit Storyboarder.  As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder  is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu...

LTX Studio (Beta): AI-Powered Visual Storytelling, From Script to Screen in One App.

LTX Studio can generate consistent characters across storyboard panels - even if one character is a dragon! W hile text to image, and text to video (and image to video) AI tend to be getting a lot of the press, the real exciting aspect of generative AI implementation is how it can be used to speed up creator workflow. Being able to realize your creative vision in a shorter length of time can lead to more ambitious projects. Particularly if you're a team of one, with a very limited budget, but you one day dream of creating your own epic animated feature film. LTX Studio (beta), a new 'all-in-one' AI film making tool, is not going to let you realize that dream from a single text prompt but, by bringing a bunch of generative AI technologies together, the developers have created a one platform workflow that can help anyone rapidly visualize and deliver a story from initial idea to finished film in days rather than weeks (depending upon how ambitious the project is). Even bette...