Krita AI Diffusion - Generative Image AI For Krita is Seriously Useful, Powerful and Free (If You Can Install it Locally)
Generative AI sequence of a woman in a business suit. From sketch to refined image using Krita AI Diffusion - by TET
Generative image AI, where you describe an image with a text prompt to an Artificial Intelligence model and it produces a new image based on your prompt, is gaining a strong hold as a tool for many artists.
Krita AI Diffusion brings generative AI image tools right into your favourite free and opensource, graphics editor, Krita. Not only that, if you have a computer with decent specs (and at least 10GB of hard drive space), Krita AI Diffusion is completely free.
What If I Don't Have a Powerful Computer?
If you're in my situation, with a computer that was around before anyone in the mainstream had even heard of generative AI, you can still access Krita AI Diffusion for free, using a cloud based AI server, Interstice and 300 tokens, to get you started.
Once your initial tokens run out, purchase 5000 more for 10€ (approx US$11.00). Tokens never expire. I would've like to have seen a daily quota of free tokens for casual users, like most AI image generation sites, but at least it's not a subscription. You only need to purchase tokens when you run out.
This was my very first image generation, one of my benchmarks of an alien wearing a business suit, sitting at a desk, using a computer. The floating docker on the left is the Krita AI Diffusion Plug-in.
Installation
I'm not going to go through the process of installation as all that is clearly explained on the plugin website. There's even a visual guide on the Interstice site.
You have three options. Two of them involve running a local server on your machine for the AI. You may eventually want to do that but I recommend you take advantage of the 300 free tokens and the cloud server option to try it out.
Setup for the cloud, is as easy as downloading and installing the Krita AI Diffusion plugin (a very small zip file) and then linking your free account on the cloud server to the plugin. You can be up and running inside 15 minutes.
Note that no images are stored on the server and you own all the rights to the images you generate.
Using Krita AI Diffusion
Krita AI Diffusion installs as a docker panel inside Krita. Once you've started a new document and connected it to your server (in my case the cloud). You're good to go. Type in a prompt and see what happens.
The main AI features you get are Generate, Inpaint, Outpaint, Refine, Live Painting, Control (guided output from image references), Resolutions, Job Queues, History, Style Presets, and Style Preset Customization.
I was both impressed and overwhelmed with what this plug-in brings to Krita. On its own it seems like one of the most powerful AI image generators out there, but teamed with Krita, a full feature graphics editor, I almost don't want to use anything else. It's kind of next level.
If you are using the free tokens of the cloud service I recommend you keep your image size to 512 x 512 pixels. You can go bigger but you'll burn through your tokens faster (the number of tokens per generation is shown next to the 'Generate' button based on your settings).
Krita AI Diffusion's live canvas lets you paint fairly basic drawings which it will turn into more finished art taking your text prompt into account.
Also, avoid using the live canvas feature too much while using your free tokens, as that seems to burn through tokens extremely quickly. My Interstice account said I'd generated 121 images, which I definitely didn't. I can only assume, every time the live canvas updated, that also counted as a generation.
There's too many features to actually cover in an article but if you want to see Krita AI Diffusion in action watch the introductory video - part 2 below by Intelligent Image for a fairly comprehensive overview. Note that part 1 to this video is a walk through of installation and all the plug-in's settings that is worth watching if you want to know what everything goes.
One feature I do like is the ability to have different image generations on each layer of a document. This allows for so much more flexibility as you're not limited to just changing a single layer like most online generative editors.
If I didn't have to pay for tokens I would spend a few weeks learning everything. It's a real game changer for Krita itself as a graphics application. That said, 5000 tokens goes a long way given a standard image generation is between 1-5 tokens.
Final Thoughts
If you use Krita, I highly recommend installing this plug-in and at least trying out the cloud version for free until your tokens run out. If it's not for you, just turn off the docker and never look at it again.
However, what it brings to your workflow is truly astonishing. Aside from the obvious, of completely generating images from scratch, it can be a lot of fun taking your own sketches, that you were never going to do anything with, and spending a few minutes using AI to color and enhance them to finished, digital art.
It's also very good at turning images back into line art. Very handy if you've ever thought of making coloring books of your own artworks.
I can't even begin to sing its praises enough here. I would encourage you to watch as many videos as you can on Krita AI Diffusion to see what is possible. It really is one of the most powerful AI Image Generators out there.
o---o--- ---o--- o---
Did you find this article useful? Subscribe to my newsletter and get the latest articles delivered to your inbox.
M obile productivity apps have become so capable that they can be great alternatives to their PC/MAC equivalents or serve as great tools in their own right when you're away from your desk. While some apps simply mimic their desktop counterparts, others offer well thought out, touch-friendly interfaces that are easier and more fun to use. Every so often I check out what's available for 2D animation for Android devices, since that's what I use, that can complement my workflow with Reallusion's Cartoon Animator 5. Some may be available for Apple devices as well. Below I've listed six free (F) apps (with optional paid (P) upgrades) on the Google Play Store that you might want to explore. Some are just fun apps on their own while others may be useful as part of your workflow on bigger animation projects. Not all are exclusively animation apps and could be used on any production. JotterPad (F/P) The name JotterPad makes this sound like a notepad application but it's ...
Continuing on with my progress of learning Crazy Talk Animator 2 I've begun work on creating my first Multi-Dimensional character. As you may have guessed it's my Skate Monkey character that I briefly attempted to turn into a CTA1 character quite some time back (See this post for the video ). A CTA2 'Multi-Dimensional' character is simply a character that consists of 10 different view angles that form a 360 degree view. This character is attached to a bone skeleton that exists in three dimensional space. The software then calculates which images from your 10 different view angles are needed to execute whatever motion you add. In the image below you can see my skate monkey character drawn at angle zero in the Serif DrawPlus template provided by Reallusion. The other nine view angles are the CTA2 dummy character which I will progressively replace with my monkey as I draw more views. A CTA2 Multi-Dimensional character has 10 view angles. In the short video be...
Alvin Owl: Bones Rig. In part 2 of my journal blog documenting my progress with learning Moho Pro 12 I dive head first into the first batch of video tutorials covering the basics of Anime Studio Debut.... wait, what? In Part 1 I described how the video tutorials I purchased with Moho Pro 12 were in no particular order and made for a confusing mess. As well, most of the video tutorials are really for Anime Studio 11, which has all the same basic features minus whatever new features have been added.
Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D...
I discovered Plastic Animation Paper (PAP) Pro 4.0 for Windows quite some time ago and even had it installed on my computer for well over a year - unused. The full pro version of the software has been given away for free, no strings attached but with no tech support, since July of 2010. Not to be sneezed at since prior to that date this version sold for 695 Euro (roughly US$900.00). When I discovered it I was still finding my way back into my love for animation and the bug to animate my characters more traditionally via classical, hand drawn 2D animation techniques had yet to take hold. I didn't really understand what PAP did or why you couldn't make complete, finished animations with it. After finding some really great, very affordable, digital storyboarding software , PAP is the next tool in your digital production workflow for those of you on a budget creating traditional 2D animation. Depending upon how finished your storyboard panels are you could even impor...
Image created with Cartoon Animator 4. Being an independent animator is not like a studio animation job. There's so much more to do that is indirectly related to the actual task of animating. Over the years I've sought out many apps, tools, and services that can help me achieve that one single task, expressing myself through animation. Below is my Ultimate Independent Animator's Resource List for 2024 (last updated Oct 2024). It started out as a list of free or low cost apps that could help you in every stage of producing either 2D or 3D animation, and then just kind of grew from there. You may not have been looking for a Time Management App as much as you needed something to get you started in 3D animation but when those commissioned projects start coming in you'll have a head start on maximizing your time. All the apps and services on this list had to meet two main criteria: They had to be useful and relevant to an Indy Animator/artist. The base app/se...
EnjoyingLifeInSeoul GoAnimator enjoyinglifeinseoul is the December 2013 winner of my GoAnimate, Get Featured in TET's Blog contest . Enjoyinglifeinseoul has had his account with GoAnimate since March of 2011 and in that time has amassed 3346 followers and published 49 animations. This is his second win of the contest. Read his first winning post here . Enjoyinglifeinseoul chose to feature his animation , saying... Well, it took me some time to decide which of my animations to have featured. I considered some of my older ones like “Prince of Persia” or “Turtle Shell! Turtle Shell!” and the latest ones like “Demon Fire!” and “Witches of Misery!” In the end I went with “Witches of Misery” because most of the challenges and special techniques I had used in the others were covered the last time I was featured here. Some fresh problems popped up this time and I thought that the solutions I came up with might help some of your readers. The other reason I choose this one...
Very interesting, I am definitely going to have a look..
ReplyDelete