Skip to main content

Artbreeder - Using AI created Character and Background Content in your Animations

A selection of AI generated images from Artbreeder.
A selection of User/AI generated images from Artbreeder.
If you're looking for an endless supply of 2D character and background images for your animations then Artbreeder, an online Artificial Intelligence (AI) that generates image mash-ups you can tweak as much as you like, could be the ultimate content library.

What is Artbreeder?

Artbreeder is free to use though there are various paid plans, that give you additional features, such as higher resolution download images or more settings to play with. All images created on the site are Public Domain (CC0 License) and can be used in commercial projects.

Using Artbreeder's online app you can generate head shot portraits, full body characters, landscapes, and other scenes simply by choosing two or more existing images to mash together then, using a series of sliders, to select which traits from each image you wish to lean toward in the final image.

Photo Comparison - Top is my original uploaded photo. Bottom is Artbreeder's aproximation.
Photo Comparison - Top
is my original uploaded
photo. Bottom is
Artbreeder's aproximation.
You can choose from existing source images on the site or, in some categories, upload your own. 

I found it interesting to upload my own photo headshot because Artbreeder does not use the literal image uploaded. Instead it recreates an approximation of the image, using its AI, ready for use in the app. My recreated image looked slightly more youthful.

I'm not going to go into a detailed tutorial on how to use Artbreeder. It takes a little experimentation to work it out but, once you do, it can be fun just seeing what kind of images you can generate. It seems like there's a slider adjustment for almost everything, ranging from art style, to age range and more.

Turning Artbreeder images into an animation

I thought I'd experiment to see if the images I produced could be brought into Reallusion's Cartoon Animator 4 and turned into an animation.

My plan was to create a simple animation showcasing the background and a character.

Below are my two original downloaded images created with Artbreeder. I was trying to generate a kind of steampunk fantasy character with a background to match. Following that is my final demonstration animation and the run down for how I put it all together.


My steampunk character and background as created in Artbreeder.
My steampunk character and background as created in Artbreeder.

Note, if you're using Artbreeder, and see an image you kind of like but aren't sure, click and save it anyway. There's no real undo feature, and restoring a single setting back to what it was is no guarantee you'll get the previous images back.

Preparing the images

Obviously my Artbreeder images were not ready to be loaded straight into Cartoon Animator. I needed to rig my character and break up my background into layers so I could create a parallax effect.

To prepare my images I used Krita, the free, open source image editor.

The background I split into three layers, the foreground rocks, the mid ground city, and the background sky. I did do some work to fill in the sky behind where the city was in the image but not too much since the parallax scrolling I wanted to create would be very subtle and the scale of the city would mostly hide the gap in the sky.

The female character I broke up into the various body part layers. I then exported a G3, front facing dummy character from CA4 into Krita in order to get the right character template. Next I copied all my body parts into the relevant layer folders in the template.

I saved a separate image of the characters head to use for the morph based head (which is the fastest character head to rig in CA4).

With regard to the character I didn't create a full set of hand sprites or create bone hands, since this is just a demo animation. I did create an extra set of flipped hand sprites so the character could fold her arms without her hands looking wrong.

Bringing the images into CA4

My final scene set up on Cartoon Animator's stage as viewed in 3D mode.
My final scene set up on Cartoon Animator's
stage as viewed in 3D mode.
My background image I saved as a photoshop file (.psd) and simply dragged it across onto CA4's stage area, importing it as a scene. CA4 retains all the layer information so, once the image was on the stage, I just moved each layer on the Z axis in order to create the parallax, depth I was going for.

I did add two 'fog' props to my scene from Reallusion's Weather Maker pack just to give the scene a little more atmospheric perspective (If you don't have this pack in your CA4 library I highly recommend it as an essential purchase).

My female character was also saved as a .psd file. I simply dragged the same dummy character I used to get the template in Krita onto the stage, went into the CA4 character composer, and imported my girl template.

All that remained to do then was create the morph based head using the head composer tools.

Turning it all into an Animation

The background set required very little animation as the parallax effect is created by the movement of the camera - which I keyframed to go from a wide shot to a mid shot of the girl.

I did animate a slight horizontal drift to the fog but you barely notice it unless you really watch closely once the camera stops moving.

The girl's walk toward character utilizes CA4's new Import 3D Motion feature for G3 characters. All of the front facing walks I had in my content library for 2D characters looked too cartoony and awkward (I can't imagine any of them look good, even with cartoony characters). So I imported a 3D motion of a female walking along a catwalk, and it was such a vast improvement.

CA4's Import 3D motion window.
CA4's Import 3D motion window.

When the girl stops, moves from side to side, and crosses her arms, that is part of an existing 'Idle Stand' motion from Reallusion's G3, 2D motions, included when you buy the software.

The girl's face and head animation is a little erratic and random because I just couldn't be bothered keyframing all her expressions. Instead I fired up the Motion 2D Live plug-in for faces and motion captured my own face. I'll admit it's not my best work but it kind of does the job for a thirty second demo.

Finally I added some cinematic music from YouTube's creator library, ambient desert wind sounds, and cinematic black bar letterboxing.

In Conclusion - Is Artbreeder any good as an image library for animation?

My demonstration animation certainly has its fair share of things that could be improved. Particularly my morph based head which could be so much better with a lot more time and effort (as well as my face capture acting). I mention this just to say those things are not down to Artbreeder's usefulness.

If you're willing to upgrade to Artbreeder's subscription plans you'll have an endless supply of high resolution images (the free plan is limited to about five high resolution downloads). Even on the free plan there are many more features than I've covered here.

Most of the portrait and character images are front facing which could be an issue as there's no way to create alternate views of a character you've saved. Or even the same character with different outfits (though you could solve this by rigging your character's head onto different outfits).

Most of the backgrounds are landscapes or abstract at this stage. Great for creating other worldly scenes but you'll need to look elsewhere for interiors. The interiors in the 'General' category didn't seem all that useful for creating actual interior background scenes.

I don't think I'd use Artbreeder as a source of graphics for a commercial project due to its limitations but there's a lot of fun to be had tinkering around with it on the side.

I could see myself definitely using it to generate backgrounds for certain projects - particularly anything that needed other-worldly landscapes or city skylines.

Furry Blue Ice Wolf created with Artbreeder.
Furry Blue Ice Wolf
created with Artbreeder.

It's definitely fun experimenting with the range and types of characters you can generate. Everything from photo realistic humans to furries and anime.

While you can certainly use the characters in your projects I'm not so sure how flexible (or time saving) they might be if you needed multiple angles of your character rigs. Certainly there's a lot of fun to be had generating a bunch of characters and animating them in smaller one shot style projects.

Overall Artbreeder is a useful tool that, if nothing else, could be a great starting inspiration point for your animated projects, and may be a good way to generate some of the final art too.


Note: I am not affiliated with Artbreeder and this post is my honest impressions of the site based on my experience creating the demo animation.


Would you like to study all the source files from this project? Why not purchase them using the 'Buy this' button below and help keep this site free.


Comments

  1. Very interesting article! Thanks David.

    ReplyDelete
  2. AI design and Character turn into animation that's looks so Amazing. When You turn all cartoon design into animation then its looks so Attractive. I visit your website twice per days and to see your Amazing Articles. You shared very helpful info.

    ReplyDelete
  3. It's definitely fun experimenting with the range and types of characters you can generate. Everything from photo realistic humans to furries and anime.

    ReplyDelete

Post a Comment

I welcome, read, and respond to genuine comments relating to each post. If your comment isn't that save me some time by not posting it.

Related Posts with Thumbnails

Popular posts from this blog

Real Human AI Text to Speech Voice App by Replica Studios - AI voice actors for games + films

Replica Studios TTS App. Image: Replica Studios It really pays to attend Reallusion's free animation demonstration Webinars. At a recent webinar, host, Kai DeNeve, featured Replica Studio's A.I. Voice Actor system . Replica uses Artificial Intelligence to learn a real voice actor's speech patterns, tone, and inflection, which can then be used with their Text To Speech (TTS) system to produce the most realistic computer generated voices yet (or at least that I've come across). You can even fine tune how individual words are said and more. Their TTS system works through a downloadable desktop app for Mac and Windows. There are also bridging apps if you want to use their system for voices in UnReal and Unity Gaming systems. Sign up for a free account and get 30 minutes of free voice downloads (that's 30 minutes of recorded audio - not 30 minutes to download audio - that you can download a line at a time). After that you can purchase 4 hour blocks for just USD$24.00.

Animating Warwick Hays Skateboarder Ed Character for Cartoon Animator - Can Ed Kickflip?

Skateboarder Ed. Character by Warwick Hays. Warwick Hays has built quite a sizeable collection of characters, props, and backgrounds for Cartoon Animator that I've yet to really explore, however, being the tragic skateboarder that I am, it was surely fate that I would buy his Skateboarder Ed G3 character as my first purchase. Now I don't know a lot about Warwick but, based on the design of the skateboard prop that comes with Skateboarder Ed I'm fairly certain Warwick doesn't know much about skateboarding, and/or probably didn't use a good reference when designing his skateboard. Bart's skateboard has changed over the years, though curiously, even later versions, barely get closer to what an actual skateboard looks like. To be fair, Warwick's holding up a tradition of animators who clearly haven't seen a skateboard or noticed how skaters actually ride them. Just check out Bart Simpson's flat plank of wood with wheels from the opening int

My First Anthropomorphic Character with Reallusion's Character Creator 3 (Pipeline) & Reviving My TETAnimations YouTube Channel

Skateboarding Cage Monster - Heelflip. Reallusion's Character Creator 3  is a pretty incredible application for creating any kind of human digital 3D character quickly. Its power comes from the way it can totally deform a standard human base template character into a seemingly infinite number of body types and shapes. While I wouldn't recommended it as a your only 3D character sculpting tool, it is very powerful with just how much you can edit a character's form at the vertex/mesh level. I've experimented a little with CC3's Edit mesh functions, mostly using it to hide areas of an object I don't want seen. Bat Storm's cape is a good example where I used the ability to hide vertices to completely remove the assassin's hood from the neckline up. Just on a whim I wondered if I could create my Cage Monster character entirely in CC3 (with exception to his skin textures which I edited in Krita). The character is basically a stylised human body with a monster

Voice All Your Own Animated Characters with Voice Changer

Voice Changer by AVSoft is real time voice manipulation software that can be used for a wide range of purposes including (according to their website); Voice-over and voice dubbing for audio/video clips, presentations, narrations, voice messages, voice mails, E-greeting cards, broadcasting, etc.; mimic the voice of any person, create animal sounds, change/replace/remove voices in songs, videos,etc. I bought it for the specific purpose of changing my own voice, to extend my vocal range, for voicing characters in my own animations. I was fortunate enough to get this software at a significant discount that made it difficult to refuse, given that I'd never tried it, or even heard of it before. I'm not sure if I would have bought it at the full price given that much of what it can do (for my needs) can also be done with the freeware audio program, Audacity . AV Voice Changer Interface. Voice Changer is relatively easy to install and set up. Once installed simply

Your First Look at Bat Storm Animated and Launching My Patreon

Bat Storm. Traditionally my Bat Storm character has always been a parody of whichever movie Batman is in the limelight. Back in the GoAnimate days that was Christian Bale, but now we have a new, upcoming Batman with Robert Pattinson. What better way to greet the new guy than with Bat Storm's own 'camera test' teaser just like Robert Pattinson's suit camera test. This is actually the very first public release of my new Bat Storm character model animated. Prior to this it's only been 'leaked' still images (does it count as leaking when it's the show creator deliberately posting images publically?). Anyhow Bat Storm pays homage to two Batmen ahead of their time (Val Kilmer and George Clooney) who had the balls to wear nipples on the Batsuit. Clearly a diversionary measure designed to disarm unsuspecting bad guys with laughter.  If no one is taking you seriously that's clearly an advantage! Visit my Patreon Page for more information. L

#XPPenanimationchallenge - How I Created My Entry for XP-Pen's First Animation Competition

XP-Pen's Mascot, Fenix, in A Change of Art by TET. XP-Pen , the makers of a range of pretty sweet pen display monitors, and Reallusion , the makers of some pretty sweet animation apps, teamed up for XP-Pen's very first Animation Challenge with the theme of 'Change'. Any form of animation was acceptable with entries needing to be a minimum of ten seconds in length. Entries closed on June 16th, 2020 (sorry, this blog isn't really a breaking news site, I probably should've mentioned it back in March when entries submissions opened) so it's too late to enter, but I wanted to tell you the tale of how I ended up creating my entry in a really late evening, the day before the deadline. Watch my entry below. Remember the theme is 'Change' and XP-Pen suggested in the rules that including their mascot, Fenix, somewhere in the animation would be looked upon favorably.   The Ideas Scenes from Skater - My First XP-Pen Competition Idea. This was not my first idea