OpenArt Versus Dzine: AI Consistent Character Training Compared

TET2d Avatar Image created with Dzine.

Regular readers of Animation and Video Life will be familiar with my alter ego, 2D avatar character, TET, who is both the face of The Lazy Animator Cartoon Animator Tutorials, and is currently part of my Resident Dragon joke cartoon series.

It is my goal to use him as an animated avatar for both my Lazy Animator video courses and my Cartoon Animator tutorials that you'll find on my @AnimLife YouTube channel.

Unfortunately I don't have the time to animate him for every single project. Even with Cartoon Animator's time-saving workflow I wouldn't be able to produce animated content quick enough. Which is why advances in AI animation is something that is increasingly more interesting to me each day.

Consistent Characters

Before we get there I have to overcome one of the biggest hurdles in AI I've come across... reproducing my art style consistently. I don't want an approximation of my characters, I want my characters looking the way I might draw them.

To that end I'm trialing two paid, all in one, AI design sites, OpenArt and Dzine. Both are said to have the best character consistency training models right now. Both work in a similar way. Upload four or more images of your character. The AI will study these, and from then on you'll be able to prompt for your character just by including their name in prompts.

Collage of TET Avatar images cropped from my Resident Dragon Joke Cartoons.
Note that these have been cropped for space. Images where you can see more of TET's
suit were originally full body images submitted for the AI Training.

OpenArt Character Output

To find out how well the training went I entered a simple prompt. Note that I named my avatar 'TET2d', and the prompt was, "@TET2d standing in a relaxed pose on a neutral gray background.".

Two initial generations of TET2d from
OpenArt using my simple prompt.

With OpenArt, they say the first image is crucial. As can be seen from my first two generations the character's head is a near copy of my first data set image. This appears to be very true as every generation featured TET without his signature glasses unless I specifically prompted for them.

For some reason OpenArt thinks my character has a short body, which isn't correct.

Dzine Character Output

Two initial generations of my TET2d avatar
from Dzine using the same prompt. Much
closer to mine, and it's good to see neither
generation is just a direct copy of the first image.

In general, Dzine did a much better job with training. Trained on the same images and using the same simple prompt, my avatar, though still with slightly incorrect proportions, looked pretty close, and I didn't even have to prompt for glasses.

Tweaking the Output for Accuracy

It's not uncommon with character consistency to tweak your prompt, even on a trained character, to get them that final way toward looking like your actual character art. If you find something that works then you keep that prompt and use it in every generation.

Try as I might, I could not get OpenArt's model to the correct proportions and, even if I directly stated I wanted my avatar to wear his circle glasses, they were not always included.

Dzine was not nearly so tricky. One minor tweak to the character description prompt (which remains with the character model) and I was good to go.

Top Row: OpenArt Images after tweaking the prompt to try and get proportions correct.
These were the best three from many attempts. Bottom Row: Dzine images with the
character model description very slightly tweaked for a larger head. Last image
demonstrates Dzine's hand correction tool.

TET2d Character reference
from Dzine used to generate
an image of TET2d at a
computer on OpenArt.

Initially I thought OpenArt was going to be my go-to tool for character consistency but Dzine seems to do a better job at matching my line art, without doing just a straight copy of the training images.

That said, I took one of my Dzine images to use as a reference on OpenArt, and produced an image of TET2d using his computer. Maybe there's a case for using both - I just don't know if I want two paid subscriptions?

o---o--- ---o--- o---

Did you find this article useful?
Subscribe to my newsletter and get the
latest articles delivered to your inbox.

Comments

Eight 2D Animation Apps For Your Phone or Tablet Mobile Device

M obile productivity apps have become so capable that they can be great alternatives to their PC/MAC equivalents or serve as great tools in their own right when you're away from your desk. While some apps simply mimic their desktop counterparts, others offer well thought out, touch-friendly interfaces that are easier and more fun to use. Every so often I check out what's available for 2D animation for Android devices, since that's what I use, that can complement my workflow with Reallusion's Cartoon Animator 5. Some may be available for Apple devices as well. Below I've listed six free (F) apps (with optional paid (P) upgrades) on the Google Play Store that you might want to explore. Some are just fun apps on their own while others may be useful as part of your workflow on bigger animation projects. Not all are exclusively animation apps and could be used on any production. JotterPad (F/P) The name JotterPad makes this sound like a notepad application but it's ...

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D...

The Ultimate Independent Animator's App and Resource List - Animation and Video Life

Image created with Cartoon Animator 4. Being an independent animator is not like a studio animation job. There's so much more to do that is indirectly related to the actual task of animating. Over the years I've sought out many apps, tools, and services that can help me achieve that one single task, expressing myself through animation. Below is my Ultimate Independent Animator's Resource List for 2024 (last updated Oct 2024). It started out as a list of free or low cost apps that could help you in every stage of producing either 2D or 3D animation, and then just kind of grew from there. You may not have been looking for a Time Management App as much as you needed something to get you started in 3D animation but when those commissioned projects start coming in you'll have a head start on maximizing your time. All the apps and services on this list had to meet two main criteria: They had to be useful and relevant to an Indy Animator/artist. The base app/se...

Create 2D Animated Characters with 3D Character Creator Tools and Artistic Filters

3D CC3 TET Character, based on my Oppa Doll Avatar, used as the base for a 2D CA4 character. One of my favorite things to do is to create characters with any type of Avatar/Character creator app. In fact the first test I usually try with these tools is, can I make an avatar of me (or at least my The Extraordinary Tourist persona). Previously I've used 2D character creators like Oppa Doll as a source of artwork for some characters I've made for Reallusion's Cartoon Animator 4 animation studio but 2D character creators are limited to... well 2D. 3D Character Creators While you may think 3D character creators have no place in creating characters for 2D animation there are quite a number of advantages including: No drawing skills required. Render characters in any style. Use an art filter or even hand trace into line art. Need to animate the character in a specific pose or angle? Render out an image of the character in the required angle and animate it in 2D. Quicker to crea...

Can a Solo Animator Make an Animated Feature Film or TV Series?

Series Creation Tip: If this is your first attempt at a series start small with two to four main characters and two or three sets that you can reuse each episode. My new series in development, Resident Dragon has four characters and is set in a suburban home. Recently I was asked if a solo animator could make a feature film? The short answer is 'YES'. Logically, with enough time, you can achieve anything. The very next question I was asked is how long do I think it would take and could it be done within a year? My initial answer was, it depends on the skill of the creator, noting that a Disney feature film takes a minimum of (I'm only guesstimating here) three to five years, based on when a movie is announced to when it actually gets released, with thousands of people working on it. Which implies that a single person trying to do the same thing may take the best part of a lifetime to make just one animated feature film. However is this really the case? Let's be clear, ...

Jarrad Wright, The Big Lez Show - Who Would've thought Animating with MS Paint Could Take You So Far?

A friend of mine recommended I should check out The Big Lez Show after I mentioned to him I make animations for living. He said the show's creator, Australian animator, Jarrad Wright , just makes episodes from his home using MS Paint. Somewhat shamefully I hadn't heard of The Big Lez Show, but the fact that it was being made with MS Paint absolutely hooked me into checking out. If you've never heard or seen the show then you, like I was, are probably thinking how good could it be? MS Paint has kind of a cult following of hardcore animators but no one would use it as their primary animation tool on a series, right? WARNING - before going any further, you need to know The Big Lez Show and its humor contains some pretty strong language. By strong I mean it's peppered very liberally with the 'F' and 'C' words and is very every day Aussie, blue collar speak. Unapologetically, all of that, is part of why it's so good. There's a good chance you've...

Animation and Video Life

Search This Blog