Skip to main content

Is Your Next Design or Writing Partner an AI? A Look at Artificial Intelligence and the Creative Arts with DALL-E 2, Jasper, and Rytr

DALL·E + TET - "A photorealistic image of an intelligent, futuristic android robot sitting at a writing desk using a very old typewriter"
DALL·E + TET - "A photorealistic image of
an intelligent, futuristic android robot sitting
at a writing desk using a very old typewriter
in an old fashioned office study that is
illuminated by candle light."

Where do you get your ideas from? Chances are you didn't ask a computer but, with advances in Artificial Intelligence (AI), your next writing or design partner could well be a machine.

Originally this article was going to just be about writing AI's. But then I finally got access to DALL-E 2, after a month or so wait, and it was the perfect opportunity to generate an image of a robot writing a script (see the feature image and caption at the top of this article. Completely AI generated image based on my prompt).

If you're not familiar with these 'creative' AIs they don't sit around waiting for inspiration to hit - which would raise questions of are AI's alive? 

Generally they're complex algorithms that can interpret natural text (i.e. text written by a human for other humans) into an image or an extended block of writing. Without a prompt these AI's don't do anything. With prompts they get better at interpreting text over time. i.e. they learn.

Image AIs - DALL-E 2

DALL-E 2 is one of the most well known image generating AIs. Not only can it generate high quality images from text, it can also be used to edit and enhance existing images. At the time of writing, to access it you needed to sign up for the waitlist. Once you have access they give you 50 free credits. One credit equals one generation of four images. You can purchase extra credit or wait for 15 free credits every month.

DALL-E 2 has some restrictions on what images you can upload (currently nothing with a recognizable human face for example) and it generally won't work if you ask it to produce images of well known people.

In terms of replacing artists these AI's are not there yet. For example, one of the things I would like to try with DALL-E 2 is to create all the art for an animated short. To do that I need character models. For Cartoon Animator I can rig an entire front facing character from a single character image standing in an 'A' pose.

Four generations of trying to get my Android character suggestion to fit fully inside the image frame. Only one was close and it wasn't the best looking one in my opinion.
Four generations of trying to get my character suggestion to
fit fully inside the image frame. Only one was close and it
wasn't the best looking one in my opinion.

To see if DALL-E 2 was up to the task I entered the initial prompt: A Futuristic Android Robot in the style of a Tesla. Full body, front facing view, standing in an 'A' pose (see image). While the initial character designs were great, each image had the head and feet cropped out.

I thought maybe DALL-E 2 was thinking 'Full body' meant I literally wanted just the body. I modified my phrase to specifically include the head and feet. I got one image that was almost there, and it wasn't particularly the best looking of all the generations.

While I could probably just take my favorite torso from these generations and then ask DALL-E to produce the head and feet in separate images that I can add in, the other problem is, DALL-E can't give me a set of turnaround images for this character. I can't even ask it to give me an image of the same robot but in side view (or even the same robot doing anything else). The AI has no concept of how to manipulate elements within an image so they remain the same but from a different angle.

If you just need single stand alone images to illustrate an article, DALL-E 2 is great for that.

Where its strength really lies is being able to visualize an idea in seconds. Which makes for a potentially powerful design partner.

I could take any of these Android designs, or combine the best features into an amalgamated final design. A real head start on designing an Android from scratch.

CrAIyon delivers lower res but no less interesting images - and has fewer limitations compared to DALL-E2.
CrAIyon delivers lower res but no less
interesting images - and has fewer
limitations compared to DALL-E2.
If you're interested in seeing DALL-E 2 pitted against a real graphic designer tech guru Marques Brownlee posted the video, Can AI Replace Our Graphic Designer? to his behind the scenes channel, The Studio. It's a very laid back video but worth it for the comparisons.

If you'd like to try an image AI for yourself but don't want to wait to be approved for DALL-E 2 then the website Replicate.com has a number of different image AI's you can play around with for free right now. You could also try CrAIyon (formerly known as DALL-E mini). It's images are low res. Try upscaling the best outputs with Replicates Image Restorer.

Writing AIs - Jasper & Rytr

Writing AIs are actually more established in their use and I would not be surprised if they're how much of the copy is generated for those bland click bait websites that exist solely to keep you clicking 'Next' while being bombarded by the surrounding ads.

They work in a similar way to image AIs in that you provide a text prompt of what you want the AI to write about, and the AI does the rest. However you do get a few more parameters like the type of article, the tone, style, etc.

You may be asking, why would anyone creative want to use a bland copy producing writing AI? As it turns out, they can also write creative, fictional stories.

I tried two of the best, Jasper and Rytr, both of which you can trial for free (note: links to both of these sites are my affiliate links). Jasper gives you a five day free trial and 10,000 words, while Ryter is free forever but you only get 5000 characters per month (and I burned through mine in ten minutes). Fortunately the lowest paid plan is only US$9.00 per month so if you do find it useful it's not too expensive to upgrade. Jasper's lowest plan starts at US$29.00 per month.

If you're interested in reading a blog post I generated with Jasper visit my TET.Life blog and read the article Checking in on Tesla's Optimus Robot - Managing Expectations where I include the full text of an article written by Jasper based on my text prompt. However in this article I'm going to compare outputs of Jasper and Rytr's story telling abilities.

I'm only going to compare one input with each, otherwise you'll be doing a lot of reading despite these stories each only being a couple of paragraphs long.

My Text Input for Both AIs

Without naming my superhero character, Bat Storm, I basically gave each AI the premise of what he is about. This is my text prompt:

A superhero having a bad day trying to fight crime but getting distracted with everyday life problems and his daughter.
DALL-E's interpretations of my text prompt with 'in a comic book style' added to steer it away from photographic images.
DALL-E's interpretations of my text prompt with 'in a comic book style' added
to steer it away from photographic images.

Jasper's Second Story

This was Jasper's second story based on my prompt. The first story read like a fan fiction for Superman with all the names; Clark Kent, Lois Lane, Daily Planet, and all the tropes; 'Cat stuck in a tree', 'lost child' etc. The only original idea was Clark now had a daughter struggling with her math homework.

The superhero had a bad day. Everything that could go wrong, did go wrong. He was running late for his fight against crime, and kept getting sidetracked by everyday life problems. His daughter was being particularly stubborn and wouldn't stop asking for his attention.

By the time he finally made it to the crime scene, he was exhausted and out of breath. The supervillain was already there, waiting for him. They fought fiercely, but in the end the superhero lost. This wasn't how it was supposed to go at all.

All in all, I didn't think this was a bad effort. There is the bare bones of a complete story that you could certainly take inspiration from or expand upon. 

Rytr's Turn

Interestingly Rytr also went straight to the IP infringement with a story about Spider-man on its first attempt so this is Rytr's second story as well.

A man, who is a superhero by night, wakes up from a dream where he's saving George Clooney from a burning building. He goes to the balcony of his apartment and sees the city in an alarming state with all sorts of bad guys going about their own business. He tries to fly to fight crime but his daughter is going to school and asks him to drive her there first. When he drops off his daughter, he has nothing in the tank for fighting crime and gets into an argument with his wife about coming home late last night, who then reminds him that they have no food in the fridge.

He goes to the store on the way back home and sees two guys fighting over a parking spot so he punches one in the face, knocking him out. The fight causes the entire store to go into chaos right outside of his wife's favorite grocery store, so he runs inside and buys everything she needs, which includes wine because it's been a long week.

You have to admit Rytr definitely packed a lot into this, raising a bunch of questions along the way, starting with does he dream about saving George Clooney often? I particularly like that he buys wine for his wife at the end because it's not just him having a bad day, she's had a long week!

Are They Your Next Writing Partner?

Honestly, these are just my very first experimentations with writing AIs. How good the output is really depends on how descriptive your text prompts are. I tried much longer and more detailed prompts with Jasper (Rytr has 200 character limit) and got more detailed, though not necessarily longer, stories that were a little more structured. With superhero stories both had a tendency to name drop existing IP characters.

I don't think they'll be replacing actual human storytellers any time soon but if I was having a hard time coming up with an idea for an animated short, I could see myself entering a half baked idea just to see what the AI would come up with.

That aside, writing AIs are capable of writing in so many different scenarios from sales copy to email, blog posts and more. You could really save quite a bit of time using AI to write your first draft, then add your own voice, edits and original words for the final draft.

The Bottom Line

I've heard so many people say that AIs are finally going to take the jobs of creative people and that may well be true in the short term. However, if you are a creative person, embracing these AIs as a tool in your workflow may well be your best bet to stay competitive.

The one thing an AI can't be is you. While they can make images and tell stories they're never going to have your unique viewpoint or perspective.

What they can do is burn through ideas as part of a brainstorm session really quickly. Imagine you take your ten best ideas for a project and put them into an AI. Within minutes or even seconds you can see possibilities for how a concept might further be developed, or just doesn't work.

You can then do, what these AI's really can't do very well, take one idea and explore it further, filtering out what works and what doesn't. Some of that exploration might even be feeding more ideas back into an AI. Regardless it still takes a human to really take the output of current AI's to the next level.

Maybe one day an AI will be advanced enough to properly co-ordinate a collection of ideas but for the moment they're really only having fleeting 'thoughts' and aren't advanced enough to assemble their best thoughts into more meaningful ideas.


Comments

Popular posts from this blog

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D  which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D

Moho 14 Released - Still the Best 2D Animation Software for Indy Animators on a Budget

Moho 14 Released. Regular readers know I am a Reallusion, Cartoon Animator advocate through and through. Hands down I would recommend Cartoon Animator 5 first over Lost Marble's Moho 14 to anyone who is just starting in 2D animation, is a team of one, or just needs to animate as quickly as possible. However, feature for feature, Moho is, arguably, the best 2D animation software for the rest of us who can't justify a Toon Boom Harmony , or Adobe Creative Cloud subscription (and even with their applications Moho is very competitive on features). You can get started with Moho Debut for just USD$59.99 which is a cut down version of Moho Pro but it still has the most essential features needed for 2D animation. While Moho Pro is a whopping USD$399.99 (Cartoon Animator, which only has one version, is just USD$149.00) upgrades to new version numbers come down to a quarter of the price at USD$99.00. Even though Reallusion just released features like Motion Pilot Puppet Animation and

Start Your 2D Animation Side Hustle - Sell Your Cartoon Animator Characters, Props, Scenes, and Motion Files in the Reallusion 2D/3D Marketplace

Have you thought about starting a side hustle selling your original Cartoon Animator assets in the Reallusion 2D/3D Marketplace ? In this article, the first in a series on selling in the marketplace, I'll give you an overview of what's involved, why you should give it some thought, and whether you can earn enough to quit your day job (or at least have a worthwhile side hustle). If you're an artist with any kind of drawing skills, and you're creating your own original characters, props, scenes, and even motion files for your Cartoon Animator projects, then setting up your own store in the Reallusion Marketplace should be a no brainer. You're making content already, it doesn't cost you anything to set up, and Reallusion only takes a 30% commission from each item sold. (If you think that's a lot, I'll address that further down). Don't be put off if you think your art skills aren't up to professional standards. There are plenty of artists with naïve

Wonder Unit Storyboarder - Free Storyboarding Software for People Who Can (or Can't) Draw

Wonder Unit Storyboarder.  As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder  is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu

Can You Learn Reallusion's Cartoon Animator 5 for Free Using Their 137 Official YouTube Video Tutorials Sorted Into a Logical Learning Order?

Or you could just buy The Lazy Animator Beginner's Guide to Cartoon Animator . While Reallusion's Cartoon Animator is one of the easiest 2D animation studios to get up and running with quickly, learning it from all of the official, free, video tutorials can be more overwhelming than helpful. With more than 137 videos totaling more than 28 and a half hours of tutorials, spread across three generations of the software (Cartoon Animator 3 through 5) it's hard to know if what you're learning is a current or legacy feature that you either need to know or can be skipped. Many of the official tutorials only teach specific features of the software and don't relate at all to previous or later tutorials. As a result there are many features either not mentioned or are hard to find. To make your learning easier, on this page, I've collected together all of the essential, official, free video tutorials and sorted them into a learning order that makes sense. Simply start at

2D Animation Side Hustle - How to Find a Niche Market Selling Digital Characters, Props, and Background Art in the Reallusion 2D Marketplace

C ontinuing my series on your 2D Animation Side Hustle, Selling in the Reallusion 2D Marketplace , in this article I'm going to take a look at niches and why they're important to becoming a successful seller. I'll also look at some indicators, specific to the Reallusion Marketplace, that can help point you in the right direction of finding niches that are in demand. What is a Niche and Why Are They Important? In marketing terms a niche is kind of like a sub category or a section of a subject that you want to focus on. It's not the big idea with wide appeal that everybody loves, it's a smaller, more specific section of the idea that fewer people really connect with. For example, in the Reallusion 2D Marketplace, Characters are the biggest sellers. Everybody loves and wants to buy characters. They're great! That's all you need to know, characters sell the best, go make some! There are currently 4413 characters for sale in the marketplace. How will people find

Artbreeder - Using AI created Character and Background Content in your Animations

A selection of User/AI generated images from Artbreeder. If you're looking for an endless supply of 2D character and background images for your animations then Artbreeder , an online Artificial Intelligence (AI) that generates image mash-ups you can tweak as much as you like, could be the ultimate content library. What is Artbreeder? Artbreeder is free to use though there are various paid plans, that give you additional features, such as higher resolution download images or more settings to play with. All images created on the site are Public Domain (CC0 License) and can be used in commercial projects. Using Artbreeder's online app you can generate head shot portraits, full body characters, landscapes, and other scenes simply by choosing two or more existing images to mash together then, using a series of sliders, to select which traits from each image you wish to lean toward in the final image. Photo Comparison - Top is my original uploaded photo. Bottom is Artbreeder's ap