Skip to main content

Is Your Next Design or Writing Partner an AI? A Look at Artificial Intelligence and the Creative Arts with DALL-E 2, Jasper, and Rytr

DALL·E + TET - "A photorealistic image of an intelligent, futuristic android robot sitting at a writing desk using a very old typewriter"
DALL·E + TET - "A photorealistic image of
an intelligent, futuristic android robot sitting
at a writing desk using a very old typewriter
in an old fashioned office study that is
illuminated by candle light."

Where do you get your ideas from? Chances are you didn't ask a computer but, with advances in Artificial Intelligence (AI), your next writing or design partner could well be a machine.

Originally this article was going to just be about writing AI's. But then I finally got access to DALL-E 2, after a month or so wait, and it was the perfect opportunity to generate an image of a robot writing a script (see the feature image and caption at the top of this article. Completely AI generated image based on my prompt).

If you're not familiar with these 'creative' AIs they don't sit around waiting for inspiration to hit - which would raise questions of are AI's alive? 

Generally they're complex algorithms that can interpret natural text (i.e. text written by a human for other humans) into an image or an extended block of writing. Without a prompt these AI's don't do anything. With prompts they get better at interpreting text over time. i.e. they learn.

Image AIs - DALL-E 2

DALL-E 2 is one of the most well known image generating AIs. Not only can it generate high quality images from text, it can also be used to edit and enhance existing images. At the time of writing, to access it you needed to sign up for the waitlist. Once you have access they give you 50 free credits. One credit equals one generation of four images. You can purchase extra credit or wait for 15 free credits every month.

DALL-E 2 has some restrictions on what images you can upload (currently nothing with a recognizable human face for example) and it generally won't work if you ask it to produce images of well known people.

In terms of replacing artists these AI's are not there yet. For example, one of the things I would like to try with DALL-E 2 is to create all the art for an animated short. To do that I need character models. For Cartoon Animator I can rig an entire front facing character from a single character image standing in an 'A' pose.

Four generations of trying to get my Android character suggestion to fit fully inside the image frame. Only one was close and it wasn't the best looking one in my opinion.
Four generations of trying to get my character suggestion to
fit fully inside the image frame. Only one was close and it
wasn't the best looking one in my opinion.

To see if DALL-E 2 was up to the task I entered the initial prompt: A Futuristic Android Robot in the style of a Tesla. Full body, front facing view, standing in an 'A' pose (see image). While the initial character designs were great, each image had the head and feet cropped out.

I thought maybe DALL-E 2 was thinking 'Full body' meant I literally wanted just the body. I modified my phrase to specifically include the head and feet. I got one image that was almost there, and it wasn't particularly the best looking of all the generations.

While I could probably just take my favorite torso from these generations and then ask DALL-E to produce the head and feet in separate images that I can add in, the other problem is, DALL-E can't give me a set of turnaround images for this character. I can't even ask it to give me an image of the same robot but in side view (or even the same robot doing anything else). The AI has no concept of how to manipulate elements within an image so they remain the same but from a different angle.

If you just need single stand alone images to illustrate an article, DALL-E 2 is great for that.

Where its strength really lies is being able to visualize an idea in seconds. Which makes for a potentially powerful design partner.

I could take any of these Android designs, or combine the best features into an amalgamated final design. A real head start on designing an Android from scratch.

CrAIyon delivers lower res but no less interesting images - and has fewer limitations compared to DALL-E2.
CrAIyon delivers lower res but no less
interesting images - and has fewer
limitations compared to DALL-E2.
If you're interested in seeing DALL-E 2 pitted against a real graphic designer tech guru Marques Brownlee posted the video, Can AI Replace Our Graphic Designer? to his behind the scenes channel, The Studio. It's a very laid back video but worth it for the comparisons.

If you'd like to try an image AI for yourself but don't want to wait to be approved for DALL-E 2 then the website Replicate.com has a number of different image AI's you can play around with for free right now. You could also try CrAIyon (formerly known as DALL-E mini). It's images are low res. Try upscaling the best outputs with Replicates Image Restorer.

Writing AIs - Jasper & Rytr

Writing AIs are actually more established in their use and I would not be surprised if they're how much of the copy is generated for those bland click bait websites that exist solely to keep you clicking 'Next' while being bombarded by the surrounding ads.

They work in a similar way to image AIs in that you provide a text prompt of what you want the AI to write about, and the AI does the rest. However you do get a few more parameters like the type of article, the tone, style, etc.

You may be asking, why would anyone creative want to use a bland copy producing writing AI? As it turns out, they can also write creative, fictional stories.

I tried two of the best, Jasper and Rytr, both of which you can trial for free (note: links to both of these sites are my affiliate links). Jasper gives you a five day free trial and 10,000 words, while Ryter is free forever but you only get 5000 characters per month (and I burned through mine in ten minutes). Fortunately the lowest paid plan is only US$9.00 per month so if you do find it useful it's not too expensive to upgrade. Jasper's lowest plan starts at US$29.00 per month.

If you're interested in reading a blog post I generated with Jasper visit my TET.Life blog and read the article Checking in on Tesla's Optimus Robot - Managing Expectations where I include the full text of an article written by Jasper based on my text prompt. However in this article I'm going to compare outputs of Jasper and Rytr's story telling abilities.

I'm only going to compare one input with each, otherwise you'll be doing a lot of reading despite these stories each only being a couple of paragraphs long.

My Text Input for Both AIs

Without naming my superhero character, Bat Storm, I basically gave each AI the premise of what he is about. This is my text prompt:

A superhero having a bad day trying to fight crime but getting distracted with everyday life problems and his daughter.
DALL-E's interpretations of my text prompt with 'in a comic book style' added to steer it away from photographic images.
DALL-E's interpretations of my text prompt with 'in a comic book style' added
to steer it away from photographic images.

Jasper's Second Story

This was Jasper's second story based on my prompt. The first story read like a fan fiction for Superman with all the names; Clark Kent, Lois Lane, Daily Planet, and all the tropes; 'Cat stuck in a tree', 'lost child' etc. The only original idea was Clark now had a daughter struggling with her math homework.

The superhero had a bad day. Everything that could go wrong, did go wrong. He was running late for his fight against crime, and kept getting sidetracked by everyday life problems. His daughter was being particularly stubborn and wouldn't stop asking for his attention.

By the time he finally made it to the crime scene, he was exhausted and out of breath. The supervillain was already there, waiting for him. They fought fiercely, but in the end the superhero lost. This wasn't how it was supposed to go at all.

All in all, I didn't think this was a bad effort. There is the bare bones of a complete story that you could certainly take inspiration from or expand upon. 

Rytr's Turn

Interestingly Rytr also went straight to the IP infringement with a story about Spider-man on its first attempt so this is Rytr's second story as well.

A man, who is a superhero by night, wakes up from a dream where he's saving George Clooney from a burning building. He goes to the balcony of his apartment and sees the city in an alarming state with all sorts of bad guys going about their own business. He tries to fly to fight crime but his daughter is going to school and asks him to drive her there first. When he drops off his daughter, he has nothing in the tank for fighting crime and gets into an argument with his wife about coming home late last night, who then reminds him that they have no food in the fridge.

He goes to the store on the way back home and sees two guys fighting over a parking spot so he punches one in the face, knocking him out. The fight causes the entire store to go into chaos right outside of his wife's favorite grocery store, so he runs inside and buys everything she needs, which includes wine because it's been a long week.

You have to admit Rytr definitely packed a lot into this, raising a bunch of questions along the way, starting with does he dream about saving George Clooney often? I particularly like that he buys wine for his wife at the end because it's not just him having a bad day, she's had a long week!

Are They Your Next Writing Partner?

Honestly, these are just my very first experimentations with writing AIs. How good the output is really depends on how descriptive your text prompts are. I tried much longer and more detailed prompts with Jasper (Rytr has 200 character limit) and got more detailed, though not necessarily longer, stories that were a little more structured. With superhero stories both had a tendency to name drop existing IP characters.

I don't think they'll be replacing actual human storytellers any time soon but if I was having a hard time coming up with an idea for an animated short, I could see myself entering a half baked idea just to see what the AI would come up with.

That aside, writing AIs are capable of writing in so many different scenarios from sales copy to email, blog posts and more. You could really save quite a bit of time using AI to write your first draft, then add your own voice, edits and original words for the final draft.

The Bottom Line

I've heard so many people say that AIs are finally going to take the jobs of creative people and that may well be true in the short term. However, if you are a creative person, embracing these AIs as a tool in your workflow may well be your best bet to stay competitive.

The one thing an AI can't be is you. While they can make images and tell stories they're never going to have your unique viewpoint or perspective.

What they can do is burn through ideas as part of a brainstorm session really quickly. Imagine you take your ten best ideas for a project and put them into an AI. Within minutes or even seconds you can see possibilities for how a concept might further be developed, or just doesn't work.

You can then do, what these AI's really can't do very well, take one idea and explore it further, filtering out what works and what doesn't. Some of that exploration might even be feeding more ideas back into an AI. Regardless it still takes a human to really take the output of current AI's to the next level.

Maybe one day an AI will be advanced enough to properly co-ordinate a collection of ideas but for the moment they're really only having fleeting 'thoughts' and aren't advanced enough to assemble their best thoughts into more meaningful ideas.


Comments

Popular posts from this blog

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D  which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D

Dollars Mocap: Full Body Webcam Motion Capture (Including Hands and Fingers) For iClone and Cartoon Animator

Even though I should be further away from the camera Dollars Mocap MONO still does a good job of  tracking my arms, hands and fingers. Ever since I wrote my series on becoming a VTuber , discovering it was possible to do full body motion capture, including hands and fingers, with just software and a webcam, I've been on the look out for any motion capture software that can bring that functionality to Cartoon Animator. Dollars Mocap is a low cost motion capture application with a free trial that I learned about through the YouTube Channel Digital Puppets  and their test video . It can record full body, upper body, arms and hands, and facial mocap from a live video source or pre-recorded video. Investigating further, I discovered not only does Dollars Mocap have a free iClone7, iClone8 character profile file download (look for it at the bottom of the main program download page), so you can use the saved motions with iClone8, they've also got a demo video for how to convert your

Prome AI Sketch Render Tool - Your Tradigital Clean Up and Colorist Artist for Character and Background Design

Random character head, Biro sketches drawn by TET (left). Render by PromeAI (right) using Prome's Sketch Render tool set to 'Comon:Cartoon, Render Mode: Outline'. W hile I don't do New Year Resolutions, one of my plans for the year ahead is to do more of my own art. Specifically character design drawn in an actual, physical sketchbook.  To that end, I have been spending the last half hour of most days drawing a page or two of random biro sketches in my sketchbook and posting the pages to my Instagram account  (this link will take you to one of my posts). These sketches are mostly practicing my skills because I don't really draw regularly anymore. Here is a tip, if you do this kind of sketching, and push yourself to keep doing it, you will see many drawings that could be taken further, even if you don't have anything they're suited for just at the moment. Which is where my second favorite AI Image Tool (after Leonardo.ai )  PromeAI comes into play. PromeAI

Moho 14 Released - Still the Best 2D Animation Software for Indy Animators on a Budget

Moho 14 Released. Regular readers know I am a Reallusion, Cartoon Animator advocate through and through. Hands down I would recommend Cartoon Animator 5 first over Lost Marble's Moho 14 to anyone who is just starting in 2D animation, is a team of one, or just needs to animate as quickly as possible. However, feature for feature, Moho is, arguably, the best 2D animation software for the rest of us who can't justify a Toon Boom Harmony , or Adobe Creative Cloud subscription (and even with their applications Moho is very competitive on features). You can get started with Moho Debut for just USD$59.99 which is a cut down version of Moho Pro but it still has the most essential features needed for 2D animation. While Moho Pro is a whopping USD$399.99 (Cartoon Animator, which only has one version, is just USD$149.00) upgrades to new version numbers come down to a quarter of the price at USD$99.00. Even though Reallusion just released features like Motion Pilot Puppet Animation and

Wonder Unit Storyboarder - Free Storyboarding Software for People Who Can (or Can't) Draw

Wonder Unit Storyboarder.  As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder  is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu

Start Your 2D Animation Side Hustle - Sell Your Cartoon Animator Characters, Props, Scenes, and Motion Files in the Reallusion 2D/3D Marketplace

Have you thought about starting a side hustle selling your original Cartoon Animator assets in the Reallusion 2D/3D Marketplace ? In this article, the first in a series on selling in the marketplace, I'll give you an overview of what's involved, why you should give it some thought, and whether you can earn enough to quit your day job (or at least have a worthwhile side hustle). If you're an artist with any kind of drawing skills, and you're creating your own original characters, props, scenes, and even motion files for your Cartoon Animator projects, then setting up your own store in the Reallusion Marketplace should be a no brainer. You're making content already, it doesn't cost you anything to set up, and Reallusion only takes a 30% commission from each item sold. (If you think that's a lot, I'll address that further down). Don't be put off if you think your art skills aren't up to professional standards. There are plenty of artists with naïve

The Ultimate Independent Animator's App and Resource List 2019-2023 - Animation and Video Life

Image created with Cartoon Animator 4. Being an independent animator is not like a studio animation job. There's so much more to do that is indirectly related to the actual task of animating. Over the years I've sought out many apps, tools, and services that can help me achieve that one single task, expressing myself through animation. Below is my Ultimate Independent Animator's Resource List for 2019-2022. It started out as a list of free or low cost apps that could help you in every stage of producing either 2D or 3D animation, and then just kind of grew from there. You may not have been looking for a Time Management App as much as you needed something to get you started in 3D animation but when those commissioned projects start coming in you'll have a head start on maximizing your time. All the apps and services on this list had to meet two main criteria: They had to be useful and relevant to an Indy Animator/artist. The base app/service had to be US$