Skip to main content

Is Your Next Design or Writing Partner an AI? A Look at Artificial Intelligence and the Creative Arts with DALL-E 2, Jasper, and Rytr

DALL·E + TET - "A photorealistic image of an intelligent, futuristic android robot sitting at a writing desk using a very old typewriter"
DALL·E + TET - "A photorealistic image of
an intelligent, futuristic android robot sitting
at a writing desk using a very old typewriter
in an old fashioned office study that is
illuminated by candle light."

Where do you get your ideas from? Chances are you didn't ask a computer but, with advances in Artificial Intelligence (AI), your next writing or design partner could well be a machine.

Originally this article was going to just be about writing AI's. But then I finally got access to DALL-E 2, after a month or so wait, and it was the perfect opportunity to generate an image of a robot writing a script (see the feature image and caption at the top of this article. Completely AI generated image based on my prompt).

If you're not familiar with these 'creative' AIs they don't sit around waiting for inspiration to hit - which would raise questions of are AI's alive? 

Generally they're complex algorithms that can interpret natural text (i.e. text written by a human for other humans) into an image or an extended block of writing. Without a prompt these AI's don't do anything. With prompts they get better at interpreting text over time. i.e. they learn.

Image AIs - DALL-E 2

DALL-E 2 is one of the most well known image generating AIs. Not only can it generate high quality images from text, it can also be used to edit and enhance existing images. At the time of writing, to access it you needed to sign up for the waitlist. Once you have access they give you 50 free credits. One credit equals one generation of four images. You can purchase extra credit or wait for 15 free credits every month.

DALL-E 2 has some restrictions on what images you can upload (currently nothing with a recognizable human face for example) and it generally won't work if you ask it to produce images of well known people.

In terms of replacing artists these AI's are not there yet. For example, one of the things I would like to try with DALL-E 2 is to create all the art for an animated short. To do that I need character models. For Cartoon Animator I can rig an entire front facing character from a single character image standing in an 'A' pose.

Four generations of trying to get my Android character suggestion to fit fully inside the image frame. Only one was close and it wasn't the best looking one in my opinion.
Four generations of trying to get my character suggestion to
fit fully inside the image frame. Only one was close and it
wasn't the best looking one in my opinion.

To see if DALL-E 2 was up to the task I entered the initial prompt: A Futuristic Android Robot in the style of a Tesla. Full body, front facing view, standing in an 'A' pose (see image). While the initial character designs were great, each image had the head and feet cropped out.

I thought maybe DALL-E 2 was thinking 'Full body' meant I literally wanted just the body. I modified my phrase to specifically include the head and feet. I got one image that was almost there, and it wasn't particularly the best looking of all the generations.

While I could probably just take my favorite torso from these generations and then ask DALL-E to produce the head and feet in separate images that I can add in, the other problem is, DALL-E can't give me a set of turnaround images for this character. I can't even ask it to give me an image of the same robot but in side view (or even the same robot doing anything else). The AI has no concept of how to manipulate elements within an image so they remain the same but from a different angle.

If you just need single stand alone images to illustrate an article, DALL-E 2 is great for that.

Where its strength really lies is being able to visualize an idea in seconds. Which makes for a potentially powerful design partner.

I could take any of these Android designs, or combine the best features into an amalgamated final design. A real head start on designing an Android from scratch.

CrAIyon delivers lower res but no less interesting images - and has fewer limitations compared to DALL-E2.
CrAIyon delivers lower res but no less
interesting images - and has fewer
limitations compared to DALL-E2.
If you're interested in seeing DALL-E 2 pitted against a real graphic designer tech guru Marques Brownlee posted the video, Can AI Replace Our Graphic Designer? to his behind the scenes channel, The Studio. It's a very laid back video but worth it for the comparisons.

If you'd like to try an image AI for yourself but don't want to wait to be approved for DALL-E 2 then the website Replicate.com has a number of different image AI's you can play around with for free right now. You could also try CrAIyon (formerly known as DALL-E mini). It's images are low res. Try upscaling the best outputs with Replicates Image Restorer.

Writing AIs - Jasper & Rytr

Writing AIs are actually more established in their use and I would not be surprised if they're how much of the copy is generated for those bland click bait websites that exist solely to keep you clicking 'Next' while being bombarded by the surrounding ads.

They work in a similar way to image AIs in that you provide a text prompt of what you want the AI to write about, and the AI does the rest. However you do get a few more parameters like the type of article, the tone, style, etc.

You may be asking, why would anyone creative want to use a bland copy producing writing AI? As it turns out, they can also write creative, fictional stories.

I tried two of the best, Jasper and Rytr, both of which you can trial for free (note: links to both of these sites are my affiliate links). Jasper gives you a five day free trial and 10,000 words, while Ryter is free forever but you only get 5000 characters per month (and I burned through mine in ten minutes). Fortunately the lowest paid plan is only US$9.00 per month so if you do find it useful it's not too expensive to upgrade. Jasper's lowest plan starts at US$29.00 per month.

If you're interested in reading a blog post I generated with Jasper visit my TET.Life blog and read the article Checking in on Tesla's Optimus Robot - Managing Expectations where I include the full text of an article written by Jasper based on my text prompt. However in this article I'm going to compare outputs of Jasper and Rytr's story telling abilities.

I'm only going to compare one input with each, otherwise you'll be doing a lot of reading despite these stories each only being a couple of paragraphs long.

My Text Input for Both AIs

Without naming my superhero character, Bat Storm, I basically gave each AI the premise of what he is about. This is my text prompt:

A superhero having a bad day trying to fight crime but getting distracted with everyday life problems and his daughter.
DALL-E's interpretations of my text prompt with 'in a comic book style' added to steer it away from photographic images.
DALL-E's interpretations of my text prompt with 'in a comic book style' added
to steer it away from photographic images.

Jasper's Second Story

This was Jasper's second story based on my prompt. The first story read like a fan fiction for Superman with all the names; Clark Kent, Lois Lane, Daily Planet, and all the tropes; 'Cat stuck in a tree', 'lost child' etc. The only original idea was Clark now had a daughter struggling with her math homework.

The superhero had a bad day. Everything that could go wrong, did go wrong. He was running late for his fight against crime, and kept getting sidetracked by everyday life problems. His daughter was being particularly stubborn and wouldn't stop asking for his attention.

By the time he finally made it to the crime scene, he was exhausted and out of breath. The supervillain was already there, waiting for him. They fought fiercely, but in the end the superhero lost. This wasn't how it was supposed to go at all.

All in all, I didn't think this was a bad effort. There is the bare bones of a complete story that you could certainly take inspiration from or expand upon. 

Rytr's Turn

Interestingly Rytr also went straight to the IP infringement with a story about Spider-man on its first attempt so this is Rytr's second story as well.

A man, who is a superhero by night, wakes up from a dream where he's saving George Clooney from a burning building. He goes to the balcony of his apartment and sees the city in an alarming state with all sorts of bad guys going about their own business. He tries to fly to fight crime but his daughter is going to school and asks him to drive her there first. When he drops off his daughter, he has nothing in the tank for fighting crime and gets into an argument with his wife about coming home late last night, who then reminds him that they have no food in the fridge.

He goes to the store on the way back home and sees two guys fighting over a parking spot so he punches one in the face, knocking him out. The fight causes the entire store to go into chaos right outside of his wife's favorite grocery store, so he runs inside and buys everything she needs, which includes wine because it's been a long week.

You have to admit Rytr definitely packed a lot into this, raising a bunch of questions along the way, starting with does he dream about saving George Clooney often? I particularly like that he buys wine for his wife at the end because it's not just him having a bad day, she's had a long week!

Are They Your Next Writing Partner?

Honestly, these are just my very first experimentations with writing AIs. How good the output is really depends on how descriptive your text prompts are. I tried much longer and more detailed prompts with Jasper (Rytr has 200 character limit) and got more detailed, though not necessarily longer, stories that were a little more structured. With superhero stories both had a tendency to name drop existing IP characters.

I don't think they'll be replacing actual human storytellers any time soon but if I was having a hard time coming up with an idea for an animated short, I could see myself entering a half baked idea just to see what the AI would come up with.

That aside, writing AIs are capable of writing in so many different scenarios from sales copy to email, blog posts and more. You could really save quite a bit of time using AI to write your first draft, then add your own voice, edits and original words for the final draft.

The Bottom Line

I've heard so many people say that AIs are finally going to take the jobs of creative people and that may well be true in the short term. However, if you are a creative person, embracing these AIs as a tool in your workflow may well be your best bet to stay competitive.

The one thing an AI can't be is you. While they can make images and tell stories they're never going to have your unique viewpoint or perspective.

What they can do is burn through ideas as part of a brainstorm session really quickly. Imagine you take your ten best ideas for a project and put them into an AI. Within minutes or even seconds you can see possibilities for how a concept might further be developed, or just doesn't work.

You can then do, what these AI's really can't do very well, take one idea and explore it further, filtering out what works and what doesn't. Some of that exploration might even be feeding more ideas back into an AI. Regardless it still takes a human to really take the output of current AI's to the next level.

Maybe one day an AI will be advanced enough to properly co-ordinate a collection of ideas but for the moment they're really only having fleeting 'thoughts' and aren't advanced enough to assemble their best thoughts into more meaningful ideas.


Comments

Popular posts from this blog

Pricing Animation Services - USD$10,000 Per Minute Might Not Be Enough For an Industry That's Collapsing... Wait, What?

T his post was inspired by an Amateur Animators Facebook Group , public conversation between two professional animators working at entirely different places in their careers but both with at least a decade plus of experience.  Indy Animator Versus Studio Animator The conversation  centered around an original post by an amateur animator asking if USD$115 payment for a four to five minute, frame by frame animation, was a good deal? Anyone who has done even one second of frame by frame animation should at least have some concept of how long it would take to make four to five minutes and know that $115 is definitely not a good deal for most people. However, professional animator one, who I would describe as an independent animator, running a successful content and training business, while not suggesting the deal was good, made the point that there are many factors that go into pricing and that ultimately it is for the individual to set their prices based on what they're happy to work

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D  which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D

Wonder Unit Storyboarder - Free Storyboarding Software for People Who Can (or Can't) Draw

Wonder Unit Storyboarder.  As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder  is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu

Dollars Mocap: Full Body Webcam Motion Capture (Including Hands and Fingers) For iClone and Cartoon Animator

Even though I should be further away from the camera Dollars Mocap MONO still does a good job of  tracking my arms, hands and fingers. Ever since I wrote my series on becoming a VTuber , discovering it was possible to do full body motion capture, including hands and fingers, with just software and a webcam, I've been on the look out for any motion capture software that can bring that functionality to Cartoon Animator. Dollars Mocap is a low cost motion capture application with a free trial that I learned about through the YouTube Channel Digital Puppets  and their test video . It can record full body, upper body, arms and hands, and facial mocap from a live video source or pre-recorded video. Investigating further, I discovered not only does Dollars Mocap have a free iClone7, iClone8 character profile file download (look for it at the bottom of the main program download page), so you can use the saved motions with iClone8, they've also got a demo video for how to convert your

Six Lip Sync Animation Tips for Cartoon Animator (That Really Apply to Any Auto Lip Syncing Application)

A nimating a character's mouth talking in any form of animation is one of the more time consuming jobs of character animation. Particularly if your project is dialogue heavy or your character has the urge to sing. Fortunately auto lip syncing in many animation software studios is becoming more common and is helping to speed up the lip syncing process. Reallusion's Cartoon Animator is no exception with a fairly good auto lip sync feature. I made a tutorial video demonstrating how to auto and manual lip sync in Cartoon Animator here . However auto lip sync is not perfect (yet) so you'll definitely find yourself manually lip syncing a character at some point. Or maybe you just prefer to manually lip sync yourself because you like that level of control. Whatever the reason here are Six tips to help improve your lip sync and to stop you getting bogged down into really small details that literally do not matter for the amount of screen time they'll get. 1. Auto Lip Sync is NO

The Ultimate Independent Animator's App and Resource List 2019-2023 - Animation and Video Life

Image created with Cartoon Animator 4. Being an independent animator is not like a studio animation job. There's so much more to do that is indirectly related to the actual task of animating. Over the years I've sought out many apps, tools, and services that can help me achieve that one single task, expressing myself through animation. Below is my Ultimate Independent Animator's Resource List for 2019-2022. It started out as a list of free or low cost apps that could help you in every stage of producing either 2D or 3D animation, and then just kind of grew from there. You may not have been looking for a Time Management App as much as you needed something to get you started in 3D animation but when those commissioned projects start coming in you'll have a head start on maximizing your time. All the apps and services on this list had to meet two main criteria: They had to be useful and relevant to an Indy Animator/artist. The base app/service had to be US$

Moho 14 Released - Still the Best 2D Animation Software for Indy Animators on a Budget

Moho 14 Released. Regular readers know I am a Reallusion, Cartoon Animator advocate through and through. Hands down I would recommend Cartoon Animator 5 first over Lost Marble's Moho 14 to anyone who is just starting in 2D animation, is a team of one, or just needs to animate as quickly as possible. However, feature for feature, Moho is, arguably, the best 2D animation software for the rest of us who can't justify a Toon Boom Harmony , or Adobe Creative Cloud subscription (and even with their applications Moho is very competitive on features). You can get started with Moho Debut for just USD$59.99 which is a cut down version of Moho Pro but it still has the most essential features needed for 2D animation. While Moho Pro is a whopping USD$399.99 (Cartoon Animator, which only has one version, is just USD$149.00) upgrades to new version numbers come down to a quarter of the price at USD$99.00. Even though Reallusion just released features like Motion Pilot Puppet Animation and