Skip to main content

Chroma Keying Go Animate Characters to Video

I was laying in bed one night and I had this brainwave of chroma keying GoAnimate characters with live action video. I was sure it could be done but how effective would it be? Obviously there are many limitations with this idea but for the moment have a look at my very rough experimental video below and I'll get onto explanation after.



Firstly if you are not familiar with what Chroma Keying is then you may be more familiar with the concept of green screening in relation to movie special effects. The terms are almost interchangeable. Both record their subject against a single background colour, usually green, which is then keyed out and replaced with another video image.

In the case of my video above I created a GoAnimate Animation which animated GoAnimate's character, Kate, on a green background. See the animation below.

GoAnimate.com: Chroma key test by etourist

Like it? Create your own at GoAnimate.com. It's free and fun!

I then used CamStudio to screen capture the animation to an AVI video file (which I later had to convert to an MPG file due to compatibility problems with my editing software. Somewhere in this conversion the colours of the animation were corrupted hence the greenish tinge on Kate in the final video).

Finally I used video editing software that supports Chroma keying to combine my animation with the video footage of myself and the frog van I shot earlier.

I'm not pretending this animation is fantastic. It's just a very rough test that I put together in a couple of hours. Call it a proof of concept. This can be done.

It's nowhere near as good as Roger Rabbit and never will be since there's no scope for adding shadows and shading to GoAnimate's pre designed characters. However as an idea it opens up another possibility for GoAnimate's platform and those of us who like to go beyond the boundaries and not settle for just what we're given when we tell our stories.

I'm not sure if I'll expand on this idea into a fully finished animation. When I first thought of it, the idea of doing a Willie Nelson Music video with myself and GoAnimate's Willie Nelson theme had a lot of appeal (The Extraordinary Tourist staring in a Video of Willie Nelson's song On the Road Again perhaps?).

If you are a GoAnimate Animator and you can see the potential in using this technique then give it your all. I'd love to see someone try this who can do it much better than me. Please let me know if you do.

Comments

  1. Nicely done...even for a rough test. I worked in production for many years and have done lots of chromakeying in the past...primarily for weather reports. It does open up a lot of possibilities. Excellent test.

    ReplyDelete
  2. Very cool! I had tried long time ago to upload a short movie clip as swf on GoAnimate and do the same thing directly on our platform. Did not quite work and file size / loading was a big issue... Could be fun if one day we can do that kind of stuff directly on GoAnimate!!

    ha ha... say no to greenish bikini girls!

    ReplyDelete
  3. Would be great to do this directly on GoAnimate Nicolas. Mainly for maintaining the animation quality.

    What would really be better is... and you've heard this before... is the ability to export GoAnimate animations as true video files (either mpg or mov would be nice). That way exporting an animation for chroma keying over a video in a dedicated video editing studio would be a snap.

    ReplyDelete
  4. Hey David,

    We are discussing right now how we could allow users to upload flv videos (better as they can stream instead of fully load before they play) as props or backgrounds in GoAnimate to enable that. Would be a bit of a pain to finetune the timing, but would be much more handy that using many different pieces of software to create your movie.

    Exporting GoAnimate animations as videos is something we have on our plate for a long time. It is quite complex and requires quite a bit of enhancements on our server side. So we're not sure when we can offer this. We totally hear you though...

    ReplyDelete
  5. I agree Nicolas, that it would be great being able to import FLV videos directly into the studio - probably the ideal in fact.

    However to make it work you'd need a 'Individual Frame' mode in the studio in order to fine tune animations to video (Which is how the animators worked on 'Who Framed Roger Rabbit' - frame by frame on live action film).

    The way the studio currently works it can be very hit and miss on timing critical animated sequences (such as one character hitting another for example). An individual frame mode would be useful not just for timing animation to video but also timing interactions between animated characters.

    Maybe you could have an FLV video as a background on a scene and then have a 'view individual frames' mode for just that scene (so as not to have to convert the entire animation storyboard into individual frames)?

    It all sounds too hard and server intensive for a web based application. Awesome though if you guys somehow made this work.

    ReplyDelete

Post a Comment

This blog is monitored by a real human. Generic or unrelated spam comments with links to sites of dubious relativity may be DELETED.

I welcome, read, and respond to genuine comments relating to each post. If your comment isn't that save me some time by not posting it.

Popular posts from this blog

Eight 2D Animation Apps For Your Phone or Tablet Mobile Device

M obile productivity apps have become so capable that they can be great alternatives to their PC/MAC equivalents or serve as great tools in their own right when you're away from your desk. While some apps simply mimic their desktop counterparts, others offer well thought out, touch-friendly interfaces that are easier and more fun to use. Every so often I check out what's available for 2D animation for Android devices, since that's what I use, that can complement my workflow with Reallusion's Cartoon Animator 5. Some may be available for Apple devices as well. Below I've listed six free (F) apps (with optional paid (P) upgrades) on the Google Play Store that you might want to explore. Some are just fun apps on their own while others may be useful as part of your workflow on bigger animation projects. Not all are exclusively animation apps and could be used on any production. JotterPad (F/P) The name JotterPad makes this sound like a notepad application but it's ...

Infinite Monkey Theorem Animated Short - Part 5

Scene 2 from my storyboard, Infinite Monkeys. Work on my Infinite Monkey animated short is definitely back on track since my last update and my previous part 4 post . To get things moving again I've decided not to spend time creating a final draft storyboard that uses all the actual props and characters. This is something that you'd generally do if you were planning to show the storyboard to someone else for feedback. At this point I'm not planning to do that so I'm going bypass it and create and animate each scene as I go, saving a bit of time.

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 2 - Inochi2D Session)

In part one of my deep dive into the free VTuber software, Inochi2D , I focused mainly on Inochi2D Creator, which is used for rigging your character avatar in the correct file format for use with Inochi2D Session, the puppeteering part of the software. The two sides of the software are still very much in development and the documentation, particularly for Session, is very thin on the ground. To the point where I don't think I could even do a comprehensive tutorial because I'm not sure I'm even doing things right, and the software could change significantly in a single update. As a result, in this part of my Inochi2D deep dive I'm changing tact from presenting my finished Cartoon Animator TET Avatar, and will be summarizing my experience of getting Session up and running using OpenSeeFace as the recommended webcam motion capture software. To do this I will be using  the TET avatar I created in my review of Mannequin , since that can be exported as a full, ready to go r...

Prome AI Sketch Render Tool - Your Tradigital Clean Up and Colorist Artist for Character and Background Design

Random character head, Biro sketches drawn by TET (left). Render by PromeAI (right) using Prome's Sketch Render tool set to 'Comon:Cartoon, Render Mode: Outline'. W hile I don't do New Year Resolutions, one of my plans for the year ahead is to do more of my own art. Specifically character design drawn in an actual, physical sketchbook.  To that end, I have been spending the last half hour of most days drawing a page or two of random biro sketches in my sketchbook and posting the pages to my Instagram account  (this link will take you to one of my posts). These sketches are mostly practicing my skills because I don't really draw regularly anymore. Here is a tip, if you do this kind of sketching, and push yourself to keep doing it, you will see many drawings that could be taken further, even if you don't have anything they're suited for just at the moment. Which is where my second favorite AI Image Tool (after Leonardo.ai )  PromeAI comes into play. PromeAI ...

Wonder Unit Storyboarder - Free Storyboarding Software for People Who Can (or Can't) Draw

Wonder Unit Storyboarder.  As an independent and solo animator I'm always tempted to try and skip storyboarding my animated shorts because they're usually only single scene sketch comedy type jokes. As a result I have many unfinished projects that kind of petered out due to having no clear finishing line. Storyboarding your productions, no matter how small, gives you a step by step guide of every shot that needs to be completed (no planning shots as you animate). It also allows you to create an animatic that gives you a rough preview of the finished production. In short, you shouldn't skip storyboards as they, generally, increase the chance of the project being completed. Disclaimer - I'm Not a Fan of Storyboarder Upfront, Wonder Unit's Storyboarder  is not my preferred storyboarding software. However it's completely free, has a number of very compelling featu...

How to Become a Virtual YouTuber (VTuber) - 2D and 3D Software for Creating and Controlling Your Avatar

Young TET VRoid Avatar in VSeeFace. In a previous YouTube video I demonstrated how you could use a webcam, Cartoon Animator and its MotionLive 2D Facial Capture system to create a virtual avatar that you could perform live during a live stream. Unfortunately the motion capture performance of this system is very average to say the least, and is even more expensive if you want to add hand motion capture via a Leap Motion Controller . This lead me down a rabbit hole of seeing what other solutions are out there, where I bumped into the world of the VTuber or Virtual YouTuber (creators who puppet and voice an on camera avatar instead of appearing on camera themselves). Specifically VTuber software, which has been a real eye opener for how expensive and far behind Reallusion's upper body motion capture system actually is. The VTuber world is heavily entrenched in the world of Anime so you'll see a lot of 2D and 3D avatars in this style. If fact, if an Anime avatar is your thing, y...

Inochi2D - Free Open Source 2D VTuber Avatar Rigging and Puppeteering Software (Part 1)

Inochi2D Creator - Free Open Source VTuber Software. If you've been looking for a way to live perform as a 2D cartoon avatar on camera, whether it be for a live stream or for pre-recorded content like educational videos, then VTuber software is a low cost (or even no cost) option worth looking into. In my previous post, How to Become a VTuber - 2D and 3D Software for Creating and Controlling Your Avatar , I took a brief look at the relatively new but completely free and open source Inochi2D  which I thought showed great potential for my own needs of creating a live performance character rig for my own TET Avatar that I use for all my promotional materials. While it is possible to live perform my character using Cartoon Animator itself, Reallusion's MotionLive2D capture system isn't great - with lip sync in particular. More importantly though, I can't exactly teach people how to use Cartoon Animator if I'm using Cartoon Animator to control my Avatar. What is Inochi2D...