Six AI Audio Cleaning and Transcription Resources for Video and Animation Content Creators

AI Audio Cleaning Robot. Image by TET and Leonardo.ai

While AI applications may have been receiving a lot of bad press lately in the visual arts, there are definitely times when AI is a game changer, in a good way, for more mundane applications like audio cleaning and transcribing.

Maybe there's some militant audio engineers or transcribers out there who just love what they do but the ability to give an audio file to an AI, and have it automatically improve the quality of sound or transcribe an hour or more of speech in seconds, is pure magic.

Sure the AI doesn't always get it right, particularly with transcribing, but it's pretty good. Plus, correcting a few short falls is certainly better than doing all the work yourself.

I recently recorded a thirty minute video with audio that was borderline awful. It was clear enough to understand but I hadn't been able to filter out the static noise of the microphone, and it would distort on the louder sections, just enough to notice, even though the levels were well under the clipping threshold.

Nothing I did in post would fix it so I decided to see what AI audio cleaning services were out there (and of course find out if there were any free services).

Clean Voice AI

I'm leading with Clean Voice AI because it was the service I used to fix my audio. Your first 30 minutes is completely free (which was all I needed).

Clean Voice over delivers, not just fixing terrible audio but also removing dead air, 'ums' and 'ahs' (as well as other mouth sounds), and more.

Although I didn't try Clean Voice's audio transcribing, its inclusion makes the site a great, one stop service, for many of your audio needs. It's particularly targeted at podcasters including a number of free tools for them like their Podcast Episode Title Generator.

Clean Voice AI is browser based. Subscription pricing seems quite reasonable to me but what I most liked is that you can pay as you go as well.

Audo Studio

If all you need is just a straight up audio cleaner that can remove almost any unwanted background noise then Audo Studio is a browser based application that may be what you're looking for.

Some examples of the kind of noises they can fix include background restaurant noise, bird squawks, dog barking and more. Audo Studio can also auto adjust volume levels so your voice can be heard.

Another nice feature is that you can upload video files for audio cleaning. No need to separate your audio just to use the service. Which may be useful if you're wanting to fix audio on older completed videos.

Audo Studio is subscription based but they do have a free plan that gives you 20 minutes of audio cleaning per month.

Deciphr

Another browser based AI service targeting podcasters (but also can process video files) Deciphr is a one stop shop for turning audio into all kinds of text.

Not limited to transcribing, it can also generate show notes, show summaries, pull out quote highlights, create captions for social media posts, list keywords for SEO and, on a paid plan includes the creation of audiograms and video reels (highlighted audio and video for social media).

All output is organized on a sharable page with a nice headline or you can download everything as a Word Document.

Deciphr has a flexi-free plan that gives you 40 minutes of audio/video upload to get started then it's a pay as you go plan. Unfortunately you do need a credit card as they only accept payments through Stripe. Which for me is disappointing because I would definitely subscribe to a plan if I could use PayPal.

Riverside

Riverside is actually a complete browser based studio for professional podcast and video recording which you can try for free. Alongside that Riverside has a host of free and paid tools including their transcription service (which is free).

You don't need an account for their transcription service, just drag'n'drop an audio or video file onto the browser window and you're away. Text can be downloaded as a transcript or caption text file.

Note that if you're using a browser other than Chrome or Edge you may find this doesn't work. I've been trialing Opera's Browser and the transcript tool wouldn't go past the choose file section. Chrome worked just fine though.

Well worth checking out some of their other free tools which include things like a YouTube Channel Name generator.

Descript

The Descript Editor can edit video
direct from your script.

Descript is also an all in one video creation tool that is browser based but also has a desktop version. Their studio uses a fairly unique concept of editing video based on your text script.

Some of Descript's features include cleaning your audio, removing filler words, and you can clone your own voice and have it speak new dialogue. There's also natural speaking AI voices you can utilize.

Since Descript's video editor relies on a text based script it goes without saying that it can also transcribe your audio and video. Not only that, if you already have a transcription, they can sync it to your media word for word.

Descript is well worth a look since there is a free plan that gives you most features with the ability to create up to an hour of video per month.

* Note: Links to Descript are affiliate links that support this site if you sign up for a Descript paid plan.

AI-coustics

AI-coustics is a fairly basic, browser based, AI audio cleaner if you just need to knock out some background noise from your recordings. Clean up to an hour of audio per month on the free account. Test the service out before you sign up in their Playground area.

The Levelator (Bonus Non-AI Free Software)

Not really an audio cleaning tool but more of an audio enhancing tool for podcasters and video creators too. The Levelator is free software for Mac or Windows that simply takes your voice audio and adjusts the speaking level of all voices to one consistent level.

Pretty much does the job of a compressor filter but the authors say it does more than that, evening out all the voices so none sound too quiet and hard to hear.

The software is quite old now but still does the job. Great if you just need something simple to even out your audio and don't really understand the technicalities of using a compressor filter in your video/audio editing software.

Can You Learn Reallusion's Cartoon Animator 5 for Free Using Their 137 Official YouTube Video Tutorials Sorted Into a Logical Learning Order?

Or you could just buy The Lazy Animator Beginner's Guide to Cartoon Animator . While Reallusion's Cartoon Animator is one of the easiest 2D animation studios to get up and running with quickly, learning it from all of the official, free, video tutorials can be more overwhelming than helpful. With more than 137 videos totaling more than 28 and a half hours of tutorials, spread across three generations of the software (Cartoon Animator 3 through 5) it's hard to know if what you're learning is a current or legacy feature that you either need to know or can be skipped. Many of the official tutorials only teach specific features of the software and don't relate at all to previous or later tutorials. As a result there are many features either not mentioned or are hard to find. To make your learning easier, on this page, I've collected together all of the essential, official, free video tutorials and sorted them into a learning order that makes sense. Simply start at

AE Juice - Animation Presets, Motion Graphics, Templates, Transitions for After Effects, Premiere Pro, and Other Video Applications

Level up you video edits and animations with AE Juice's motion graphics and templates. Some days you just don't have the time to create flashy motion graphics for your latest video or animation. For some of us it's more a question of our own artistic abilities being a little less than the awesome we'd like them to be. Whatever reason a resource like AE Juice's animation presets, motion graphics, templates, and transitions packs for After Effects , Premiere Pro , and other video applications can really make your work stand out very quickly. AE Juice gives you access to an instant library of free, premade content elements and sound effects, which you can add to with additional purchases of various themed packs from their store. There are three ways to manage their content, all of which can be used in commercial projects . The AE Juice Standalone Package Manager makes it easy to browse previews of all your pack contents and to download and find just the elements yo

Artbreeder - Using AI created Character and Background Content in your Animations

A selection of User/AI generated images from Artbreeder. If you're looking for an endless supply of 2D character and background images for your animations then Artbreeder , an online Artificial Intelligence (AI) that generates image mash-ups you can tweak as much as you like, could be the ultimate content library. What is Artbreeder? Artbreeder is free to use though there are various paid plans, that give you additional features, such as higher resolution download images or more settings to play with. All images created on the site are Public Domain (CC0 License) and can be used in commercial projects. Using Artbreeder's online app you can generate head shot portraits, full body characters, landscapes, and other scenes simply by choosing two or more existing images to mash together then, using a series of sliders, to select which traits from each image you wish to lean toward in the final image. Photo Comparison - Top is my original uploaded photo. Bottom is Artbreeder's ap

Jarrad Wright, The Big Lez Show - Who Would've thought Animating with MS Paint Could Take You So Far?

A friend of mine recommended I should check out The Big Lez Show after I mentioned to him I make animations for living. He said the show's creator, Australian animator, Jarrad Wright , just makes episodes from his home using MS Paint. Somewhat shamefully I hadn't heard of The Big Lez Show, but the fact that it was being made with MS Paint absolutely hooked me into checking out. If you've never heard or seen the show then you, like I was, are probably thinking how good could it be? MS Paint has kind of a cult following of hardcore animators but no one would use it as their primary animation tool on a series, right? WARNING - before going any further, you need to know The Big Lez Show and its humor contains some pretty strong language. By strong I mean it's peppered very liberally with the 'F' and 'C' words and is very every day Aussie, blue collar speak. Unapologetically, all of that, is part of why it's so good. There's a good chance you've

Moho 14 Released - Still the Best 2D Animation Software for Indy Animators on a Budget

Moho 14 Released. Regular readers know I am a Reallusion, Cartoon Animator advocate through and through. Hands down I would recommend Cartoon Animator 5 first over Lost Marble's Moho 14 to anyone who is just starting in 2D animation, is a team of one, or just needs to animate as quickly as possible. However, feature for feature, Moho is, arguably, the best 2D animation software for the rest of us who can't justify a Toon Boom Harmony , or Adobe Creative Cloud subscription (and even with their applications Moho is very competitive on features). You can get started with Moho Debut for just USD$59.99 which is a cut down version of Moho Pro but it still has the most essential features needed for 2D animation. While Moho Pro is a whopping USD$399.99 (Cartoon Animator, which only has one version, is just USD$149.00) upgrades to new version numbers come down to a quarter of the price at USD$99.00. Even though Reallusion just released features like Motion Pilot Puppet Animation and

Reallusion Releases Cartoon Animator 5 - One Version, More Features, Lower Price!

If you're serious about producing 2D animation as quickly as possible, while still achieving professional results, Reallusion's Cartoon Animator 5 makes the most compelling case yet as your animation studio/tool of choice. Cartoon Animator's point of difference has always been its ease of use and accelerated workflow. Creating fast, 2D animation using puppet, bone rigged based characters and props, on a stage with 3D depth for easy scene parallax effects. As it has developed Reallusion has incorporated more advanced features like motion capture for both face and body as well as being able to export scenes to post production tools like After Effects with the addition of plugins. After moving away from Flash based vector image support for a few years, Reallusion is back with full .SVG (scalable vector graphics) support for resolution independent graphics. They've also added Spring Dynamic physics and Full Form Deformation tools, both of which make it ridiculously easy t

Cartoon Animator 5 and G2 Characters - Why You'll Probably Never Use Them Even Though They're Great

Since I've previously covered how to get the most out of your purchased G3 and G1 characters for Reallusion's Cartoon Animator 5, it would be remiss of me not to look at the greatest character rig of all time, G2 characters. G2 Characters have been mostly relegated to legacy status since Cartoon Animator 3 but, as a rig that let you create fully 360 degree turn-able characters that moved in 3D space, animated with 3D motion files, and were mostly vector based, there was nothing else like them in any other 2D software. The problem was, even with the templates provided by Reallusion for both Adobe Flash and Serif DrawPlus , they were complex and time consuming to make from scratch. They were also difficult to customize because there was no way to export and edit individual parts. G2 characters just weren't easy enough for the casual Cartoon Animator user to customize so they fell by the wayside. However they're still fully supported in CA5 with all the same functional

Animation and Video Life

Search This Blog