Runway AI is blowing up in the AI Tools world, especially when it comes to video and animation creators. These guys have a whole suite of tools that go beyond just generative AI. But what’s really got people hyped is their Gen 1 Video to Video tool. This bad boy can take your input video and transform it into something totally different. We’re talking about a technique called the “world jump” simulation. Imagine the main character in your video jumping into another dimension and turning into a whole new character, but maintaining the same movements as the original. It’s like a modern-day “Quantum Leap”!
Now, you can use any NLE (that’s non-linear editing software for you noobs) to edit your video, but the real key here is aligning those clips just right. You want a seamless transition from scene to scene. And let me tell ya, sound design is crucial to make this effect pop. You gotta sell it, man!
But let’s take a look at some examples of this mind-bending technique. Martin Haerlin, the dude who made this concept popular, dropped a video on the Internet that blew everyone’s minds. It was only 4 months ago, and it instantly went viral. Check this out!
And here’s another one from Martin. He stepped up his game with more developed characters and insane action at every stage. This dude knows how to push the boundaries!
Oh, and don’t miss this fun production in the mirror. There are several characters, and each one has their own voice. It’s wild!
But wait, there’s more! Martin recently entered the Runway Gen:48 short film competition with a mock insurance ad. It’s a creative masterpiece, my friends!
Now, if you’re wondering how this magic is done, Runway has got you covered. They’ve got a tutorial on their site that breaks down the process. But hey, I got inspired by this technique and decided to give it a whirl myself. Check out my tutorial video for a step-by-step guide.
First things first, record your spin/walking/static selfie video, or get a close-up shot of your subject. You gotta have some action going on to define those scene “jumps.” It can be a finger snap, a cool motion, or any kind of signal. Be creative, people!
Next, slice up your footage in good ol’ Adobe Premiere Pro and export each segment as a separate video clip. Easy peasy, right?
Now, log into your Runway AI account and select Gen 1 Video to Video. Upload that first clip sequence you rendered in Premiere and get ready for some fun. You can add reference images or choose default styles for your various sequences. Make it your own, baby!
In this example, I used an image created in Runway AI’s text to image generator. Pay attention to the settings in the Advanced Tab on the right. They’re crucial to dialing in that desired effect. Tweak it until it’s just right, my friends!
Once you’re happy with the preview look, hit that Generate Video button and watch the magic happen. Rinse and repeat this process for all your clip segments, and then download those sweet, rendered results.
Now it’s time to bring it all together in Adobe Premiere. Assemble your clips on the timeline and make sure they match up perfectly from end to end. We don’t want any funky jumps ruining our masterpiece.
Oh, and since I wanted to add some spice to my “world jump” experience, I created my cosmic “blast” effect using various SFX from the Adobe Stock library. Stack ’em up until you get the result that makes you scream, “Hell yeah!”
But that’s not all. I needed something extra to make those jumps even more mind-blowing. So I threw in some Boris FX BBC Lens Flash for each transition. It’s like a flash of brilliance, baby!
Lastly, I added different ambient sounds from my library to create unique environments for each segment. This takes the viewer to a whole new world or dimension, man. It’s gonna blow their minds!
So there you have it, my friends. Get ready for more creations with these badass Generative AI Tools from Runway. The possibilities are endless, and we’re just scratching the surface. Buckle up, because things are about to get wild!