Up next in 10
Runway GEN 2 Motion Brush Next Level Text to Video A
2K views
Jun 24, 2024
The video "Runway GEN 2 Motion Brush: Next Level Text to Video" showcases the advanced capabilities of Runway's GEN 2 Motion Brush in transforming text into dynamic video content. It demonstrates how this AI-powered tool generates visually engaging videos from textual prompts, utilizing cutting-edge motion and visual effects. Whether you're a digital artist, marketer, or content creator, this tutorial explores how Runway GEN 2 Motion Brush enhances the creative process, enabling users to produce high-quality, customized videos efficiently and effectively.
View Video Transcript
0:00
Runway has just introduced a new option called motion brush and with motion brush you could basically bring any part of an image to life
0:08
All you have to do is brush over a section and this gives you control over the motion in that very specific area for your video
0:16
Now if you haven't used Runway before, this is the leading text-to-video platform, so you could access it at RunwayML.com
0:24
Right now motion brush is the new option, so you could try it here, but if you try Runway here, it will take you to the same page
0:31
Now here inside of Runway, I'm going to go ahead and start with an image because the way motion brush works is it actually lets you control parts of an image
0:39
and turn that part into motion, so you can't do it with text
0:44
Although you could generate image previews here with text, but right now I'm just going to use images and upload a file
0:51
Now to get good images, there is a free website and it's called Pexels.com, so here you could search for any images
0:58
These are royalty free, free to use. And you could always use Dolly or Mid Journey to generate images that are good as well
1:05
And all I did right now is search for beach. I'm going to show you a couple of different examples with some of the settings we have, but if you search for beach
1:11
just go ahead and click on any one of these and then go ahead and press free download right on top
1:16
And then I'm going to upload that image here under the image tab. Now here, typically you would click generate and it will bring this to life, but in this case, we want to use this motion brush option right here
1:26
This is going to open this new edit window. I'm going to tap anywhere to get started
1:30
And here inside of the image, you have this brush right here, so this purple dots here brush
1:35
and then you have the size, which you could decrease if you want really fine refinements
1:40
But in most cases, I want to move a big area, so in this case, I want to move the cloud
1:44
so I'm going to increase it to be large, and then you could select the parts that you want moved
1:49
If you make a mistake, there is an eraser here where you could erase what you don't want included
1:55
Now, in this case, I'm going to just change and select all the clouds that I want moved over here
2:01
And you could do it with the water too. Anything you want moved, you could go ahead and select it here
2:06
And then you have three sliders down here that is going to control speed
2:10
So horizontal, if you want things to move faster left to right, you could change it
2:15
So if you want things to move slower left to right, decrease. If you want things to move fast left to right, increase
2:21
Now, by default, I recommend you stay just right here in the middle
2:25
With vertical too, you could do the same thing. If there is vertical motion in the image that makes sense
2:31
In this case, if I change the clouds to move vertically, it's not going to make much sense
2:35
So I'm going to just not touch that at all, leave it right in the center. I'll show you an example where this makes sense in the very next image that I have right now
2:42
And then proximity, if you want things to move in a group, you could go ahead and move this more to the right
2:50
And if you want things to be more separated, move it to the left. So a flock of bird, for example, should move together
2:56
Clouds should move together. In the middle, by the way, gets me the best results in all my experimentation so far
3:02
So I recommend you start here before you generate too much and use up too much credit
3:07
And then if it doesn't look quite right or if the speed is not there for you, go ahead and make alterations to these three sliders
3:14
So as soon as you're done here, you could go ahead and press save
3:18
Then in addition to that, you have camera motion. So that is going to make your image move in the certain parts that you brushed over
3:25
But camera movement moves the whole video. So if you want things to basically move in or out or zoom in, you could go ahead and set these options
3:34
And then the speed, again, independent from the motion speed, you could set here
3:38
In this case, I'm going to keep it simple. I'm just going to generate this based on all the default settings of the motion brush without any additional camera
3:46
I'll show you what it looks like in a second. And let me go ahead and play this in full screen here for you
3:51
And if you take a look at the clouds, really nice natural movement
3:55
And not much movement here happening to the water because I didn't brush the water
3:59
Now, if I do brush the water, the water is going to move as well. Now, typically, this moves slowly by default
4:04
So if you want to increase how fast the clouds were moving, although this looks pretty natural
4:08
but if you want it to be more like a time lapse, take that horizontal slider all the way to one direction to the right
4:15
Now, this version, I actually changed the slider on the vertical. So I made the speed change in the vertical and see unexpected things happen when things move vertically
4:24
It didn't make sense with this image. So you have to make the decision if you want to change the sliders, the horizontal, vertical, which way you want to go
4:32
Because sometimes like in this one where I changed the vertical slider, the speed, I got really bad results
4:37
Let me show you one with the vertical slider that makes more sense. Now, here's an image again from pixels
4:43
And let's go to motion brush one more time. Click anywhere. I'm going to increase the brush size again
4:48
And let's just paint the entire fire here. And I'm going to increase the size here to five
4:54
Let's see what that looks like. Everything else I'm going to leave the same
4:58
In this case, I want the vertical movement to be even faster than normal. And then I'm going to go ahead and save and generate
5:03
So the fire is moving in the right direction, but the speed still needs to increase
5:07
So I moved it to five. I should probably move it all the way to the max. This sort of looks like slow motion video right now
5:12
It looks pretty good, though. The movement is very nice in the right direction. And so let me show you how to edit existing ones
5:18
So right here, if you click the motion brush one more time, which is just underneath every video that you preview
5:24
you could go ahead and increase it. So I'm going to go all the way to the 10 to the maximum and see what I come up with
5:31
By the way, every time you generate, it will use up credits. So I'm down to 121 seconds
5:35
You can see up here, and this is going to use another four. So you need to upgrade sometimes if you run out of credits
5:41
So let me slide down. Here's the new one. Let me press play
5:45
So the speed is faster. Let me show you the previous. So this was much, much slower
5:50
But this actually looked a lot better. This one, it's losing some of the details in the fire
5:55
So I notice if I go all the way up or all the way down with any of those sliders
5:59
it does make other parts of it not look as good. So this is actually useful if I want some kind of a slow fire
6:08
But in most cases, I can get things to move really, really fast. But I could speed this up in maybe an editing software like CapCut
6:16
This is a free video editing software where you could double the speed. So experiment with this
6:20
Again, use pixels or any other text-to-image platform to create an image
6:24
and bring it to life. I hope you found this useful, and I'll see you on the next video
#Clip Art & Animated GIFs
#Online Goodies