Exploring RunwayML’s ‘Infinite Images’ Machine Learning Tool

February 22, 2023

Fill a vertical 9:16 image into a 16:9 horizontal frame - by painting it in using RunwayML.com's 'Infinite Image' machine learning tool.


Quick Tip: Using Machine Learning on portrait-oriented still images to fill a 16:9 frame

Machine Learning tools can do some amazing things. They can even fit a vertical image into a wider 16:9 hole. I’m not talking about increasing the image’s resolution so the image tolerates a 200% or 300% scaling operation.

I’m talking about extending the rest of the vertical image to fill in the horizontal empty space with new unseen image detail!

Think: Hand-painted set extensions (like a matte painting artist) but with a computer creating the set extensions with a few clicks of a button.

In this Mixing Light Short,  we explore using Machine Learning (ML) to solve a common editorial aesthetic problem, fitting vertical 9:16 images in a 16:9 horizontal frame. We’ll do this in just a few clicks using Runway’s Infinite Image machine learning tool – a tool that extends your image based on its visual content.

I want you to know where this technology is taking us and provide an example you can use with your clients today. Of course, when uploading client images to these services, be sure you have your client’s approval to avoid copyright issues.

Discount Code

Mixing Light members, log in to view the discount code for RunwayML – it’s above the video.

External Links

  • Visit RunwayML.com – Runway currenly has over 30 ML-based tools that are interesting to experiment with. I encourage you to check them out. You’ll notice that some of these tools are also showing up in plugins for DaVinci Resolve and other post-production tools (such as depth matte extraction, removing/healing parts of an image, and super slow motion).

Related Mixing Light Insights

Member Content

Sorry... the rest of this content is for members only. You'll need to login or Join Now to continue (we hope you do!).

Need more information about our memberships? Click to learn more.

Membership options
Member Login

Are you using our app? For the best experience, please login using the app's launch screen


1,000+ Tutorials to Explore

Get full access to our entire library of over 1,100+ color tutorials for an entire week!


Start Your Test Drive!
Loading...