Selected papers | Runway Research
Our ensemble of diffusion models, called eDiff-I, results in improved text alignment while maintaining the same inference computation cost and preserving high visual quality, outperforming previous large-scale text-to-image diffusion models on …
The research origins of Stable Diffusion - Runway
Oct 5, 2022 · Patrick Esser is a Principal Research Scientist at Runway, leading applied research efforts including the core model behind Stable Diffusion, otherwise known as High-Resolution Image Synthesis with Latent Diffusion Models.
Runway Acceleration Program
Runway Acceleration Program. The Runway Acceleration Program is a full-time, paid position that starts with a 3-month intensive venture dedicated to fostering engineers, propelling them into accomplished machine learning engineer roles within our organization.
Behind The Scenes: Understanding video object segmentation (VOS)
Publications Gen-3 Alpha Gen-2 Gen-1 Careers About Sign in to Runway. Gen-2 Gen-1 Careers About Go to Runway. Behind The Scenes: Understanding video object segmentation (VOS) Explore Careers. Reimagining creativity with artificial intelligence. About; Publications; Join Runway; 2024 Runway AI, Inc.
Building a web-based real-time video editing tool with machine
May 24, 2021 · In this blog post, I will briefly describe some of the technical challenges we faced while building Green Screen, and provide insight into the process of developing a real-time, interactive machine learning tool for the web.
AI Conversations - Runway Research
A series of conversations with prominent AI researchers and artists on their perspectives on creative AI.
All Publications - RunwayML
Gen-1: Structure and Content-Guided Video Synthesis with Diffusion Models Patrick Esser, Jonathan Granskog, Johnathan Chiu, Parmida Atighehchian, Anastasis Germanidis Runway
High-Resolution Image Synthesis with Latent Diffusion Models
Our latent diffusion models (LDMs) achieve highly competitive performance on various tasks, including unconditional image generation, inpainting, and super-resolution, while significantly reducing computational requirements compared to pixel-based DMs.
Towards Unified Keyframe Propagation Models | Runway Research
Publications Gen-2 Gen-1 Careers About Sign in to Runway. Gen-2 Gen-1 Careers About Go to Runway. Research. Towards Unified Keyframe Propagation Models. Authors. Patrick Esser 1, Peter Michael 1, 2, Soumyadip Sengupta 2. 1 Runway, 2 University of Washington. Published. May 25, 2022. Downloads.
Gen-2 by Runway
Gen-2: The Next Step Forward for Generative AI A multimodal AI system that can generate novel videos with text, images or video clips. Try Gen-2 in Runway Try Gen-2 for iOS