BriefGPT.xyz
May, 2024
MotionCraft: 基于物理的零样本视频生成
MotionCraft: Physics-based Zero-Shot Video Generation
HTML
PDF
Luca Savant Aira, Antonio Montanaro, Emanuele Aiello, Diego Valsesia, Enrico Magli
TL;DR
提出了一种新的零样本视频生成器MotionCraft,通过应用来自物理模拟的光流对图像扩散模型(如稳定扩散)的噪声潜空间进行变形,从而实现基于物理的和逼真的视频生成,以生成具有复杂运动动力学的视频。与现有方法相比,实现了定性和定量改进,证明了该方法的有效性。
Abstract
Generating videos with realistic and physically plausible motion is one of the main recent challenges in computer vision. While
diffusion models
are achieving compelling results in image generation, video
diffusion mode
→