We present AnaMoDiff, a novel diffusion-based method for 2D motion analogies
that is applied to raw, unannotated videos of articulated characters. Our goal
is to accurately transfer motions from a 2D driving video onto a source
character, with its identity, in terms of appearance and natural movement, well
preserved, even when there may be significant discrepancies between the source
and driving characters in their part proportions and movement speed and styles.
Our diffusion model transfers the input motion via a latent optical flow (LOF)
network operating in a noised latent space, which is spatially aware, efficient
to process compared to the original RGB videos, and artifact-resistant through
the diffusion denoising process even amid dense movements. To accomplish both
motion analogy and identity preservation, we train our denoising model in a
feature-disentangled manner, operating at two noise levels. While
identity-revealing features of the source are learned via conventional noise
injection, motion features are learned from LOF-warped videos by only injecting
noise with large values, with the stipulation that motion properties involving
pose and limbs are encoded by higher-level features. Experiments demonstrate
that our method achieves the best trade-off between motion analogy and identity
preservation.

提出了 AnaMoDiff 方法，一种新型的基于扩散的 2D 运动类比方法，适用于未经注释的二维角色视频。通过扩散模型利用噪声的潜在光流网络在无噪声潜在空间中转移输入运动，实现对 2D 驾驶视频运动准确地转移到源角色上，同时保持其外观和自然运动的身份，即使源角色与驾驶角色在部分比例、运动速度和风格上存在显著差异，通过特征解耦的方式训练去噪模型，实现运动类比和身份保护的最佳平衡。