Stochastic human motion prediction aims to predict multiple possible upcoming
pose sequences based on past human motion trajectories. Prior works focused
heavily on generating diverse motion samples, leading to inconsistent, abnormal
predictions from the immediate past observations. To address this issue, in
this work, we propose DiffMotion, a diffusion-based stochastic human motion
prediction framework that considers both the kinematic structure of the human
body and the globally temporally consistent nature of motion. Specifically,
DiffMotion consists of two modules: 1) a transformer-based network for
generating an initial motion reconstruction from corrupted motion, and 2) a
multi-stage graph convolutional network to iteratively refine the generated
motion based on past observations. Facilitated by the proposed direct target
prediction objective and the variance scheduler, our method is capable of
predicting accurate, realistic and consistent motion with an appropriate level
of diversity. Our results on benchmark datasets demonstrate that DiffMotion
outperforms previous methods by large margins in terms of accuracy and fidelity
while demonstrating superior robustness.

该论文提出了一种基于扩散的随机人体运动预测框架 DiffMotion，旨在预测未来的姿势序列，并通过使用多阶段图卷积网络和方差调度器，使预测结果准确、逼真、一致，同时在准确度和保真度方面明显优于先前的方法，并通过基准数据集展现了强大的鲁棒性。

基于运动扩散的全局一致随机人体动作预测

Towards Globally Consistent Stochastic Human Motion Prediction via  Motion Diffusion

Stochastic human motion prediction aims to forecast multiple plausible future
motions given a single pose sequence from the past. Most previous works focus
on designing elaborate losses to improve the accuracy, while the diversity is
typically characterized by randomly sampling a set of latent variables from the
latent prior, which is then decoded into possible motions. This joint training
of sampling and decoding, however, suffers from posterior collapse as the
learned latent variables tend to be ignored by a strong decoder, leading to
limited diversity. Alternatively, inspired by the diffusion process in
nonequilibrium thermodynamics, we propose MotionDiff, a diffusion probabilistic
model to treat the kinematics of human joints as heated particles, which will
diffuse from original states to a noise distribution. This process offers a
natural way to obtain the "whitened" latents without any trainable parameters,
and human motion prediction can be regarded as the reverse diffusion process
that converts the noise distribution into realistic future motions conditioned
on the observed sequence. Specifically, MotionDiff consists of two parts: a
spatial-temporal transformer-based diffusion network to generate diverse yet
plausible motions, and a graph convolutional network to further refine the
outputs. Experimental results on two datasets demonstrate that our model yields
the competitive performance in terms of both accuracy and diversity.

该研究提出了一种名为 MotionDiff 的扩散概率模型，将人体运动的运动学视为受热的粒子，其自原始状态扩散到噪声分布。该方法通过一种自然的方式获取了 “白化” 的潜在变量，而无需任何可训练参数，证明 MotionDiff 模型在两种数据集上具有竞争力的准确性和多样性表现。