Joint forecasting of human trajectory and pose dynamics is a fundamental
building block of various applications ranging from robotics and autonomous
driving to surveillance systems. Predicting body dynamics requires capturing
subtle information embedded in the humans' interactions with each other and
with the objects present in the scene. In this paper, we propose a novel
TRajectory and POse Dynamics (nicknamed TRiPOD) method based on graph
attentional networks to model the human-human and human-object interactions
both in the input space and the output space (decoded future output). The model
is supplemented by a message passing interface over the graphs to fuse these
different levels of interactions efficiently. Furthermore, to incorporate a
real-world challenge, we propound to learn an indicator representing whether an
estimated body joint is visible/invisible at each frame, e.g. due to occlusion
or being outside the sensor field of view. Finally, we introduce a new
benchmark for this joint task based on two challenging datasets (PoseTrack and
3DPW) and propose evaluation metrics to measure the effectiveness of
predictions in the global space, even when there are invisible cases of joints.
Our evaluation shows that TRiPOD outperforms all prior work and
state-of-the-art specifically designed for each of the trajectory and pose
forecasting tasks.

本文提出了一种新的基于图注意力网络的轨迹和姿态动力学建模方法，通过消息传递界面融合了输入输出空间中人机和人物交互的不同层次，最终在两个具有挑战性的数据集上评估其性能，证明其优于先前的工作和针对轨迹和姿态预测任务的现有技术水平。

TRiPOD：野外人体行为轨迹和姿态动态预测

TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild

This paper presents a novel deep learning framework for human trajectory
prediction and detecting social group membership in crowds. We introduce a
generative adversarial pipeline which preserves the spatio-temporal structure
of the pedestrian's neighbourhood, enabling us to extract relevant attributes
describing their social identity. We formulate the group detection task as an
unsupervised learning problem, obviating the need for supervised learning of
group memberships via hand labeled databases, allowing us to directly employ
the proposed framework in different surveillance settings. We evaluate the
proposed trajectory prediction and group detection frameworks on multiple
public benchmarks, and for both tasks the proposed method demonstrates its
capability to better anticipate human sociological behaviour compared to the
existing state-of-the-art methods.

本文提出了一种新颖的深度学习框架，用于人类轨迹预测和在人群中检测社交群体成员。我们引入了一个生成对抗网络管道，可保留行人社区的时空结构，从而使我们能够提取描述其社会身份的相关属性，并将群体检测任务公式化为无监督学习问题，不需要通过手动标记的数据库进行监督学习，使我们能够直接将所提出的框架应用于不同的监控设置。我们在多个公共基准测试上评估了所提出的轨迹预测和群体检测框架，对于这两个任务，所提出的方法都证明了其相对于现有最先进方法更能够预测人类的社会行为。