Prediction of human actions in social interactions has important applications
in the design of social robots or artificial avatars. In this paper, we focus
on a unimodal representation of interactions and propose to tackle interaction
generation in a data-driven fashion. In particular, we model human interaction
generation as a discrete multi-sequence generation problem and present
SocialInteractionGAN, a novel adversarial architecture for conditional
interaction generation. Our model builds on a recurrent encoder-decoder
generator network and a dual-stream discriminator, that jointly evaluates the
realism of interactions and individual action sequences and operates at
different time scales. Crucially, contextual information on interacting
participants is shared among agents and reinjected in both the generation and
the discriminator evaluation processes. Experiments show that albeit dealing
with low dimensional data, SocialInteractionGAN succeeds in producing high
realism action sequences of interacting people, comparing favorably to a
diversity of recurrent and convolutional discriminator baselines, and we argue
that this work will constitute a first stone towards higher dimensional and
multimodal interaction generation. Evaluations are conducted using classical
GAN metrics, that we specifically adapt for discrete sequential data. Our model
is shown to properly learn the dynamics of interaction sequences, while
exploiting the full range of available actions.

本文介绍了 SocialInteractionGAN—— 一种新颖的基于数据驱动的对抗性生成网络框架，其旨在以单模态展示的相互作用为重点，以离散多序列生成问题为基础，以建立在递归编码器 - 解码器生成网络和双流鉴别器之上的方法来处理相互作用的生成问题。实验结果表明，SocialInteractionGAN 能成功地生成以人为中心的高真实感互动动作序列，这对社交机器人或人工头像的设计具有重要应用。