Generating human-human motion interactions conditioned on textual
descriptions is a very useful application in many areas such as robotics,
gaming, animation, and the metaverse. Alongside this utility also comes a great
difficulty in modeling the highly dimensional inter-personal dynamics. In
addition, properly capturing the intra-personal diversity of interactions has a
lot of challenges. Current methods generate interactions with limited diversity
of intra-person dynamics due to the limitations of the available datasets and
conditioning strategies. For this, we introduce in2IN, a novel diffusion model
for human-human motion generation which is conditioned not only on the textual
description of the overall interaction but also on the individual descriptions
of the actions performed by each person involved in the interaction. To train
this model, we use a large language model to extend the InterHuman dataset with
individual descriptions. As a result, in2IN achieves state-of-the-art
performance in the InterHuman dataset. Furthermore, in order to increase the
intra-personal diversity on the existing interaction datasets, we propose
DualMDM, a model composition technique that combines the motions generated with
in2IN and the motions generated by a single-person motion prior pre-trained on
HumanML3D. As a result, DualMDM generates motions with higher individual
diversity and improves control over the intra-person dynamics while maintaining
inter-personal coherence.

生成人际动作互动可以根据文本描述，应用于机器人、游戏、动画和元宇宙等多个领域；本文提出了在人际动作生成中困扰的问题以及解决方案，包括使用扩展了 InterHuman 数据集的 in2IN 扩散模型以及结合 in2IN 和 HumanML3D 进行模型组合的 DualMDM，进一步提高了个体多样性和对个体动态的控制。