Generative adversarial imitation learning (GAIL) has shown promising results by taking advantage of generative adversarial nets, especially in the field of robot learning. However, the requirement of isolated single modal demonstrations limits the scalability of the approach to real world scenarios such as autonomous vehicles' demand for a proper understanding of human drivers' behavior. In this paper, we propose a novel multi-modal GAIL framework, named Triple-GAIL, that is able to learn skill selection and imitation jointly from both expert demonstrations and continuously generated experiences with data augmentation purpose by introducing an auxiliary skill selector. We provide theoretical guarantees on the convergence to optima for both of the generator and the selector respectively. Experiments on real driver trajectories and real-time strategy game datasets demonstrate that Triple-GAIL can better fit multi-modal behaviors close to the demonstrators and outperforms state-of-the-art methods.

本文提出了一种名为Triple-GAIL的新型多模GAIL框架，能够从专家演示和连续生成的经验中学习技能选择和模仿，引入辅助技能选择器进行数据增强，从而更好地适应展示者的多模式行为，并在现实驾驶员轨迹和实时策略游戏数据集上，表现出超越前沿性能的实验结果。

Triple-GAIL: 一种基于生成对抗网络的多模态模仿学习框架