In this paper, we study imitation learning under the challenging setting of:
(1) only a single demonstration, (2) no further data collection, and (3) no
prior task or object knowledge. We show how, with these constraints, imitation
learning can be formulated as a combination of trajectory transfer and unseen
object pose estimation. To explore this idea, we provide an in-depth study on
how state-of-the-art unseen object pose estimators perform for one-shot
imitation learning on ten real-world tasks, and we take a deep dive into the
effects that camera calibration, pose estimation error, and spatial
generalisation have on task success rates. For videos, please visit
this https URL

本文研究了在只有一个示范、没有进一步的数据收集和没有先前的任务或对象知识的挑战性环境下的模仿学习，并展示了如何在这些限制条件下将模仿学习表述为轨迹转移和未见物体姿态估计的组合。通过对十个真实世界任务进行一次性模仿学习，我们深入研究了最先进的未见物体姿态估计器在性能上的表现，并深入了解了相机标定、姿态估计误差和空间泛化对任务成功率的影响。