We present Skill Transformer, an approach for solving long-horizon robotic tasks by combining conditional sequence modeling and skill modularity. Conditioned on egocentric and proprioceptive observations of a robot, Skill Transformer is trained end-to-end to predict both a high-level skill (e.g., navigation, picking, placing), and a whole-body low-level action (e.g., base and arm motion), using a transformer architecture and demonstration trajectories that solve the full task. It retains the composability and modularity of the overall task through a skill predictor module while reasoning about low-level actions and avoiding hand-off errors, common in modular approaches. We test Skill Transformer on an embodied rearrangement benchmark and find it performs robust task planning and low-level control in new scenarios, achieving a 2.5x higher success rate than baselines in hard rearrangement problems.

通过结合条件序列建模和技能模块化，我们提出了Skill Transformer方法，用于解决长期规划的机器人任务，并通过Transformer架构和演示轨迹对高级技能和低级动作进行端到端训练，并通过技能预测模块保持整体任务的组合性和模块化，同时考虑低级动作并避免常见的模块化方法中的交接错误。在具有挑战性的重新排列问题中，我们对Skill Transformer进行了测试，发现其在新场景中执行稳健的任务规划和低级控制，并在成功率上比基线提高了2.5倍。

技能变换器：移动操纵的一体化策略