Learning-based approaches to robotic manipulation are limited by the
scalability of data collection and accessibility of labels. In this paper, we
present a multi-task domain adaptation framework for instance grasping in
cluttered scenes by utilizing simulated robot experiments. Our neural network
takes monocular RGB images and the instance segmentation mask of a specified
target object as inputs, and predicts the probability of successfully grasping
the specified object for each candidate motor command. The proposed transfer
learning framework trains a model for instance grasping in simulation and uses
a domain-adversarial loss to transfer the trained model to real robots using
indiscriminate grasping data, which is available both in simulation and the
real world. We evaluate our model in real-world robot experiments, comparing it
with alternative model architectures as well as an indiscriminate grasping
baseline.

本文提出一种基于多任务领域适应的框架来解决机器人抓取的训练数据收集和标注的问题，借助仿真机器人实验来对杂乱场景下的抓取进行实例化，并通过领域对抗性损失将训练好的模型转移到真实机器人系统中，经过实际机器人实验的评估表明本文所提出的模型准确性比其他模型结构及基准模型都要高。