Touch sensing is widely acknowledged to be important for dexterous robotic
manipulation, but exploiting tactile sensing for continuous, non-prehensile
manipulation is challenging. General purpose control techniques that are able
to effectively leverage tactile sensing as well as accurate physics models of
contacts and forces remain largely elusive, and it is unclear how to even
specify a desired behavior in terms of tactile percepts. In this paper, we take
a step towards addressing these issues by combining high-resolution tactile
sensing with data-driven modeling using deep neural network dynamics models. We
propose deep tactile MPC, a framework for learning to perform tactile servoing
from raw tactile sensor inputs, without manual supervision. We show that this
method enables a robot equipped with a GelSight-style tactile sensor to
manipulate a ball, analog stick, and 20-sided die, learning from unsupervised
autonomous interaction and then using the learned tactile predictive model to
reposition each object to user-specified configurations, indicated by a goal
tactile reading. Videos, visualizations and the code are available here:
this https URL

本文中，我们提出了一种深度触觉模型预测的方法，结合高分辨率触觉传感器，通过无监督自主交互生成模型以从原始触觉传感器输入进行学习，并将学习到的模型用于将物体重新定位到用户指定的配置，从而实现非握持操作的触觉控制。