In this paper, we develop a new approach of spatially supervised recurrent
convolutional neural networks for visual object tracking. Our recurrent
convolutional network exploits the history of locations as well as the
distinctive visual features learned by the deep neural networks. Inspired by
recent bounding box regression methods for object detection, we study the
regression capability of Long Short-Term Memory (LSTM) in the temporal domain,
and propose to concatenate high-level visual features produced by convolutional
networks with region information. In contrast to existing deep learning based
trackers that use binary classification for region candidates, we use
regression for direct prediction of the tracking locations both at the
convolutional layer and at the recurrent unit. Our extensive experimental
results and performance comparison with state-of-the-art tracking methods on
challenging benchmark video tracking datasets shows that our tracker is more
accurate and robust while maintaining low computational cost. For most test
video sequences, our method achieves the best tracking performance, often
outperforms the second best by a large margin.

本文提出了一种新的空间监督递归卷积神经网络，用于视觉对象跟踪，通过研究长短期记忆和区域信息的回归能力，结合卷积网络产生的高层视觉特征直接预测跟踪位置，相较于现有的深度学习跟踪器，我们的跟踪器在保持低计算成本的同时更加准确和鲁棒，实验结果表明在多个数据集上均表现优异，常常优于排名第二的跟踪器。