Observing that Semantic features learned in an image classification task and Appearance features learned in a similarity matching task complement each other, we build a twofold Siamese network, named SA-Siam, for real-time object tracking. SA-Siam is composed of a semantic branch and an appearance branch. Each branch is a similarity-learning Siamese network. An important design choice in SA-Siam is to separately train the two branches to keep the heterogeneity of the two types of features. In addition, we propose a channel attention mechanism for the semantic branch. Channel-wise weights are computed according to the channel activations around the target position. While the inherited architecture from SiamFC \cite{SiamFC} allows our tracker to operate beyond real-time, the twofold design and the attention mechanism significantly improve the tracking performance. The proposed SA-Siam outperforms all other real-time trackers by a large margin on OTB-2013/50/100 benchmarks.

提出了一种基于Siamese网络的实时物体跟踪方法，利用图像分类任务中学习到的语义特征和相似度匹配任务中学习到的外观特征相结合，其中包括两个支路，一个用于语义特征学习，另一个用于外观特征学习，并针对前者提出了通道注意力机制，同时在OTB-2013/50/100数据集上取得了比其他实时跟踪器更好的性能。

用于实时目标追踪的双重孪生网络