Existing deep Thermal InfraRed (TIR) trackers usually use the feature models
of RGB trackers for representation. However, these feature models learned on
RGB images are neither effective in representing TIR objects nor taking
fine-grained TIR information into consideration. To this end, we develop a
multi-task framework to learn the TIR-specific discriminative features and
fine-grained correlation features for TIR tracking. Specifically, we first use
an auxiliary classification network to guide the generation of TIR-specific
discriminative features for distinguishing the TIR objects belonging to
different classes. Second, we design a fine-grained aware module to capture
more subtle information for distinguishing the TIR objects belonging to the
same class. These two kinds of features complement each other and recognize TIR
objects in the levels of inter-class and intra-class respectively. These two
feature models are learned using a multi-task matching framework and are
jointly optimized on the TIR tracking task. In addition, we develop a
large-scale TIR training dataset to train the network for adapting the model to
the TIR domain. Extensive experimental results on three benchmarks show that
the proposed algorithm achieves a relative gain of 10% over the baseline and
performs favorably against the state-of-the-art methods. Codes and the proposed
TIR dataset are available at {this https URL}.

该论文提出了一种基于多任务学习的框架，学习适用于红外追踪的特征模型，并使用大规模红外训练数据集来优化该模型。在三个基准测试中，实验结果表明，该算法的相对增益达到 10％，表现优于现有的方法。