RGBT tracking receives a surge of interest in the computer vision community,
but this research field lacks a large-scale and high-diversity benchmark
dataset, which is essential for both the training of deep RGBT trackers and the
comprehensive evaluation of RGBT tracking methods. To this end, we present a
Large-scale High-diversity benchmark for RGBT tracking (LasHeR) in this work.
LasHeR consists of 1224 visible and thermal infrared video pairs with more than
730K frame pairs in total. Each frame pair is spatially aligned and manually
annotated with a bounding box, making the dataset well and densely annotated.
LasHeR is highly diverse capturing from a broad range of object categories,
camera viewpoints, scene complexities and environmental factors across seasons,
weathers, day and night. We conduct a comprehensive performance evaluation of
12 RGBT tracking algorithms on the LasHeR dataset and present detailed analysis
to clarify the research room in RGBT tracking. In addition, we release the
unaligned version of LasHeR to attract the research interest for alignment-free
RGBT tracking, which is a more practical task in real-world applications. The
datasets and evaluation protocols are available at:
this https URL

本文介绍了一个针对 RGBT 跟踪的大规模高多样性基准测试数据集 LasHeR，该数据集由 1224 个可见光和热红外视频对组成，共有超过 730K 帧，每个帧对都进行了精细的人工标注。在此基础上，我们对 12 种 RGBT 跟踪算法进行了全面评估，并展示了详细分析，旨在澄清 RGBT 跟踪领域中的研究空间。此外，我们还发布了 LasHeR 的未对齐版本，以吸引对无对齐 RGBT 跟踪更实际的任务感兴趣的研究者。