Maritime surveillance is vital to mitigate illegal activities such as drug
smuggling, illegal fishing, and human trafficking. Vision-based maritime
surveillance is challenging mainly due to visibility issues at night, which
results in failures in re-identifying vessels and detecting suspicious
activities. In this paper, we introduce a thermal, vision-based approach for
maritime surveillance with object tracking, vessel re-identification, and
suspicious activity detection capabilities. For vessel re-identification, we
propose a novel viewpoint-independent algorithm which compares features of the
sides of the vessel separately (separate side-spaces) leveraging shape
information in the absence of color features. We propose techniques to adapt
tracking and activity detection algorithms for the thermal domain and train
them using a thermal dataset we created. This dataset will be the first
publicly available benchmark dataset for thermal maritime surveillance. Our
system is capable of re-identifying vessels with an 81.8% Top1 score and
identifying suspicious activities with a 72.4\% frame mAP score; a new
benchmark for each task in the thermal domain.

我们提出了一种基于热视觉的海上监控方法，具备目标跟踪、船只重识别和可疑活动检测的能力，并使用我们创建的热数据集对其进行训练，该数据集将成为热海上监控的首个公开基准数据集。我们的系统能够以 81.8% 的 Top1 得分重新识别船只，以 72.4% 的帧 mAP 得分识别可疑活动，为热领域中的每个任务建立了一个新的基准。