We present a multi-cue metric learning framework to tackle the popular yet unsolved Multi-Object Tracking (MOT) problem. One of the key challenges of tracking methods is to effectively compute a similarity score that models multiple cues from the past such as object appearance, motion, or even interactions. This is particularly challenging when objects get occluded or share similar appearance properties with surrounding objects. To address this challenge, we cast the problem as a metric learning task that jointly reasons on multiple cues across time. Our framework learns to encode long-term temporal dependencies across multiple cues with a hierarchical Recurrent Neural Network. We demonstrate the strength of our approach by tracking multiple objects using their appearance, motion, and interactions. Our method outperforms previous works by a large margin on multiple publicly available datasets including the challenging MOT benchmark.

本文研究的是多目标跟踪中数据关联错误的问题，提出了一种基于RNN的多信号联合跟踪方法，能够编码多信号的长期时间依赖性，有效地解决了遮挡和外观相似等问题，取得了比之前公开数据集更好的跟踪效果。

追踪不可追踪的物体：学习如何跟踪多个线索及其长期依赖性