The complex dynamicity of open-world objects presents non-negligible
challenges for multi-object tracking (MOT), often manifested as severe
deformations, fast motion, and occlusions. Most methods that solely depend on
coarse-grained object cues, such as boxes and the overall appearance of the
object, are susceptible to degradation due to distorted internal relationships
of dynamic objects. To address this problem, this work proposes NetTrack, an
efficient, generic, and affordable tracking framework to introduce fine-grained
learning that is robust to dynamicity. Specifically, NetTrack constructs a
dynamicity-aware association with a fine-grained Net, leveraging point-level
visual cues. Correspondingly, a fine-grained sampler and matching method have
been incorporated. Furthermore, NetTrack learns object-text correspondence for
fine-grained localization. To evaluate MOT in extremely dynamic open-world
scenarios, a bird flock tracking (BFT) dataset is constructed, which exhibits
high dynamicity with diverse species and open-world scenarios. Comprehensive
evaluation on BFT validates the effectiveness of fine-grained learning on
object dynamicity, and thorough transfer experiments on challenging open-world
benchmarks, i.e., TAO, TAO-OW, AnimalTrack, and GMOT-40, validate the strong
generalization ability of NetTrack even without finetuning. Project page:
this https URL

NetTrack 是一个高效、通用、经济实惠的追踪框架，通过引入细粒度学习，利用点级视觉线索来构建一个对动态性鲁棒的动态感知关联。它还学习了细粒度的样本选择和匹配方法，以及细粒度的定位。在鸟群追踪 (Bird Flock Tracking) 数据集和一系列具有高动态性的开放世界基准测试中的全面评估验证了 NetTrack 在目标动态性方面的有效性，即使没有微调，在挑战性的开放世界基准测试中也证实了 NetTrack 的强大泛化能力。