New transformer networks have been integrated into object tracking pipelines
and have demonstrated strong performance on the latest benchmarks. This paper
focuses on understanding how transformer trackers behave under adversarial
attacks and how different attacks perform on tracking datasets as their
parameters change. We conducted a series of experiments to evaluate the
effectiveness of existing adversarial attacks on object trackers with
transformer and non-transformer backbones. We experimented on 7 different
trackers, including 3 that are transformer-based, and 4 which leverage other
architectures. These trackers are tested against 4 recent attack methods to
assess their performance and robustness on VOT2022ST, UAV123 and GOT10k
datasets. Our empirical study focuses on evaluating adversarial robustness of
object trackers based on bounding box versus binary mask predictions, and
attack methods at different levels of perturbations. Interestingly, our study
found that altering the perturbation level may not significantly affect the
overall object tracking results after the attack. Similarly, the sparsity and
imperceptibility of the attack perturbations may remain stable against
perturbation level shifts. By applying a specific attack on all transformer
trackers, we show that new transformer trackers having a stronger
cross-attention modeling achieve a greater adversarial robustness on tracking
datasets, such as VOT2022ST and GOT10k. Our results also indicate the necessity
for new attack methods to effectively tackle the latest types of transformer
trackers. The codes necessary to reproduce this study are available at
this https URL

新的 Transformer 跟踪器在最新的基准测试上表现出高效能，该研究关注于理解 Transformer 跟踪器在对抗性攻击中的行为以及各种攻击方法在参数变化时对跟踪数据集的表现。我们的实证研究发现，攻击干扰的程度和攻击干扰的稀疏性可能在不同干扰级别的变化下保持稳定。通过对所有 Transformer 跟踪器应用特定攻击，我们展示了具有更强交叉注意建模的新 Transformer 跟踪器在跟踪数据集上具有更强的对抗鲁棒性。同时，我们的研究结果也表明需要新的攻击方法来有效应对最新类型的 Transformer 跟踪器。