An accurate detection and tracking of devices such as guiding catheters in
live X-ray image acquisitions is an essential prerequisite for endovascular
cardiac interventions. This information is leveraged for procedural guidance,
e.g., directing stent placements. To ensure procedural safety and efficacy,
there is a need for high robustness no failures during tracking. To achieve
that, one needs to efficiently tackle challenges, such as: device obscuration
by contrast agent or other external devices or wires, changes in field-of-view
or acquisition angle, as well as the continuous movement due to cardiac and
respiratory motion. To overcome the aforementioned challenges, we propose a
novel approach to learn spatio-temporal features from a very large data cohort
of over 16 million interventional X-ray frames using self-supervision for image
sequence data. Our approach is based on a masked image modeling technique that
leverages frame interpolation based reconstruction to learn fine inter-frame
temporal correspondences. The features encoded in the resulting model are
fine-tuned downstream. Our approach achieves state-of-the-art performance and
in particular robustness compared to ultra optimized reference solutions (that
use multi-stage feature fusion, multi-task and flow regularization). The
experiments show that our method achieves 66.31% reduction in maximum tracking
error against reference solutions (23.20% when flow regularization is used);
achieving a success score of 97.95% at a 3x faster inference speed of 42
frames-per-second (on GPU). The results encourage the use of our approach in
various other tasks within interventional image analytics that require
effective understanding of spatio-temporal semantics.

通过学习超过 1600 万干预 X 光帧的数据，我们提出了一种新的方法来实现设备的准确检测和跟踪，从而提高干预心血管手术的安全性和效果，同时在干预图像分析中的其他任务中更好地理解时空语义。