Finding point-level correspondences is a fundamental problem in ultrasound
(US), since it can enable US landmark tracking for intraoperative image
guidance in different surgeries, including head and neck. Most existing US
tracking methods, e.g., those based on optical flow or feature matching, were
initially designed for RGB images before being applied to US. Therefore domain
shift can impact their performance. Training could be supervised by
ground-truth correspondences, but these are expensive to acquire in US. To
solve these problems, we propose a self-supervised pixel-level tracking model
called PIPsUS. Our model can track an arbitrary number of points in one forward
pass and exploits temporal information by considering multiple, instead of just
consecutive, frames. We developed a new self-supervised training strategy that
utilizes a long-term point-tracking model trained for RGB images as a teacher
to guide the model to learn realistic motions and use data augmentation to
enforce tracking from US appearance. We evaluate our method on neck and oral US
and echocardiography, showing higher point tracking accuracy when compared with
fast normalized cross-correlation and tuned optical flow. Code will be
available once the paper is accepted.

我们提出了一种自我监督的像素级追踪模型，名为 PIPsUS，该模型可以在单次前向传递中追踪任意数量的点，并利用多个而不仅仅是连续的帧考虑时间信息。我们的方法在颈部和口腔超声以及超声心动图上进行了评估，与快速归一化互相关和调整的光流相比，显示出更高的点追踪准确性。