Visual Odometry (VO) is vital for the navigation of autonomous systems, providing accurate position and orientation estimates at reasonable costs. While traditional VO methods excel in some conditions, they struggle with challenges like variable lighting and motion blur. Deep learning-based VO, though more adaptable, can face generalization problems in new environments. Addressing these drawbacks, this paper presents a novel hybrid visual odometry (VO) framework that leverages pose-only supervision, offering a balanced solution between robustness and the need for extensive labeling. We propose two cost-effective and innovative designs: a self-supervised homographic pre-training for enhancing optical flow learning from pose-only labels and a random patch-based salient point detection strategy for more accurate optical flow patch extraction. These designs eliminate the need for dense optical flow labels for training and significantly improve the generalization capability of the system in diverse and challenging environments. Our pose-only supervised method achieves competitive performance on standard datasets and greater robustness and generalization ability in extreme and unseen scenarios, even compared to dense optical flow-supervised state-of-the-art methods.

该论文提出了一种新的混合视觉里程计（VO）框架，利用仅姿态监督来平衡鲁棒性和对大量标注的需求，并采用自我监督的同态学习和随机基于补丁的显著点检测策略，提高系统在各种具有挑战性的环境中的泛化能力。该方法在标准数据集上具有竞争力的性能，并在极端和未知场景中表现出更高的鲁棒性和泛化能力，甚至超过基于密集光流监督的最先进方法。

带姿态监督的显著稀疏视觉里程计