Correspondence matching plays a crucial role in numerous robotics
applications. In comparison to conventional hand-crafted methods and recent
data-driven approaches, there is significant interest in plug-and-play
algorithms that make full use of pre-trained backbone networks for multi-scale
feature extraction and leverage hierarchical refinement strategies to generate
matched correspondences. The primary focus of this paper is to address the
limitations of deep feature matching (DFM), a state-of-the-art (SoTA)
plug-and-play correspondence matching approach. First, we eliminate the
pre-defined threshold employed in the hierarchical refinement process of DFM by
leveraging a more flexible nearest neighbor search strategy, thereby preventing
the exclusion of repetitive yet valid matches during the early stages. Our
second technical contribution is the integration of a patch descriptor, which
extends the applicability of DFM to accommodate a wide range of backbone
networks pre-trained across diverse computer vision tasks, including image
classification, semantic segmentation, and stereo matching. Taking into account
the practical applicability of our method in real-world robotics applications,
we also propose a novel patch descriptor distillation strategy to further
reduce the computational complexity of correspondence matching. Extensive
experiments conducted on three public datasets demonstrate the superior
performance of our proposed method. Specifically, it achieves an overall
performance in terms of mean matching accuracy of 0.68, 0.92, and 0.95 with
respect to the tolerances of 1, 3, and 5 pixels, respectively, on the HPatches
dataset, outperforming all other SoTA algorithms. Our source code, demo video,
and supplement are publicly available at mias.group/GCM.

本文的主要关注点是解决深度特征匹配（DFM）的局限性，通过采用更灵活的最近邻搜索策略并集成图像补丁描述符，扩展了 DFM 的适用范围，同时提出了一种新颖的图像补丁描述符精炼策略，进一步降低了对应匹配的计算复杂度，实验证明我们的方法在实际机器人应用中具有卓越的性能。

通过灵活的分层细化和补丁描述符精炼的广义匹配

Generalized Correspondence Matching via Flexible Hierarchical Refinement  and Patch Descriptor Distillation

Recent novel view synthesis methods obtain promising results for relatively
small scenes, e.g., indoor environments and scenes with a few objects, but tend
to fail for unbounded outdoor scenes with a single image as input. In this
paper, we introduce SAMPLING, a Scene-adaptive Hierarchical Multiplane Images
Representation for Novel View Synthesis from a Single Image based on improved
multiplane images (MPI). Observing that depth distribution varies significantly
for unbounded outdoor scenes, we employ an adaptive-bins strategy for MPI to
arrange planes in accordance with each scene image. To represent intricate
geometry and multi-scale details, we further introduce a hierarchical
refinement branch, which results in high-quality synthesized novel views. Our
method demonstrates considerable performance gains in synthesizing large-scale
unbounded outdoor scenes using a single image on the KITTI dataset and
generalizes well to the unseen Tanks and Temples dataset. The code and models
will be made public.

基于改进的多平面图像（MPI），本文介绍了一种适应场景的分层多平面图像表示，用于从单幅图像合成新视角，观察到对于无界户外场景，深度分布变化显著，因此采用自适应分组策略来排列平面，进一步引入了分层细化分支，以呈现精细的几何和多尺度细节，该方法在 KITTI 数据集上合成大规模无界户外场景并具有显著的性能提升，在未见过的 Tanks and Temples 数据集上具有较好的泛化性能，代码和模型将公开。