Image keypoints and descriptors play a crucial role in many visual
measurement tasks. In recent years, deep neural networks have been widely used
to improve the performance of keypoint and descriptor extraction. However, the
conventional convolution operations do not provide the geometric invariance
required for the descriptor. To address this issue, we propose the Sparse
Deformable Descriptor Head (SDDH), which learns the deformable positions of
supporting features for each keypoint and constructs deformable descriptors.
Furthermore, SDDH extracts descriptors at sparse keypoints instead of a dense
descriptor map, which enables efficient extraction of descriptors with strong
expressiveness. In addition, we relax the neural reprojection error (NRE) loss
from dense to sparse to train the extracted sparse descriptors. Experimental
results show that the proposed network is both efficient and powerful in
various visual measurement tasks, including image matching, 3D reconstruction,
and visual relocalization.

本研究介绍了 Sparse Deformable Descriptor Head（SDDH）模型，它通过采用少量关键点来提高描述符抽取的效率和表现，适用于多种视觉测量任务，包括图像匹配，三维重建和视觉重定位。