Learned local descriptors based on Convolutional Neural Networks (CNNs) have
achieved significant improvements on patch-based benchmarks, whereas not having
demonstrated strong generalization ability on recent benchmarks of image-based
3D reconstruction. In this paper, we mitigate this limitation by proposing a
novel local descriptor learning approach that integrates geometry constraints
from multi-view reconstructions, which benefits the learning process in terms
of data generation, data sampling and loss computation. We refer to the
proposed descriptor as GeoDesc, and demonstrate its superior performance on
various large-scale benchmarks, and in particular show its great success on
challenging reconstruction tasks. Moreover, we provide guidelines towards
practical integration of learned descriptors in Structure-from-Motion (SfM)
pipelines, showing the good trade-off that GeoDesc delivers to 3D
reconstruction tasks between accuracy and efficiency.

本文提出一种新颖的基于几何约束的局部描述符学习方法 ——GeoDesc，旨在改善学习局部描述符在图片三维重建中的泛化性能不足的问题。结果表明，GeoDesc 在各种大型基准测试中表现出优异的性能，并在具有挑战性的重建任务中显著成功。此外，本文提供了在 SfM 流水线中实际集成学习描述符的指南，展示了 GeoDesc 在精度和效率之间能够提供的良好平衡。