We propose an efficient method to learn deep local descriptors for
instance-level recognition. The training only requires examples of positive and
negative image pairs and is performed as metric learning of sum-pooled global
image descriptors. At inference, the local descriptors are provided by the
activations of internal components of the network. We demonstrate why such an
approach learns local descriptors that work well for image similarity
estimation with classical efficient match kernel methods. The experimental
validation studies the trade-off between performance and memory requirements of
the state-of-the-art image search approach based on match kernels. Compared to
existing local descriptors, the proposed ones perform better in two
instance-level recognition tasks and keep memory requirements lower. We
experimentally show that global descriptors are not effective enough at large
scale and that local descriptors are essential. We achieve state-of-the-art
performance, in some cases even with a backbone network as small as ResNet18.

该篇论文提出了一种用于实例级别识别的高效学习本地描述符的方法，它使用度量学习来训练深度神经网络，通过内部组件的激活传递局部描述符。与现有本地描述符相比，在两个实例级别识别任务中提供更好的性能和更低的存储器需求，这证明了全局描述符在大规模情况下不够有效，适当的局部性是不可或缺的。