Camera localization aims to estimate 6 DoF camera poses from RGB images.
Traditional methods detect and match interest points between a query image and
a pre-built 3D model. Recent learning-based approaches encode scene structures
into a specific convolutional neural network (CNN) and thus are able to predict
dense coordinates from RGB images. However, most of them require re-training or
re-adaption for a new scene and have difficulties in handling large-scale
scenes due to limited network capacity. We present a new method for scene
agnostic camera localization using dense scene matching (DSM), where a cost
volume is constructed between a query image and a scene. The cost volume and
the corresponding coordinates are processed by a CNN to predict dense
coordinates. Camera poses can then be solved by PnP algorithms. In addition,
our method can be extended to temporal domain, which leads to extra performance
boost during testing time. Our scene-agnostic approach achieves comparable
accuracy as the existing scene-specific approaches, such as KFNet, on the
7scenes and Cambridge benchmark. This approach also remarkably outperforms
state-of-the-art scene-agnostic dense coordinate regression network SANet. The
Code is available at this https URL

本文提出一种基于 DSM 和 CNN 的相机场景无关的定位方法，可应用于大范围场景，能够在时间领域实现额外的性能提升，大大优于 SANet 等现有方法。