The dominant CNN-based methods for cross-view image geo-localization rely on
polar transform and fail to model global correlation. We propose a pure
transformer-based approach (TransGeo) to address these limitations from a
different perspective. TransGeo takes full advantage of the strengths of
transformer related to global information modeling and explicit position
information encoding. We further leverage the flexibility of transformer input
and propose an attention-guided non-uniform cropping method, so that
uninformative image patches are removed with negligible drop on performance to
reduce computation cost. The saved computation can be reallocated to increase
resolution only for informative patches, resulting in performance improvement
with no additional computation cost. This "attend and zoom-in" strategy is
highly similar to human behavior when observing images. Remarkably, TransGeo
achieves state-of-the-art results on both urban and rural datasets, with
significantly less computation cost than CNN-based methods. It does not rely on
polar transform and infers faster than CNN-based methods. Code is available at
this https URL

本研究提出了一种基于纯 Transformer 的方法（TransGeo）来针对交叉视图图像地理定位中的局限性，通过全局信息建模和显式位置信息编码等优势，结合了注意力引导的非均匀裁剪方法以实现性能优化，结果表明该方法在城市和乡村数据集上取得了最优结果，并显著降低了计算成本。