Due to difficulties in acquiring ground truth depth of equirectangular (360)
images, the quality and quantity of equirectangular depth data today is
insufficient to represent the various scenes in the world. Therefore, 360 depth
estimation studies, which relied solely on supervised learning, are destined to
produce unsatisfactory results. Although self-supervised learning methods
focusing on equirectangular images (EIs) are introduced, they often have
incorrect or non-unique solutions, causing unstable performance. In this paper,
we propose 360 monocular depth estimation methods which improve on the areas
that limited previous studies. First, we introduce a self-supervised 360 depth
learning method that only utilizes gravity-aligned videos, which has the
potential to eliminate the needs for depth data during the training procedure.
Second, we propose a joint learning scheme realized by combining supervised and
self-supervised learning. The weakness of each learning is compensated, thus
leading to more accurate depth estimation. Third, we propose a non-local fusion
block, which can further retain the global information encoded by vision
transformer when reconstructing the depths. With the proposed methods, we
successfully apply the transformer to 360 depth estimations, to the best of our
knowledge, which has not been tried before. On several benchmarks, our approach
achieves significant improvements over previous works and establishes a state
of the art.

本文提出了一个 360 度深度估计的方法，结合自监督学习和有监督学习，并使用全局信息编码的视觉 transformer 实现全局非局部融合块，提高了深度估计的准确性和整体效果。在多个基准测试中，我们的方法在之前的研究工作中取得了显著的改进和最先进的表现。