Single-View depth estimation using the CNNs trained from unlabelled videos
has shown significant promise. However, excellent results have mostly been
obtained in street-scene driving scenarios, and such methods often fail in
other settings, particularly indoor videos taken by handheld devices. In this
work, we establish that the complex ego-motions exhibited in handheld settings
are a critical obstacle for learning depth. Our fundamental analysis suggests
that the rotation behaves as noise during training, as opposed to the
translation (baseline) which provides supervision signals. To address the
challenge, we propose a data pre-processing method that rectifies training
images by removing their relative rotations for effective learning. The
significantly improved performance validates our motivation. Towards end-to-end
learning without requiring pre-processing, we propose an Auto-Rectify Network
with novel loss functions, which can automatically learn to rectify images
during training. Consequently, our results outperform the previous unsupervised
SOTA method by a large margin on the challenging NYUv2 dataset. We also
demonstrate the generalization of our trained model in ScanNet and Make3D, and
the universality of our proposed learning method on 7-Scenes and KITTI
datasets.

提出了一种基于自动矫正网络的数据预处理方法，解决了手持场景下旋转运动对单视角深度估计的干扰问题，并针对不同数据集验证了该方法的有效性及通用性。