Given the recent advances in depth prediction from Convolutional Neural Networks (CNNs), this paper investigates how predicted depth maps from a deep neural network can be deployed for accurate and dense monocular reconstruction. We propose a method where CNN-predicted dense depth maps are naturally fused together with depth measurements obtained from direct monocular SLAM. Our fusion scheme privileges depth prediction in image locations where monocular SLAM approaches tend to fail, e.g. along low-textured regions, and vice-versa. We demonstrate the use of depth prediction for estimating the absolute scale of the reconstruction, hence overcoming one of the major limitations of monocular SLAM. Finally, we propose a framework to efficiently fuse semantic labels, obtained from a single frame, with dense SLAM, yielding semantically coherent scene reconstruction from a single view. Evaluation results on two benchmark datasets show the robustness and accuracy of our approach.

本文研究了如何利用卷积神经网络深度预测图来进行准确而密集的单目重建，并提出了一种将CNN预测的密集深度图与直接单目SLAM测量所获得的深度测量自然融合的方法，证明了这种方法在场景重建绝对尺度估计等方面的鲁棒性和准确性。最终，提出了一个将语义标签与单个帧的密集SLAM高效融合的框架，能够从单个视图中获得语义一致的场景重建。

CNN-SLAM: 实时稠密单目 SLAM 与深度预测学习