We propose a novel geometric and photometric 3D mapping pipeline for accurate and real-time scene reconstruction from monocular images. To achieve this, we leverage recent advances in dense monocular SLAM and real-time hierarchical volumetric neural radiance fields. Our insight is that dense monocular SLAM provides the right information to fit a neural radiance field of the scene in real-time, by providing accurate pose estimates and depth-maps with associated uncertainty. With our proposed uncertainty-based depth loss, we achieve not only good photometric accuracy, but also great geometric accuracy. In fact, our proposed pipeline achieves better geometric and photometric accuracy than competing approaches (up to 179% better PSNR and 86% better L1 depth), while working in real-time and using only monocular images.

提出了一种新的基于几何和光学的三维地图制图方法，利用稠密单目SLAM和实时分层体积神经辐射场技术，通过提供估计准确的位姿和深度图的相关不确定性，实时适应神经辐射场的场景。通过采用提出的基于不确定性的深度损失，实现了良好光学和几何精度，在实时和单目成像的情况下比竞争方法更精确(最高提高179%的PSNR和86%的L1深度)。

NeRF-SLAM：神经辐射场实时稠密单目SLAM