Estimating depth from a sequence of posed RGB images is a fundamental
computer vision task, with applications in augmented reality, path planning
etc. Prior work typically makes use of previous frames in a multi view stereo
framework, relying on matching textures in a local neighborhood. In contrast,
our model leverages historical predictions by giving the latest 3D geometry
data as an extra input to our network. This self-generated geometric hint can
encode information from areas of the scene not covered by the keyframes and it
is more regularized when compared to individual predicted depth maps for
previous frames. We introduce a Hint MLP which combines cost volume features
with a hint of the prior geometry, rendered as a depth map from the current
camera location, together with a measure of the confidence in the prior
geometry. We demonstrate that our method, which can run at interactive speeds,
achieves state-of-the-art estimates of depth and 3D scene reconstruction in
both offline and incremental evaluation scenarios.

我们的方法通过在网络中添加最新的 3D 几何数据作为额外输入，结合之前的几何提示，利用深度和 3D 场景重建领域中的先前工作，实现了与实时交互速度相比达到最先进的深度估计和场景重建。