The growing availability of commodity RGB-D cameras has boosted the
applications in the field of scene understanding. However, as a fundamental
scene understanding task, surface normal estimation from RGB-D data lacks
thorough investigation. In this paper, a hierarchical fusion network with
adaptive feature re-weighting is proposed for surface normal estimation from a
single RGB-D image. Specifically, the features from color image and depth are
successively integrated at multiple scales to ensure global surface smoothness
while preserving visually salient details. Meanwhile, the depth features are
re-weighted with a confidence map estimated from depth before merging into the
color branch to avoid artifacts caused by input depth corruption. Additionally,
a hybrid multi-scale loss function is designed to learn accurate normal
estimation given noisy ground-truth dataset. Extensive experimental results
validate the effectiveness of the fusion strategy and the loss design,
outperforming state-of-the-art normal estimation schemes.

本论文提出了一种基于 RGB-D 图像的表面法向估计的分层融合网络和自适应特征再加权，设计了混合多尺度损失函数来学习准确的法向估计，实验证明了该方法在场景理解中的有效性。