A novel depth super-resolution approach for RGB-D sensors is presented. It
disambiguates depth super-resolution through high-resolution photometric clues
and, symmetrically, it disambiguates uncalibrated photometric stereo through
low-resolution depth cues. To this end, an RGB-D sequence is acquired from the
same viewing angle, while illuminating the scene from various uncalibrated
directions. This sequence is handled by a variational framework which fits
high-resolution shape and reflectance, as well as lighting, to both the
low-resolution depth measurements and the high-resolution RGB ones. The key
novelty consists in a new PDE-based photometric stereo regularizer which
implicitly ensures surface regularity. This allows to carry out depth
super-resolution in a purely data-driven manner, without the need for any
ad-hoc prior or material calibration. Real-world experiments are carried out
using an out-of-the-box RGB-D sensor and a hand-held LED light source.

本文提出了一种新颖的 RGB-D 传感器深度超分辨率方法，该方法通过高分辨率光度线索澄清深度超分辨率，并对未校正的光度立体进行低分辨率深度线索的澄清。使用变分方法处理 RGB-D 序列，并通过新的 PDE 光度立体正则化器隐式地保持了表面的规则性。实验表明，该方法能够在无需任何特殊先验知识或材料校准的情况下，在现实世界的环境中拍摄高质量的深度图像。