The problem of estimating a surface shape from its observed reflectance
properties still remains a challenging task in computer vision. The presence of
global illumination effects such as inter-reflections or cast shadows makes the
task particularly difficult for non-convex real-world surfaces.
State-of-the-art methods for calibrated photometric stereo address these issues
using convolutional neural networks (CNNs) that primarily aim to capture either
the spatial context among adjacent pixels or the photometric one formed by
illuminating a sample from adjacent directions.
In this paper, we bridge these two objectives and introduce an efficient
fully-convolutional architecture that can leverage both spatial and photometric
context simultaneously. In contrast to existing approaches that rely on
standard 2D CNNs and regress directly to surface normals, we argue that using
separable 4D convolutions and regressing to 2D Gaussian heat-maps severely
reduces the size of the network and makes inference more efficient. Our
experimental results on a real-world photometric stereo benchmark show that the
proposed approach outperforms the existing methods both in efficiency and
accuracy.

介绍了一种新颖的、基于可分离 4D 卷积的全卷积网络架构，将空间和光度一起利用，并回归到二维高斯热图，从而实现高效的表面形状估计。实验结果表明，所提出的方法在效率和准确性上均优于现有方法。