We develop a method that recovers the surface, materials, and illumination of
a scene from its posed multi-view images. In contrast to prior work, it does
not require any additional data and can handle glossy objects or bright
lighting. It is a progressive inverse rendering approach, which consists of
three stages. First, we reconstruct the scene radiance and signed distance
function (SDF) with our novel regularization strategy for specular reflections.
Our approach considers both the diffuse and specular colors, which allows for
handling complex view-dependent lighting effects for surface reconstruction.
Second, we distill light visibility and indirect illumination from the learned
SDF and radiance field using learnable mapping functions. Third, we design a
method for estimating the ratio of incoming direct light represented via
Spherical Gaussians reflected in a specular manner and then reconstruct the
materials and direct illumination of the scene. Experimental results
demonstrate that the proposed method outperforms the current state-of-the-art
in recovering surfaces, materials, and lighting without relying on any
additional data.

该研究提出一种逆向渲染方法，通过多视角图像恢复场景的表面、材质和光照，可以处理具有光泽物体或亮光照明场景，无需使用附加数据，三个阶段的方法通过漫反射和镜面颜色考虑复杂视角依赖光照效果对表面重构，该方法在不依赖任何附加数据的情况下，优于当前状态下表面材质和光照恢复的最佳方法。