This work tackles the challenging task of achieving real-time novel view synthesis on various scenes, including highly reflective objects and unbounded outdoor scenes. Existing real-time rendering methods, especially those based on meshes, often have subpar performance in modeling surfaces with rich view-dependent appearances. Our key idea lies in leveraging meshes for rendering acceleration while incorporating a novel approach to parameterize view-dependent information. We decompose the color into diffuse and specular, and model the specular color in the reflected direction based on a neural environment map. Our experiments demonstrate that our method achieves comparable reconstruction quality for highly reflective surfaces compared to state-of-the-art offline methods, while also efficiently enabling real-time rendering on edge devices such as smartphones.

该研究通过利用网格进行加速渲染的方法，结合新颖的视角相关信息参数化方法，解决了实时渲染中对高反射物体和无约束室外场景的挑战。通过将颜色分解为漫反射和镜面反射，并基于神经环境贴图模拟反射方向上的镜面颜色，实验结果表明，我们的方法在高反射表面的重建质量上与最先进的离线方法相当，同时还能在智能手机等边缘设备上实现高效的实时渲染。

重新构想：移动设备实时镜面渲染