Conventional methods of 3D object generative modeling learn volumetric predictions using deep networks with 3D convolutional operations, which are direct analogies to classical 2D ones. However, these methods are computationally wasteful in attempt to predict 3D shapes, where information is rich only on the surfaces. In this paper, we propose a novel 3D generative modeling framework to efficiently generate object shapes in the form of dense point clouds. We use 2D convolutional operations to predict the 3D structure from multiple viewpoints and jointly apply geometric reasoning with 2D projection optimization. We introduce the pseudo-renderer, a differentiable module to approximate the true rendering operation, to synthesize novel depth maps for optimization. Experimental results for single-image 3D object reconstruction tasks show that we outperforms state-of-the-art methods in terms of shape similarity and prediction density.

本文提出了一种新的3D生成建模框架，使用2D卷积运算从多个视角预测3D结构，并联合应用几何推理和2D投影优化来高效地生成以密集点云形式呈现的物体形状，并引入伪渲染器来合成优化的新深度图，在单张图像3D对象重建任务中表现了优越的形状相似性和预测密度。

稠密三维物体重建的高效点云生成学习