Human perception of 3D shapes goes beyond reconstructing them as a set of
points or a composition of geometric primitives: we also effortlessly
understand higher-level shape structure such as the repetition and reflective
symmetry of object parts. In contrast, recent advances in 3D shape sensing
focus more on low-level geometry but less on these higher-level relationships.
In this paper, we propose 3D shape programs, integrating bottom-up recognition
systems with top-down, symbolic program structure to capture both low-level
geometry and high-level structural priors for 3D shapes. Because there are no
annotations of shape programs for real shapes, we develop neural modules that
not only learn to infer 3D shape programs from raw, unannotated shapes, but
also to execute these programs for shape reconstruction. After initial
bootstrapping, our end-to-end differentiable model learns 3D shape programs by
reconstructing shapes in a self-supervised manner. Experiments demonstrate that
our model accurately infers and executes 3D shape programs for highly complex
shapes from various categories. It can also be integrated with an
image-to-shape module to infer 3D shape programs directly from an RGB image,
leading to 3D shape reconstructions that are both more accurate and more
physically plausible.

该研究提出了一种基于自下而上的识别系统和结构符号化程序的 3D 形状程序，通过自监督方式对 3D 形状程序进行学习，具有在不同领域中高精度的 3D 形状重建能力，结合图像到 3D 形状模块，能够实现从 RGB 图像直接推断出 3D 形状程序并重建出更加准确和真实的 3D 形状。