Existing online 3D shape repositories contain thousands of 3D models but lack
photorealistic appearance. We present an approach to automatically assign
high-quality, realistic appearance models to large scale 3D shape collections.
The key idea is to jointly leverage three types of online data -- shape
collections, material collections, and photo collections, using the photos as
reference to guide assignment of materials to shapes. By generating a large
number of synthetic renderings, we train a convolutional neural network to
classify materials in real photos, and employ 3D-2D alignment techniques to
transfer materials to different parts of each shape model. Our system produces
photorealistic, relightable, 3D shapes (PhotoShapes).

利用图像引导并借助三种类型的在线数据，包括形状集合、物质集合、及照片集合，使用大规模 3D 形状集合自动分配高质量、逼真的外观模型，利用卷积神经网络在大量合成的渲染图像中训练材料分类，再通过 3D-2D 对齐技术将材料传输到每个形状的不同部位，从而生成光真实、可重新采光的 3D 形状（PhotoShapes)。