This paper introduces a 3D shape completion approach using a 3D latent
diffusion model optimized for completing shapes, represented as Truncated
Signed Distance Functions (TSDFs), from partial 3D scans. Our method combines
image-based conditioning through cross-attention and spatial conditioning
through the integration of 3D features from captured partial scans. This dual
guidance enables high-fidelity, realistic shape completions at superior
resolutions. At the core of our approach is the compression of 3D data into a
low-dimensional latent space using an auto-encoder inspired by 2D latent
diffusion models. This compression facilitates the processing of
higher-resolution shapes and allows us to apply our model across multiple
object classes, a significant improvement over other existing diffusion-based
shape completion methods, which often require a separate diffusion model for
each class. We validated our approach against two common benchmarks in the
field of shape completion, demonstrating competitive performance in terms of
accuracy and realism and performing on par with state-of-the-art methods
despite operating at a higher resolution with a single model for all object
classes. We present a comprehensive evaluation of our model, showcasing its
efficacy in handling diverse shape completion challenges, even on unseen object
classes. The code will be released upon acceptance.

本文介绍了一种基于 3D 潜在扩散模型的 3D 形状补全方法，该方法通过交叉注意力和空间特征整合实现以图像为基础的条件和以 3D 特征为基础的条件，以高分辨率、真实感的方式完成形状补全。