Point clouds captured by scanning devices are often incomplete due to
occlusion. Point cloud completion aims to predict the complete shape based on
its partial input. Existing methods can be classified into supervised and
unsupervised methods. However, both of them require a large number of 3D
complete point clouds, which are difficult to capture. In this paper, we
propose Cross-PCC, an unsupervised point cloud completion method without
requiring any 3D complete point clouds. We only utilize 2D images of the
complete objects, which are easier to capture than 3D complete and clean point
clouds. Specifically, to take advantage of the complementary information from
2D images, we use a single-view RGB image to extract 2D features and design a
fusion module to fuse the 2D and 3D features extracted from the partial point
cloud. To guide the shape of predicted point clouds, we project the predicted
points of the object to the 2D plane and use the foreground pixels of its
silhouette maps to constrain the position of the projected points. To reduce
the outliers of the predicted point clouds, we propose a view calibrator to
move the points projected to the background into the foreground by the
single-view silhouette image. To the best of our knowledge, our approach is the
first point cloud completion method that does not require any 3D supervision.
The experimental results of our method are superior to those of the
state-of-the-art unsupervised methods by a large margin. Moreover, compared to
some supervised methods, our method achieves similar performance. We will make
the source code publicly available at this https URL

本文提出了一种无监督的点云补全方法，不需要 3D 补全点云，只利用 2D 补全图像，使用单视角 RGB 图像提取 2D 特征，并使用融合模块将其与部分点云提取的 3D 特征相结合，以预测物体的完整形状。