LiDAR point cloud analysis is a core task for 3D computer vision, especially
for autonomous driving. However, due to the severe sparsity and noise
interference in the single sweep LiDAR point cloud, the accurate semantic
segmentation is non-trivial to achieve. In this paper, we propose a novel
sparse LiDAR point cloud semantic segmentation framework assisted by learned
contextual shape priors. In practice, an initial semantic segmentation (SS) of
a single sweep point cloud can be achieved by any appealing network and then
flows into the semantic scene completion (SSC) module as the input. By merging
multiple frames in the LiDAR sequence as supervision, the optimized SSC module
has learned the contextual shape priors from sequential LiDAR data, completing
the sparse single sweep point cloud to the dense one. Thus, it inherently
improves SS optimization through fully end-to-end training. Besides, a
Point-Voxel Interaction (PVI) module is proposed to further enhance the
knowledge fusion between SS and SSC tasks, i.e., promoting the interaction of
incomplete local geometry of point cloud and complete voxel-wise global
structure. Furthermore, the auxiliary SSC and PVI modules can be discarded
during inference without extra burden for SS. Extensive experiments confirm
that our JS3C-Net achieves superior performance on both SemanticKITTI and
SemanticPOSS benchmarks, i.e., 4% and 3% improvement correspondingly.

本文提出了一种基于学习的语义分割框架，其利用上下文形状先验知识，在 LiDAR 点云序列的帮助下将单个点云序列完成从稀疏的单扫描点云到密集的点云的语义分割任务，并在 SemanticKITTI 和 SemanticPOSS 数据集上取得了显著的性能提升。