This work proposes a general-purpose, fully-convolutional network
architecture for efficiently processing large-scale 3D data. One striking
characteristic of our approach is its ability to process unorganized 3D
representations such as point clouds as input, then transforming them
internally to ordered structures to be processed via 3D convolutions. In
contrast to conventional approaches that maintain either unorganized or
organized representations, from input to output, our approach has the advantage
of operating on memory efficient input data representations while at the same
time exploiting the natural structure of convolutional operations to avoid the
redundant computing and storing of spatial information in the network. The
network eliminates the need to pre- or post process the raw sensor data. This,
together with the fully-convolutional nature of the network, makes it an
end-to-end method able to process point clouds of huge spaces or even entire
rooms with up to 200k points at once. Another advantage is that our network can
produce either an ordered output or map predictions directly onto the input
cloud, thus making it suitable as a general-purpose point cloud descriptor
applicable to many 3D tasks. We demonstrate our network's ability to
effectively learn both low-level features as well as complex compositional
relationships by evaluating it on benchmark datasets for semantic voxel
segmentation, semantic part segmentation and 3D scene captioning.

提出了一种用于处理大规模 3D 数据的一般用途的全卷积网络，具有内部将无组织的点云转换为有序结构以通过 3D 卷积处理的能力，可用于许多 3D 任务的通用点云描述符。在语义体素分割，语义部分分割和 3D 场景字幕数据集上进行了评估。