We tackle the problem of using 3D information in convolutional neural
networks for down-stream recognition tasks. Using depth as an additional
channel alongside the RGB input has the scale variance problem present in image
convolution based approaches. On the other hand, 3D convolution wastes a large
amount of memory on mostly unoccupied 3D space, which consists of only the
surface visible to the sensor. Instead, we propose SurfConv, which "slides"
compact 2D filters along the visible 3D surface. SurfConv is formulated as a
simple depth-aware multi-scale 2D convolution, through a new Data-Driven Depth
Discretization (D4) scheme. We demonstrate the effectiveness of our method on
indoor and outdoor 3D semantic segmentation datasets. Our method achieves
state-of-the-art performance with less than 30% parameters used by the 3D
convolution-based approaches.

本文提出使用 SurfConv 作为一种新型的深度学习算法，可以有效地解决在 3D 图像中使用卷积神经网络在尺度上变化和浪费空间等问题，通过新的数据驱动深度离散化方案（D4），在室内和室外 3D 语义分割数据集上获得了超越 3D 卷积方法并使用不到 30％的参数的最先进性能。