Autonomous driving requires the inference of actionable information such as
detecting and classifying objects, and determining the drivable space. To this
end, we present Multi-View LidarNet (MVLidarNet), a two-stage deep neural
network for multi-class object detection and drivable space segmentation using
multiple views of a single LiDAR point cloud. The first stage processes the
point cloud projected onto a perspective view in order to semantically segment
the scene. The second stage then processes the point cloud (along with semantic
labels from the first stage) projected onto a bird's eye view, to detect and
classify objects. Both stages use an encoder-decoder architecture. We show that
our multi-view, multi-stage, multi-class approach is able to detect and
classify objects while simultaneously determining the drivable space using a
single LiDAR scan as input, in challenging scenes with more than one hundred
vehicles and pedestrians at a time. The system operates efficiently at 150 fps
on an embedded GPU designed for a self-driving car, including a postprocessing
step to maintain identities over time. We show results on both KITTI and a much
larger internal dataset, thus demonstrating the method's ability to scale by an
order of magnitude.

本文介绍了一种使用多视角 LiDAR 点云的双阶段深度神经网络，用于多类目标检测和行驶空间分割，通过两个阶段的处理，能够在挑战性的场景中使用单个 LiDAR 扫描作为输入同时检测和分类物体，同时确定驾驶空间，该系统在配备于自动驾驶汽车的嵌入式 GPU 上能够高效运行，并展示了在 KITTI 数据集和更大型的内部数据集上的测试结果。