3D LiDAR scanners are playing an increasingly important role in autonomous driving as they can generate depth information of the environment. However, creating large 3D LiDAR point cloud datasets with point-level labels requires a significant amount of manual annotation. This jeopardizes the efficient development of supervised deep learning algorithms which are often data-hungry. We present a framework to rapidly create point clouds with accurate point-level labels from a computer game. The framework supports data collection from both auto-driving scenes and user-configured scenes. Point clouds from auto-driving scenes can be used as training data for deep learning algorithms, while point clouds from user-configured scenes can be used to systematically test the vulnerability of a neural network, and use the falsifying examples to make the neural network more robust through retraining. In addition, the scene images can be captured simultaneously in order for sensor fusion tasks, with a method proposed to do automatic calibration between the point clouds and captured scene images. We show a significant improvement in accuracy (+9%) in point cloud segmentation by augmenting the training dataset with the generated synthesized data. Our experiments also show by testing and retraining the network using point clouds from user-configured scenes, the weakness/blind spots of the neural network can be fixed.

本文提出了一个从电脑游戏中快速生成带有准确点级别标签的点云的框架，可用于深度学习算法的训练和神经网络的鲁棒性测试并提出了自动标定方法，实验表明将生成的合成数据与训练数据集相结合可显著提高点云分割的准确性(+9%)，通过从用户配置场景的点云进行神经网络的测试和重新训练，可以修复神经网络的弱点/盲点。

一种LiDAR点云生成器：从虚拟世界到自主驾驶