With the rapid proliferation of autonomous driving, there has been a
heightened focus on the research of lidar-based 3D semantic segmentation and
object detection methodologies, aiming to ensure the safety of traffic
participants. In recent decades, learning-based approaches have emerged,
demonstrating remarkable performance gains in comparison to conventional
algorithms. However, the segmentation and detection tasks have traditionally
been examined in isolation to achieve the best precision. To this end, we
propose an efficient multi-task learning framework named LiSD which can address
both segmentation and detection tasks, aiming to optimize the overall
performance. Our proposed LiSD is a voxel-based encoder-decoder framework that
contains a hierarchical feature collaboration module and a holistic information
aggregation module. Different integration methods are adopted to keep sparsity
in segmentation while densifying features for query initialization in
detection. Besides, cross-task information is utilized in an instance-aware
refinement module to obtain more accurate predictions. Experimental results on
the nuScenes dataset and Waymo Open Dataset demonstrate the effectiveness of
our proposed model. It is worth noting that LiSD achieves the state-of-the-art
performance of 83.3% mIoU on the nuScenes segmentation benchmark for lidar-only
methods.

通过提出一种高效的多任务学习框架 LiSD，将分割和检测任务集成在一起，以优化整体性能， 它是一种基于体素的编码器 - 解码器框架，包含分层特征协作和整体信息聚合模块，以及利用跨任务信息的实例感知细化模块。我们在 nuScenes 数据集和 Waymo Open 数据集上进行了实验验证，结果表明我们提出的模型的有效性，尤其是在只使用 lidar 的方法中，LiSD 在 nuScenes 分割基准测试中达到了 83.3％的 mIoU，领先于其他方法。