Leveraging LiDAR-based detectors or real LiDAR point data to guide monocular
3D detection has brought significant improvement, e.g., Pseudo-LiDAR methods.
However, the existing methods usually apply non-end-to-end training strategies
and insufficiently leverage the LiDAR information, where the rich potential of
the LiDAR data has not been well exploited. In this paper, we propose the
Cross-Modality Knowledge Distillation (CMKD) network for monocular 3D detection
to efficiently and directly transfer the knowledge from LiDAR modality to image
modality on both features and responses. Moreover, we further extend CMKD as a
semi-supervised training framework by distilling knowledge from large-scale
unlabeled data and significantly boost the performance. Until submission, CMKD
ranks $1^{st}$ among the monocular 3D detectors with publications on both KITTI
$test$ set and Waymo $val$ set with significant performance gains compared to
previous state-of-the-art methods.

本研究提出了一种基于 Cross-Modality Knowledge Distillation (CMKD) 的半监督训练框架，通过跨模态知识蒸馏能够从大规模未标记数据中有效传输 LiDAR 模态到图像模态的知识，从而显著提高单目三维检测性能，使得该方法在 KITTI 测试集和 Waymo 验证集上的表现明显优于先前最先进的方法。