This paper addresses the critical challenges of sparsity and occlusion in
LiDAR-based 3D object detection. Current methods often rely on supplementary
modules or specific architectural designs, potentially limiting their
applicability to new and evolving architectures. To our knowledge, we are the
first to propose a versatile technique that seamlessly integrates into any
existing framework for 3D Object Detection, marking the first instance of
Weak-to-Strong generalization in 3D computer vision. We introduce a novel
framework, X-Ray Distillation with Object-Complete Frames, suitable for both
supervised and semi-supervised settings, that leverages the temporal aspect of
point cloud sequences. This method extracts crucial information from both
previous and subsequent LiDAR frames, creating Object-Complete frames that
represent objects from multiple viewpoints, thus addressing occlusion and
sparsity. Given the limitation of not being able to generate Object-Complete
frames during online inference, we utilize Knowledge Distillation within a
Teacher-Student framework. This technique encourages the strong Student model
to emulate the behavior of the weaker Teacher, which processes simple and
informative Object-Complete frames, effectively offering a comprehensive view
of objects as if seen through X-ray vision. Our proposed methods surpass
state-of-the-art in semi-supervised learning by 1-1.5 mAP and enhance the
performance of five established supervised models by 1-2 mAP on standard
autonomous driving datasets, even with default hyperparameters. Code for
Object-Complete frames is available here:
this https URL

提出了一种新颖的方法，通过使用 X 射线视觉模型引入 Object-Complete frames 来处理 LiDAR 在 3D 物体检测中的稀疏性和遮挡问题，并且应用于半监督和监督学习场景中，取得了优于现有方法 1-1.5 mAP 的性能提升。