Weakly supervised 3D object detection aims to learn a 3D detector with lower
annotation cost, e.g., 2D labels. Unlike prior work which still relies on few
accurate 3D annotations, we propose a framework to study how to leverage
constraints between 2D and 3D domains without requiring any 3D labels.
Specifically, we employ visual data from three perspectives to establish
connections between 2D and 3D domains. First, we design a feature-level
constraint to align LiDAR and image features based on object-aware regions.
Second, the output-level constraint is developed to enforce the overlap between
2D and projected 3D box estimations. Finally, the training-level constraint is
utilized by producing accurate and consistent 3D pseudo-labels that align with
the visual data. We conduct extensive experiments on the KITTI dataset to
validate the effectiveness of the proposed three constraints. Without using any
3D labels, our method achieves favorable performance against state-of-the-art
approaches and is competitive with the method that uses 500-frame 3D
annotations. Code and models will be made publicly available at
this https URL

对于弱监督的三维物体检测任务，本文提出了一种框架来研究如何在无需任何三维标签的情况下利用二维和三维领域之间的约束，通过三种视角的视觉数据建立二维和三维领域之间的关联。实验证明，在无需使用任何三维标签的情况下，该方法在 KITTI 数据集上取得了与最先进方法相媲美的性能。