Recognizing and localizing objects in the 3D space is a crucial ability for
an AI agent to perceive its surrounding environment. While significant progress
has been achieved with expensive LiDAR point clouds, it poses a great challenge
for 3D object detection given only a monocular image. While there exist
different alternatives for tackling this problem, it is found that they are
either equipped with heavy networks to fuse RGB and depth information or
empirically ineffective to process millions of pseudo-LiDAR points. With
in-depth examination, we realize that these limitations are rooted in
inaccurate object localization. In this paper, we propose a novel and
lightweight approach, dubbed {\em Progressive Coordinate Transforms} (PCT) to
facilitate learning coordinate representations. Specifically, a localization
boosting mechanism with confidence-aware loss is introduced to progressively
refine the localization prediction. In addition, semantic image representation
is also exploited to compensate for the usage of patch proposals. Despite being
lightweight and simple, our strategy leads to superior improvements on the
KITTI and Waymo Open Dataset monocular 3D detection benchmarks. At the same
time, our proposed PCT shows great generalization to most coordinate-based 3D
detection frameworks. The code is available at:
this https URL .

本文提出一种名为 “Progressive Coordinate Transforms”（PCT）的新型简单的轻量级方法来促进学习坐标表示，通过引入具有自信损失的定位增强机制来逐步改进定位预测，并利用语义图像表示来弥补局部提案的使用，得到了在 KITTI 和 Waymo Open Dataset 单眼 3D 检测基准上具有卓越的改进并具有良好的泛化性能。