HD map reconstruction is crucial for autonomous driving. LiDAR-based methods
are limited due to expensive sensors and time-consuming computation.
Camera-based methods usually need to perform road segmentation and view
transformation separately, which often causes distortion and missing content.
To push the limits of the technology, we present a novel framework that
reconstructs a local map formed by road layout and vehicle occupancy in the
bird's-eye view given a front-view monocular image only. We propose a
front-to-top view projection (FTVP) module, which takes the constraint of cycle
consistency between views into account and makes full use of their correlation
to strengthen the view transformation and scene understanding. In addition, we
also apply multi-scale FTVP modules to propagate the rich spatial information
of low-level features to mitigate spatial deviation of the predicted object
location. Experiments on public benchmarks show that our method achieves the
state-of-the-art performance in the tasks of road layout estimation, vehicle
occupancy estimation, and multi-class semantic estimation. For multi-class
semantic estimation, in particular, our model outperforms all competitors by a
large margin. Furthermore, our model runs at 25 FPS on a single GPU, which is
efficient and applicable for real-time panorama HD map reconstruction.

提出基于前视单目图像的局部鸟瞰地图重建新框架，利用前向到俯视图像变换（FTVP）模块中的多尺度设计和周期性一致性约束，实现低成本高效的道路与汽车区域感知以及多类别场景理解。在公共基准测试中，该方法在道路布局估计，车辆占用估计和多类别语义估计任务中均达到了最先进的性能，并且在多类别语义估计中优于所有竞争对手。