In this paper, we propose PETRv2, a unified framework for 3D perception from
multi-view images. Based on PETR, PETRv2 explores the effectiveness of temporal
modeling, which utilizes the temporal information of previous frames to boost
3D object detection. More specifically, we extend the 3D position embedding (3D
PE) in PETR for temporal modeling. The 3D PE achieves the temporal alignment on
object position of different frames. A feature-guided position encoder is
further introduced to improve the data adaptability of 3D PE. To support for
multi-task learning (e.g., BEV segmentation and 3D lane detection), PETRv2
provides a simple yet effective solution by introducing task-specific queries,
which are initialized under different spaces. PETRv2 achieves state-of-the-art
performance on 3D object detection, BEV segmentation and 3D lane detection.
Detailed robustness analysis is also conducted on PETR framework. We hope
PETRv2 can serve as a strong baseline for 3D perception. Code is available at
https://github.com/megvii-research/PETR.

本文提出了 PETRv2，这是一个统一的框架，用于从多视角图像中进行三维感知，基于 PETR，PETRv2 利用先前帧的时间信息进行了时间建模，扩展了 PETR 中的 3D 位置嵌入。PETRv2 提出了一种简单而有效的解决方案，并通过引入任务特定查询来支持多任务学习，PETRv2 在三维物体检测、BEV 分割和三维车道检测方面取得了最先进的表现。