Predicting the object's 6D pose from a single RGB image is a fundamental
computer vision task. Generally, the distance between transformed object
vertices is employed as an objective function for pose estimation methods.
However, projective geometry in the camera space is not considered in those
methods and causes performance degradation. In this regard, we propose a new
pose estimation system based on a projective grid instead of object vertices.
Our pose estimation method, dynamic projective spatial transformer network
(DProST), localizes the region of interest grid on the rays in camera space and
transforms the grid to object space by estimated pose. The transformed grid is
used as both a sampling grid and a new criterion of the estimated pose.
Additionally, because DProST does not require object vertices, our method can
be used in a mesh-less setting by replacing the mesh with a reconstructed
feature. Experimental results show that mesh-less DProST outperforms the
state-of-the-art mesh-based methods on the LINEMOD and LINEMOD-OCCLUSION
dataset, and shows competitive performance on the YCBV dataset with mesh data.
The source code is available at this https URL

本文提出了一种基于投影网格的物体 6D 位姿估计系统，该系统采用动态投影空间变换网络方法，可在无模型的情况下进行位姿估计，并在 LINEMOD 和 LINEMOD-OCCLUSION 数据集上优于最先进的基于网格的方法，在 YCBV 数据集上表现出竞争性。