Light has many properties that vision sensors can passively measure.
Colour-band separated wavelength and intensity are arguably the most commonly
used for monocular 6D object pose estimation. This paper explores how
complementary polarisation information, i.e. the orientation of light wave
oscillations, influences the accuracy of pose predictions. A hybrid model that
leverages physical priors jointly with a data-driven learning strategy is
designed and carefully tested on objects with different levels of photometric
complexity. Our design significantly improves the pose accuracy compared to
state-of-the-art photometric approaches and enables object pose estimation for
highly reflective and transparent objects. A new multi-modal instance-level 6D
object pose dataset with highly accurate pose annotations for multiple objects
with varying photometric complexity is introduced as a benchmark.

本文探讨了光的偏振信息对单目 6D 物体姿态预测准确性的影响，并设计了一种混合模型，该模型将物理先验与数据驱动的学习策略结合起来，在不同光度复杂度的物体上进行了仔细的测试。实验结果表明，与现有的光度测量方法相比，我们的设计显著提高了姿态准确性，并能够实现高反射和透明物体的姿态估计。同时，我们还引入了一个新的多模式 6D 物体姿态数据集作为基准。