Many autonomous robotic applications require object-level understanding when
deployed. Actively reconstructing objects of interest, i.e. objects with
specific semantic meanings, is therefore relevant for a robot to perform
downstream tasks in an initially unknown environment. In this work, we propose
a novel framework for semantic-targeted active reconstruction using posed RGB-D
measurements and 2D semantic labels as input. The key components of our
framework are a semantic implicit neural representation and a compatible
planning utility function based on semantic rendering and uncertainty
estimation, enabling adaptive view planning to target objects of interest. Our
planning approach achieves better reconstruction performance in terms of mesh
and novel view rendering quality compared to implicit reconstruction baselines
that do not consider semantics for view planning. Our framework further
outperforms a state-of-the-art semantic-targeted active reconstruction pipeline
based on explicit maps, justifying our choice of utilising implicit neural
representations to tackle semantic-targeted active reconstruction problems.

我们提出了一个新的框架，利用姿态化的 RGB-D 测量和 2D 语义标签作为输入，进行语义目标的主动重建，实现对感兴趣目标的自适应视角规划，从而在网格和新视角渲染质量方面实现更好的重建性能，超过不考虑语义的隐式重建基线和基于显式地图的最先进的语义目标主动重建流水线。