Robots require a semantic understanding of their surroundings to operate in
an efficient and explainable way in human environments. In the literature,
there has been an extensive focus on object labeling and exhaustive scene graph
generation; less effort has been focused on the task of purely identifying and
mapping large semantic regions. The present work proposes a method for semantic
region mapping via embodied navigation in indoor environments, generating a
high-level representation of the knowledge of the agent. To enable region
identification, the method uses a vision-to-language model to provide scene
information for mapping. By projecting egocentric scene understanding into the
global frame, the proposed method generates a semantic map as a distribution
over possible region labels at each location. This mapping procedure is paired
with a trained navigation policy to enable autonomous map generation. The
proposed method significantly outperforms a variety of baselines, including an
object-based system and a pretrained scene classifier, in experiments in a
photorealistic simulator.

通过室内环境中的具身导航，提出了一种语义区域绘图的方法，通过视觉 - 语言模型向导绘图，将自身场景理解映射到全局框架上，生成具有高级代理知识的语义地图，实现自主地图生成。在逼真模拟器的实验中，该方法在大量基线方法中明显优于基于对象的系统和预训练场景分类器。