We deal with the navigation problem where the agent follows natural language
instructions while observing the environment. Focusing on language
understanding, we show the importance of spatial semantics in grounding
navigation instructions into visual perceptions. We propose a neural agent that
uses the elements of spatial configurations and investigate their influence on
the navigation agent's reasoning ability. Moreover, we model the sequential
execution order and align visual objects with spatial configurations in the
instruction. Our neural agent improves strong baselines on the seen
environments and shows competitive performance on the unseen environments.
Additionally, the experimental results demonstrate that explicit modeling of
spatial semantic elements in the instructions can improve the grounding and
spatial reasoning of the model.

我们针对导航问题进行研究，提出了一种使用空间语义元素的神经代理导航模型，并探究了它们对导航代理的推理能力的影响。研究结果表明，指令中显式建模空间语义元素可以改善模型的基础和空间推理能力，并在已见及未见环境上取得了竞争性的性能。