Vision-and-language navigation (VLN) aims to guide autonomous agents through
real-world environments by integrating visual and linguistic cues. While
substantial progress has been made in understanding these interactive
modalities in ground-level navigation, aerial navigation remains largely
underexplored. This is primarily due to the scarcity of resources suitable for
real-world, city-scale aerial navigation studies. To bridge this gap, we
introduce CityNav, a new dataset for language-goal aerial navigation using a 3D
point cloud representation from real-world cities. CityNav includes 32,637
natural language descriptions paired with human demonstration trajectories,
collected from participants via a new web-based 3D simulator developed for this
research. Each description specifies a navigation goal, leveraging the names
and locations of landmarks within real-world cities. We also provide baseline
models of navigation agents that incorporate an internal 2D spatial map
representing landmarks referenced in the descriptions. We benchmark the latest
aerial navigation baselines and our proposed model on the CityNav dataset. The
results using this dataset reveal the following key findings: (i) Our aerial
agent models trained on human demonstration trajectories outperform those
trained on shortest path trajectories, highlighting the importance of
human-driven navigation strategies; (ii) The integration of a 2D spatial map
significantly enhances navigation efficiency at city scale. Our dataset and
code are available at this https URL

通过真实世界的城市的三维点云表示，CityNav 数据集提供了 32,637 个自然语言描述与人类演示轨迹的配对，作为语言目标的航空导航的新数据集。该数据集揭示了以下关键发现：（一）在航空代理模型上，基于人类演示轨迹的训练优于最短路径轨迹的训练，突出了人类驱动导航策略的重要性；（二）在城市尺度上，二维空间地图的整合显著提高了导航效率。