Vision-and-language navigation (VLN) aims to guide autonomous agents through
real-world environments by integrating visual and linguistic cues. While
substantial progress has been made in understanding these interactive
modalities in ground-level navigation, aerial navigation remains largely
underexplored. This is primarily due to the scarcity of resources suitable for
real-world, city-scale aerial navigation studies. To bridge this gap, we
introduce CityNav, a new dataset for language-goal aerial navigation using a 3D
point cloud representation from real-world cities. CityNav includes 32,637
natural language descriptions paired with human demonstration trajectories,
collected from participants via a new web-based 3D simulator developed for this
research. Each description specifies a navigation goal, leveraging the names
and locations of landmarks within real-world cities. We also provide baseline
models of navigation agents that incorporate an internal 2D spatial map
representing landmarks referenced in the descriptions. We benchmark the latest
aerial navigation baselines and our proposed model on the CityNav dataset. The
results using this dataset reveal the following key findings: (i) Our aerial
agent models trained on human demonstration trajectories outperform those
trained on shortest path trajectories, highlighting the importance of
human-driven navigation strategies; (ii) The integration of a 2D spatial map
significantly enhances navigation efficiency at city scale. Our dataset and
code are available at this https URL

通过真实世界的城市的三维点云表示，CityNav 数据集提供了 32,637 个自然语言描述与人类演示轨迹的配对，作为语言目标的航空导航的新数据集。该数据集揭示了以下关键发现：（一）在航空代理模型上，基于人类演示轨迹的训练优于最短路径轨迹的训练，突出了人类驱动导航策略的重要性；（二）在城市尺度上，二维空间地图的整合显著提高了导航效率。

CityNav: 具备地理信息的语言目标空中导航数据集

CityNav: Language-Goal Aerial Navigation Dataset with Geographic  Information

Drones have been widely used in many areas of our daily lives. It relieves
people of the burden of holding a controller all the time and makes drone
control easier to use for people with disabilities or occupied hands. However,
the control of aerial robots is more complicated compared to normal robots due
to factors such as uncontrollable height. Therefore, it is crucial to develop
an intelligent UAV that has the ability to talk to humans and follow natural
language commands. In this report, we present an aerial navigation task for the
2023 ICCV Conversation History. Based on the AVDN dataset containing more than
3k recorded navigation trajectories and asynchronous human-robot conversations,
we propose an effective method of fusion training of Human Attention Aided
Transformer model (HAA-Transformer) and Human Attention Aided LSTM (HAA-LSTM)
model, which achieves the prediction of the navigation routing points and human
attention. The method not only achieves high SR and SPL metrics, but also shows
a 7% improvement in GP metrics compared to the baseline model.

发展能够与人类交流并遵循自然语言命令的智能无人机，该研究提出了一种基于 AVDN 数据集的高效融合训练方法，使用 HAA-Transformer 模型和 HAA-LSTM 模型，对导航路由点和人的注意力进行预测，并在 SR、SPL 指标上取得高效果，相比基线模型，GP 指标有 7% 的改进。