Pre-trained Foundation Models (PFMs) have ushered in a paradigm-shift in
Artificial Intelligence, due to their ability to learn general-purpose
representations that can be readily employed in a wide range of downstream
tasks. While PFMs have been successfully adopted in various fields such as
Natural Language Processing and Computer Vision, their capacity in handling
geospatial data and answering urban questions remains limited. This can be
attributed to the intrinsic heterogeneity of geospatial data, which encompasses
different data types, including points, segments and regions, as well as
multiple information modalities, such as a spatial position, visual
characteristics and textual annotations. The proliferation of Volunteered
Geographic Information initiatives, and the ever-increasing availability of
open geospatial data sources, like OpenStreetMap, which is freely accessible
globally, unveil a promising opportunity to bridge this gap. In this paper, we
present CityFM, a self-supervised framework to train a foundation model within
a selected geographical area of interest, such as a city. CityFM relies solely
on open data from OSM, and produces multimodal representations of entities of
different types, incorporating spatial, visual, and textual information. We
analyse the entity representations generated using our foundation models from a
qualitative perspective, and conduct quantitative experiments on road,
building, and region-level downstream tasks. We compare its results to
algorithms tailored specifically for the respective applications. In all the
experiments, CityFM achieves performance superior to, or on par with, the
baselines.

通过开放地理空间数据和自我监督学习，CityFM 构建了一个多模态的预训练基础模型，用于处理地理空间数据和回答城市相关问题，并在道路、建筑和区域级别的任务上获得了优秀的性能。

CityFM：解决城市挑战的城市基础模型

CityFM: City Foundation Models to Solve Urban Challenges

This paper explores the concept of leveraging generative AI as a mapping
assistant for enhancing the efficiency of collaborative mapping. We present
results of an experiment that combines multiple sources of volunteered
geographic information (VGI) and large language models (LLMs). Three analysts
described the content of crowdsourced Mapillary street-level photographs taken
along roads in a small test area in Miami, Florida. GPT-3.5-turbo was
instructed to suggest the most appropriate tagging for each road in
OpenStreetMap (OSM). The study also explores the utilization of BLIP-2, a
state-of-the-art multimodal pre-training method as an artificial analyst of
street-level photographs in addition to human analysts. Results demonstrate two
ways to effectively increase the accuracy of mapping suggestions without
modifying the underlying AI models: by (1) providing a more detailed
description of source photographs, and (2) combining prompt engineering with
additional context (e.g. location and objects detected along a road). The first
approach increases the suggestion accuracy by up to 29%, and the second one by
up to 20%.

本研究探索利用生成型 AI 作为绘图的助手的概念，以增强协作绘图的效率，并结合志愿地理信息和大型语言模型进行实验，结果表明，采用更详细的来源照片描述或结合附加上下文可以在不修改底层 AI 模型的情况下有效地提高地图标记建议的准确性。