Large language models (LLMs) exhibit emerging geospatial capabilities,
stemming from their pre-training on vast unlabelled text datasets that are
often derived from the Common Crawl corpus. However, the geospatial content
within CC remains largely unexplored, impacting our understanding of LLMs'
spatial reasoning. This paper investigates the prevalence of geospatial data in
recent Common Crawl releases using Gemini, a powerful language model. By
analyzing a sample of documents and manually revising the results, we estimate
that between 1 in 5 and 1 in 6 documents contain geospatial information such as
coordinates and street addresses. Our findings provide quantitative insights
into the nature and extent of geospatial data within Common Crawl, and web
crawl data in general. Furthermore, we formulate questions to guide future
investigations into the geospatial content of available web crawl datasets and
its influence on LLMs.

分析大型语言模型对 Common Crawl 数据集的地理空间数据的利用率，发现 1/5 至 1/6 的文档中包含有经纬度和街道地址等地理空间信息，为进一步研究有关地理空间内容对大型语言模型的影响提供了定量的见解。