Data contamination has garnered increased attention in the era of large
language models (LLMs) due to the reliance on extensive internet-derived
training corpora. The issue of training corpus overlap with evaluation
benchmarks--referred to as contamination--has been the focus of significant
recent research. This body of work aims to identify contamination, understand
its impacts, and explore mitigation strategies from diverse perspectives.
However, comprehensive studies that provide a clear pathway from foundational
concepts to advanced insights are lacking in this nascent field. Therefore, we
present a comprehensive survey in the field of data contamination, laying out
the key issues, methodologies, and findings to date, and highlighting areas in
need of further research and development. In particular, we begin by examining
the effects of data contamination across various stages and forms. We then
provide a detailed analysis of current contamination detection methods,
categorizing them to highlight their focus, assumptions, strengths, and
limitations. We also discuss mitigation strategies, offering a clear guide for
future research. This survey serves as a succinct overview of the most recent
advancements in data contamination research, providing a straightforward guide
for the benefit of future research endeavors.

数据污染在大型语言模型 (LLMs) 时代引起了越来越多的关注，由于依赖于广泛来源于互联网的训练语料库。重叠训练语料库与评估基准的问题（称为污染）已成为重要的研究焦点。本文介绍了数据污染领域的综合调查，阐述了关键问题、方法和迄今为止的研究结果，并重点关注需要进一步研究和发展的领域。该调查对数据污染研究的最新进展进行了简明概述，为未来研究提供了清晰的指南。