The advent of Large Language Models (LLMs) has revolutionized text
generation, producing outputs that closely mimic human writing. This blurring
of lines between machine- and human-written text presents new challenges in
distinguishing one from the other a task further complicated by the frequent
updates and closed nature of leading proprietary LLMs. Traditional logits-based
detection methods leverage surrogate models for identifying LLM-generated
content when the exact logits are unavailable from black-box LLMs. However,
these methods grapple with the misalignment between the distributions of the
surrogate and the often undisclosed target models, leading to performance
degradation, particularly with the introduction of new, closed-source models.
Furthermore, while current methodologies are generally effective when the
source model is identified, they falter in scenarios where the model version
remains unknown, or the test set comprises outputs from various source models.
To address these limitations, we present Distribution-Aligned LLMs Detection
(DALD), an innovative framework that redefines the state-of-the-art performance
in black-box text detection even without logits from source LLMs. DALD is
designed to align the surrogate model's distribution with that of unknown
target LLMs, ensuring enhanced detection capability and resilience against
rapid model iterations with minimal training investment. By leveraging corpus
samples from publicly accessible outputs of advanced models such as ChatGPT,
GPT-4 and Claude-3, DALD fine-tunes surrogate models to synchronize with
unknown source model distributions effectively.

大规模语言模型在文本生成方面产生了重大影响，难以区分机器和人类生成的文本的界限提出了新的挑战，而且阻碍了黑盒 LLMs 的准确检测方法。为了解决这些限制，提出了一种创新的框架 Distribution-Aligned LLMs Detection (DALD)，在没有源 LLMs 的准确日志的情况下，通过对公开可访问的高级模型（如 ChatGPT、GPT-4 和 Claude-3）的样本进行细化调优，实现了与未知源模型分布的同步，从而提高了检测能力和对快速模型迭代的韧性。