Self-evaluation using large language models (LLMs) has proven valuable not
only in benchmarking but also methods like reward modeling, constitutional AI,
and self-refinement. But new biases are introduced due to the same LLM acting
as both the evaluator and the evaluatee. One such bias is self-preference,
where an LLM evaluator scores its own outputs higher than others' while human
annotators consider them of equal quality. But do LLMs actually recognize their
own outputs when they give those texts higher scores, or is it just a
coincidence? In this paper, we investigate if self-recognition capability
contributes to self-preference. We discover that, out of the box, LLMs such as
GPT-4 and Llama 2 have non-trivial accuracy at distinguishing themselves from
other LLMs and humans. By fine-tuning LLMs, we discover a linear correlation
between self-recognition capability and the strength of self-preference bias;
using controlled experiments, we show that the causal explanation resists
straightforward confounders. We discuss how self-recognition can interfere with
unbiased evaluations and AI safety more generally.

大型语言模型的自我评估能力，特别是自我偏好和自我识别能力，对于无偏评估和人工智能安全性具有重要影响。