The continuous advancement of large language models (LLMs) has brought
increasing attention to the critical issue of developing fair and reliable
methods for evaluating their performance. Particularly, the emergence of
subjective or non-subjective cheating phenomena, such as test set leakage and
prompt format overfitting, poses significant challenges to the reliable
evaluation of LLMs. Since evaluation frameworks often utilize Regular
Expression (RegEx) for answer extraction, some models may adjust their
responses to comply with specific formats that are easily extractable by RegEx.
Nevertheless, the key answer extraction module based on RegEx frequently
suffers from extraction errors. This paper conducts a comprehensive analysis of
the entire LLM evaluation chain, demonstrating that optimizing the key answer
extraction module can improve extraction accuracy, reduce LLMs' reliance on
specific answer formats, and enhance the reliability of LLM evaluation. To
address these issues, we propose xFinder, a model specifically designed for key
answer extraction. As part of this process, we create a specialized dataset,
the Key Answer Finder (KAF) dataset, to ensure effective model training and
evaluation. Through generalization testing and evaluation in real-world
scenarios, the results demonstrate that the smallest xFinder model with only
500 million parameters achieves an average answer extraction accuracy of
93.42%. In contrast, RegEx accuracy in the best evaluation framework is 74.38%.
xFinder exhibits stronger robustness and higher accuracy compared to existing
evaluation frameworks. All resources for xFinder are available at
https://github.com/IAAR-Shanghai/xFinder.

通过优化关键答案提取模块，xFinder 提高了关键答案提取准确率，降低了大语言模型对特定答案格式的依赖，增强了大语言模型评估的可靠性。