Large language models (LLMs) have achieved great success, but their
occasional content fabrication, or hallucination, limits their practical
application. Hallucination arises because LLMs struggle to admit ignorance due
to inadequate training on knowledge boundaries. We call it a limitation of LLMs
that they can not accurately express their knowledge boundary, answering
questions they know while admitting ignorance to questions they do not know. In
this paper, we aim to teach LLMs to recognize and express their knowledge
boundary, so they can reduce hallucinations caused by fabricating when they do
not know. We propose CoKE, which first probes LLMs' knowledge boundary via
internal confidence given a set of questions, and then leverages the probing
results to elicit the expression of the knowledge boundary. Extensive
experiments show CoKE helps LLMs express knowledge boundaries, answering known
questions while declining unknown ones, significantly improving in-domain and
out-of-domain performance.

本文提出了 CoKE 方法，通过评估大型语言模型的知识边界，使其能够准确表达自己的知识边界，从而减少幻觉现象，显著提高在领域内和领域外的性能表现。