Incorporating factual knowledge in knowledge graph is regarded as a promising
approach for mitigating the hallucination of large language models (LLMs).
Existing methods usually only use the user's input to query the knowledge
graph, thus failing to address the factual hallucination generated by LLMs
during its reasoning process. To address this problem, this paper proposes
Knowledge Graph-based Retrofitting (KGR), a new framework that incorporates
LLMs with KGs to mitigate factual hallucination during the reasoning process by
retrofitting the initial draft responses of LLMs based on the factual knowledge
stored in KGs. Specifically, KGR leverages LLMs to extract, select, validate,
and retrofit factual statements within the model-generated responses, which
enables an autonomous knowledge verifying and refining procedure without any
additional manual efforts. Experiments show that KGR can significantly improve
the performance of LLMs on factual QA benchmarks especially when involving
complex reasoning processes, which demonstrates the necessity and effectiveness
of KGR in mitigating hallucination and enhancing the reliability of LLMs.

知识图谱的积极运用可以有效减轻大型语言模型的虚构幻觉，本文提出了一种基于知识图谱的改进框架，通过将知识图谱与语言模型相结合，修改模型生成的初步回答，从而验证和完善其中的事实陈述，实验证明该框架在解决复杂推理过程中显著提高了语言模型在事实问答基准测试中的性能，有效减轻了虚构幻觉，增强了语言模型的可信度。