In the field of Question Answering (QA), unifying large language models
(LLMs) with external databases has shown great success. However, these methods
often fall short in providing the advanced reasoning needed for complex QA
tasks. To address these issues, we improve over a novel approach called
Knowledge Graph Prompting (KGP), which combines knowledge graphs with a
LLM-based agent to improve reasoning and search accuracy. Nevertheless, the
original KGP framework necessitates costly fine-tuning with large datasets yet
still suffers from LLM hallucination. Therefore, we propose a reasoning-infused
LLM agent to enhance this framework. This agent mimics human curiosity to ask
follow-up questions to more efficiently navigate the search. This simple
modification significantly boosts the LLM performance in QA tasks without the
high costs and latency associated with the initial KGP framework. Our ultimate
goal is to further develop this approach, leading to more accurate, faster, and
cost-effective solutions in the QA domain.

在问答领域中，将大型语言模型与外部数据库结合已经取得了巨大的成功。然而，这些方法在提供复杂问答任务所需的高级推理方面常常效果不佳。为了解决这些问题，我们改进了一种称为 “知识图谱提示” 的新方法，该方法结合了知识图谱和基于大型语言模型的代理以提高推理和搜索准确性。然而，原始的知识图谱提示框架需要在大型数据集上进行昂贵的微调，并且仍然存在着大型语言模型幻觉的问题。因此，我们提出了一种注入推理能力的大型语言模型代理来增强该框架。这种代理模仿人类的好奇心来提问后续问题，以更高效地导航搜索。这种简单的改进显著提升了大型语言模型在问答任务中的性能，而无需承担初始 “知识图谱提示” 框架的高成本和延迟。我们的最终目标是进一步发展这种方法，在问答领域提供更准确、更快速、更具成本效益的解决方案。