In this paper, we present CORE-GPT, a novel question-answering platform that
combines GPT-based language models and more than 32 million full-text open
access scientific articles from CORE. We first demonstrate that GPT3.5 and GPT4
cannot be relied upon to provide references or citations for generated text. We
then introduce CORE-GPT which delivers evidence-based answers to questions,
along with citations and links to the cited papers, greatly increasing the
trustworthiness of the answers and reducing the risk of hallucinations.
CORE-GPT's performance was evaluated on a dataset of 100 questions covering the
top 20 scientific domains in CORE, resulting in 100 answers and links to 500
relevant articles. The quality of the provided answers and and relevance of the
links were assessed by two annotators. Our results demonstrate that CORE-GPT
can produce comprehensive and trustworthy answers across the majority of
scientific domains, complete with links to genuine, relevant scientific
articles.

本研究提出了 CORE-GPT，一个结合了 GPT 语言模型和超过 3200 万篇 CORE 科学论文的问答平台。我们首先证明了 GPT3.5 和 GPT4 不能提供所生成文本的参考文献和引用。然后，我们介绍了 CORE-GPT，它能够提供有据可依的答案，并附带引文和文章链接，大大提高了答案的可信度，减少了虚构性的风险。CORE-GPT 在 CORE 数据库中涵盖了 20 个科学领域的 100 个问题上进行了性能评估，得出了 100 个答案和 500 篇相关文章的链接。两个标注者评估了提供的答案的质量和链接的相关性。我们的结果表明，CORE-GPT 能够在绝大多数科学领域生成全面且可信赖的答案，同时提供真实且相关的科学文章的链接。