BriefGPT.xyz
May, 2023
TrueTeacher:利用大型语言模型学习事实一致性评估
TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models
HTML
PDF
Zorik Gekhman, Jonathan Herzig, Roee Aharoni, Chen Elkind, Idan Szpektor
TL;DR
TrueTeacher通过用LLM注释各种模型生成的摘要来生成合成数据的方法,优于现有的合成数据生成方法,并可在多语言情况下通用。
Abstract
factual consistency evaluation
is often conducted using
natural language inference
(NLI) models, yet these models exhibit limited success in evaluating summaries. Previous work improved such models with synthetic
→