Retrieval Augmented Generation (RAG) has become a popular application for
large language models. It is preferable that successful RAG systems provide
accurate answers that are supported by being grounded in a passage without any
hallucinations. While considerable work is required for building a full RAG
pipeline, being able to benchmark performance is also necessary. We present
ClapNQ, a benchmark Long-form Question Answering dataset for the full RAG
pipeline. ClapNQ includes long answers with grounded gold passages from Natural
Questions (NQ) and a corpus to perform either retrieval, generation, or the
full RAG pipeline. The ClapNQ answers are concise, 3x smaller than the full
passage, and cohesive, with multiple pieces of the passage that are not
contiguous. RAG models must adapt to these properties to be successful at
ClapNQ. We present baseline experiments and analysis for ClapNQ that highlight
areas where there is still significant room for improvement in grounded RAG.
CLAPNQ is publicly available at this https URL

用于全面 RAG 流程的基准长问题回答数据集 ClapNQ 提供了准确、基于问句语境且无产生幻觉的答案，可以用于评估和改进基于 RAG 的模型。