Large language models (LLMs) have been shown to perform well in answering
questions and in producing long-form texts, both in few-shot closed-book
settings. While the former can be validated using well-known evaluation
metrics, the latter is difficult to evaluate. We resolve the difficulties to
evaluate long-form output by doing both tasks at once -- to do question
answering that requires long-form answers. Such questions tend to be
multifaceted, i.e., they may have ambiguities and/or require information from
multiple sources. To this end, we define query refinement prompts that
encourage LLMs to explicitly express the multifacetedness in questions and
generate long-form answers covering multiple facets of the question. Our
experiments on two long-form question answering datasets, ASQA and AQuAMuSe,
show that using our prompts allows us to outperform fully finetuned models in
the closed book setting, as well as achieve results comparable to
retrieve-then-generate open-book models.

通过定义查询细化提示，可以提高大型语言模型在长篇输出评估和多方面问题回答中的表现，并在闭书问题回答设置中胜过完全微调模型，并取得与检索后生成开书模型相当的结果。