Generating diverse, interesting responses to chitchat conversations is a
problem for neural conversational agents. This paper makes two substantial
contributions to improving diversity in dialogue generation. First, we propose
a novel metric which uses Natural Language Inference (NLI) to measure the
semantic diversity of a set of model responses for a conversation. We evaluate
this metric using an established framework (Tevet and Berant, 2021) and find
strong evidence indicating NLI Diversity is correlated with semantic diversity.
Specifically, we show that the contradiction relation is more useful than the
neutral relation for measuring this diversity and that incorporating the NLI
model's confidence achieves state-of-the-art results. Second, we demonstrate
how to iteratively improve the semantic diversity of a sampled set of responses
via a new generation procedure called Diversity Threshold Generation, which
results in an average 137% increase in NLI Diversity compared to standard
generation procedures.

本文通过提出一种新的度量方法和一种称为 Diversity Threshold Generation 的新生成程序来改进对话生成，从而在多样性方面取得了显著进展。