Recently, utilizing deep neural networks to build the opendomain dialogue models has become a hot topic. However, the responses generated by these models suffer from many problems such as responses not being contextualized and tend to generate generic responses that lack information content, damaging the user's experience seriously. Therefore, many studies try introducing more information into the dialogue models to make the generated responses more vivid and informative. Unlike them, this paper improves the quality of generated responses by learning the implicit pattern information between contexts and responses in the training samples. In this paper, we first build an open-domain dialogue model based on the pre-trained language model (i.e., GPT-2). And then, an improved scheduled sampling method is proposed for pre-trained models, by which the responses can be used to guide the response generation in the training phase while avoiding the exposure bias problem. More importantly, we design a response-aware mechanism for mining the implicit pattern information between contexts and responses so that the generated replies are more diverse and approximate to human replies. Finally, we evaluate the proposed model (RAD) on the Persona-Chat and DailyDialog datasets; and the experimental results show that our model outperforms the baselines on most automatic and manual metrics.

本文介绍了一种基于预训练语言模型（GPT-2）的开放域对话模型，通过学习训练样本中上下文和回复之间的隐式模式信息，改进了生成回复的质量。我们提出了改进的预训练模型的定期抽样方法，并设计了一种回复感知机制，使生成的回复更加多样化和接近人类回复。通过在Persona-Chat和DailyDialog数据集上对所提出的模型（RAD）进行评估，实验结果表明我们的模型在大多数自动和手动评估指标上优于基线模型。

通过学习上下文和回应之间的模式信息来推动开放域对话生成