Human dialogue contains evolving concepts, and speakers naturally associate
multiple concepts to compose a response. However, current dialogue models with
the seq2seq framework lack the ability to effectively manage concept
transitions and can hardly introduce multiple concepts to responses in a
sequential decoding manner. To facilitate a controllable and coherent dialogue,
in this work, we devise a concept-guided non-autoregressive model (CG-nAR) for
open-domain dialogue generation. The proposed model comprises a multi-concept
planning module that learns to identify multiple associated concepts from a
concept graph and a customized Insertion Transformer that performs
concept-guided non-autoregressive generation to complete a response. The
experimental results on two public datasets show that CG-nAR can produce
diverse and coherent responses, outperforming state-of-the-art baselines in
both automatic and human evaluations with substantially faster inference speed.

设计一个基于概念引导的非自回归模型，为了更好地管理概念转换并能够顺序解码引入多个概念，实现可控和连贯的对话生成，实验表明该模型在速度和质量上都优于现有最先进的模型。