Being able to generate informative and coherent dialogue responses is crucial
when designing human-like open-domain dialogue systems. Encoder-decoder-based
dialogue models tend to produce generic and dull responses during the decoding
step because the most predictable response is likely to be a non-informative
response instead of the most suitable one. To alleviate this problem, we
propose to train the generation model in a bidirectional manner by adding a
backward reasoning step to the vanilla encoder-decoder training. The proposed
backward reasoning step pushes the model to produce more informative and
coherent content because the forward generation step's output is used to infer
the dialogue context in the backward direction. The advantage of our method is
that the forward generation and backward reasoning steps are trained
simultaneously through the use of a latent variable to facilitate bidirectional
optimization. Our method can improve response quality without introducing side
information (e.g., a pre-trained topic model). The proposed bidirectional
response generation method achieves state-of-the-art performance for response
quality.

本文提出一种双向推理的生成模型，通过向基础的编码解码模型添加后向推理步骤，推动模型产生更多信息丰富、连贯的回复，实现了双向优化，最终提升了响应质量，成为当前响应质量最好的方法之一。