We introduce end-to-end neural network based models for simulating users of
task-oriented dialogue systems. User simulation in dialogue systems is crucial
from two different perspectives: (i) automatic evaluation of different dialogue
models, and (ii) training task-oriented dialogue systems. We design a
hierarchical sequence-to-sequence model that first encodes the initial user
goal and system turns into fixed length representations using Recurrent Neural
Networks (RNN). It then encodes the dialogue history using another RNN layer.
At each turn, user responses are decoded from the hidden representations of the
dialogue level RNN. This hierarchical user simulator (HUS) approach allows the
model to capture undiscovered parts of the user goal without the need of an
explicit dialogue state tracking. We further develop several variants by
utilizing a latent variable model to inject random variations into user
responses to promote diversity in simulated user responses and a novel goal
regularization mechanism to penalize divergence of user responses from the
initial user goal. We evaluate the proposed models on movie ticket booking
domain by systematically interacting each user simulator with various dialogue
system policies trained with different objectives and users.

本论文提出一种基于神经网络的端到端用户仿真模型，用于对话系统的自动评估和训练，采用分层序列到序列模型，并利用隐变量模型引入随机变化，以提高仿真用户响应的多样性，并制定了目标正则化机制，以惩罚用户对初始用户目标的偏离。