Natural Language Understanding (NLU) is a core component of dialog systems.
It typically involves two tasks - intent classification (IC) and slot labeling
(SL), which are then followed by a dialogue management (DM) component. Such NLU
systems cater to utterances in isolation, thus pushing the problem of context
management to DM. However, contextual information is critical to the correct
prediction of intents and slots in a conversation. Prior work on contextual NLU
has been limited in terms of the types of contextual signals used and the
understanding of their impact on the model. In this work, we propose a
context-aware self-attentive NLU (CASA-NLU) model that uses multiple signals,
such as previous intents, slots, dialog acts and utterances over a variable
context window, in addition to the current user utterance. CASA-NLU outperforms
a recurrent contextual NLU baseline on two conversational datasets, yielding a
gain of up to 7% on the IC task for one of the datasets. Moreover, a
non-contextual variant of CASA-NLU achieves state-of-the-art performance for IC
task on standard public datasets - Snips and ATIS.

本文针对当前自然语言理解中存在的上下文信息缺失问题，提出了一种基于多信号的上下文感知自注意力自然语言理解 (CASA-NLU) 的模型，其能够获得比传统循环神经网络基线更好的性能，在两个对话数据集上分别提升了 IC 的任务 7% 和公共数据集 Snips 和 ATIS 的非上下文 CASA-NLU 模型取得了最先进的性能。