Human verbal communication includes affective messages which are conveyed
through use of emotionally colored words. There has been a lot of research in
this direction but the problem of integrating state-of-the-art neural language
models with affective information remains an area ripe for exploration. In this
paper, we propose an extension to an LSTM (Long Short-Term Memory) language
model for generating conversational text, conditioned on affect categories. Our
proposed model, Affect-LM enables us to customize the degree of emotional
content in generated sentences through an additional design parameter.
Perception studies conducted using Amazon Mechanical Turk show that Affect-LM
generates naturally looking emotional sentences without sacrificing grammatical
correctness. Affect-LM also learns affect-discriminative word representations,
and perplexity experiments show that additional affective information in
conversational text can improve language model prediction.

本文提出了一种基于 LSTM 模型的扩展 Affect-LM，用于在生成对话文本时增加情感内容的控制因素，研究表明，通过 Affect-LM 生成的自然语言句子不会破坏语法正确性。Affect-LM 学习到了区分情感的单词表达方式，迷惑度实验表明在对话文本中增加情感信息可以提高语言模型的预测效果。