One critical issue for chat systems is to stay consistent about preferences,
opinions, beliefs and facts of itself, which has been shown a difficult
problem. In this work, we study methods to assess and bolster utterance
consistency of chat systems. A dataset is first developed for studying the
inconsistencies, where inconsistent dialogue responses, explanations of the
inconsistencies, and recovery utterances are authored by annotators. This
covers the life span of inconsistencies, namely introduction, understanding,
and resolution. Building on this, we introduce a set of tasks centered on
dialogue consistency, specifically focused on its detection and resolution. Our
experimental findings indicate that our dataset significantly helps the
progress in identifying and resolving conversational inconsistencies, and
current popular large language models like ChatGPT which are good at resolving
inconsistencies however still struggle with detection.

研究论文强调了聊天系统的一致性问题，介绍了一个用于研究对话一致性的数据集和一系列任务，实验证明该数据集对于检测和解决会话中的不一致性有显著帮助，同时发现当前流行的大型语言模型如 ChatGPT 在解决不一致性方面表现良好但在检测方面仍存在困难。