While pre-trained large-scale deep models have garnered attention as an
important topic for many downstream natural language processing (NLP) tasks,
such models often make unreliable predictions on out-of-distribution (OOD)
inputs. As such, OOD detection is a key component of a reliable
machine-learning model for any industry-scale application. Common approaches
often assume access to additional OOD samples during the training stage,
however, outlier distribution is often unknown in advance. Instead, we propose
a post hoc framework called POORE - POsthoc pseudo-Ood REgularization, that
generates pseudo-OOD samples using in-distribution (IND) data. The model is
fine-tuned by introducing a new regularization loss that separates the
embeddings of IND and OOD data, which leads to significant gains on the OOD
prediction task during testing. We extensively evaluate our framework on three
real-world dialogue systems, achieving new state-of-the-art in OOD detection.

本文提出 POORE - POsthoc pseudo-Ood REgularization 框架，通过在内部数据中生成伪 OOD 数据进行 fine-tune，通过引入新的正则化损失来分离 IND 和 OOD 数据的嵌入，提高了 OOD 预测任务的准确度，相较现有方法在三个实际对话系统上获得了最新的技术进展。