Slot filling is one of the critical tasks in modern conversational systems.
The majority of existing literature employs supervised learning methods, which
require labeled training data for each new domain. Zero-shot learning and weak
supervision approaches, among others, have shown promise as alternatives to
manual labeling. Nonetheless, these learning paradigms are significantly
inferior to supervised learning approaches in terms of performance. To minimize
this performance gap and demonstrate the possibility of open-domain slot
filling, we propose a Self-supervised Co-training framework, called SCot, that
requires zero in-domain manually labeled training examples and works in three
phases. Phase one acquires two sets of complementary pseudo labels
automatically. Phase two leverages the power of the pre-trained language model
BERT, by adapting it for the slot filling task using these sets of pseudo
labels. In phase three, we introduce a self-supervised cotraining mechanism,
where both models automatically select highconfidence soft labels to further
improve the performance of the other in an iterative fashion. Our thorough
evaluations show that SCot outperforms state-of-the-art models by 45.57% and
37.56% on SGD and MultiWoZ datasets, respectively. Moreover, our proposed
framework SCot achieves comparable performance when compared to
state-of-the-art fully supervised models.

这篇论文提出了一个名为 SCot 的自我监督协同训练框架，它需要零个领域内手动标记的训练例子，并且通过引入三个阶段来最小化性能差距，证明了在开放域槽填充中可行性，通过使用伪标签和自我监督强化三个阶段的性能，SCot 在 SGD 和 MultiWoZ 数据集上的性能比现有的模型分别提高了 45.57％和 37.56％。