A common heuristic in semi-supervised deep learning (SSDL) is to select
unlabelled data based on a notion of semantic similarity to the labelled data.
For example, labelled images of numbers should be paired with unlabelled images
of numbers instead of, say, unlabelled images of cars. We refer to this
practice as semantic data set matching. In this work, we demonstrate the limits
of semantic data set matching. We show that it can sometimes even degrade the
performance for a state of the art SSDL algorithm. We present and make
available a comprehensive simulation sandbox, called non-IID-SSDL, for stress
testing an SSDL algorithm under different degrees of distribution mismatch
between the labelled and unlabelled data sets. In addition, we demonstrate that
simple density based dissimilarity measures in the feature space of a generic
classifier offer a promising and more reliable quantitative matching criterion
to select unlabelled data before SSDL training.

本文研究了半监督深度学习中的语义数据集匹配，证明其在某些情况下甚至会降低最先进算法的性能，并提出了一种更可靠的选择无标签数据的定量匹配标准，即使用基于密度的不相似性度量在通用分类器的特征空间中进行。