Semi-supervised Learning (SSL) has witnessed great success owing to the
impressive performances brought by various methods based on pseudo labeling and
consistency regularization. However, we argue that existing methods might fail
to utilize the unlabeled data more effectively since they either use a
pre-defined / fixed threshold or an ad-hoc threshold adjusting scheme,
resulting in inferior performance and slow convergence. We first analyze a
motivating example to obtain intuitions on the relationship between the
desirable threshold and model's learning status. Based on the analysis, we
hence propose FreeMatch to adjust the confidence threshold in a self-adaptive
manner according to the model's learning status. We further introduce a
self-adaptive class fairness regularization penalty to encourage the model for
diverse predictions during the early training stage. Extensive experiments
indicate the superiority of FreeMatch especially when the labeled data are
extremely rare. FreeMatch achieves 5.78%, 13.59%, and 1.28% error rate
reduction over the latest state-of-the-art method FlexMatch on CIFAR-10 with 1
label per class, STL-10 with 4 labels per class, and ImageNet with 100 labels
per class, respectively. Moreover, FreeMatch can also boost the performance of
imbalanced SSL. The codes can be found at
this https URL

本文提出一种自适应阈值调整方法 FreeMatch，以更好地利用未标记数据，另外还引入了自适应类公平性正则化惩罚来促进模型多样性预测。实验证明 FreeMatch 相对于最新的 FlexMatch 方法在 CIFAR-10、STL-10 和 ImageNet 上均表现更加优越，可提高不平衡 SSL 的性能。