Unsupervised representation learning with contrastive learning achieved great
success. This line of methods duplicate each training batch to construct
contrastive pairs, making each training batch and its augmented version
forwarded simultaneously and leading to additional computation. We propose a
new jigsaw clustering pretext task in this paper, which only needs to forward
each training batch itself, and reduces the training cost. Our method makes use
of information from both intra- and inter-images, and outperforms previous
single-batch based ones by a large margin. It is even comparable to the
contrastive learning methods when only half of training batches are used.
Our method indicates that multiple batches during training are not necessary,
and opens the door for future research of single-batch unsupervised methods.
Our models trained on ImageNet datasets achieve state-of-the-art results with
linear classification, outperforming previous single-batch methods by 2.6%.
Models transferred to COCO datasets outperform MoCo v2 by 0.4% with only half
of the training batches. Our pretrained models outperform supervised ImageNet
pretrained models on CIFAR-10 and CIFAR-100 datasets by 0.9% and 4.1%
respectively. Code is available at
this https URL

本文介绍了一种新的基于拼图聚类的预处理任务方式，可在降低训练成本的同时充分利用图像内部和外部信息进行训练，实现了与对比学习方法相当的效果，甚至在只使用一半的训练批次时也能够优于其他单批次方法。通过预训练模型，最终在 ImageNet 、CIFAR-10 和 CIFAR-100 数据集上实现了优异的成果。