Self-supervision has emerged as a propitious method for visual representation
learning after the recent paradigm shift from handcrafted pretext tasks to
instance-similarity based approaches. Most state-of-the-art methods enforce
similarity between various augmentations of a given image, while some methods
additionally use contrastive approaches to explicitly ensure diverse
representations. While these approaches have indeed shown promising direction,
they require a significantly larger number of training iterations when compared
to the supervised counterparts. In this work, we explore reasons for the slow
convergence of these methods, and further propose to strengthen them using
well-posed auxiliary tasks that converge significantly faster, and are also
useful for representation learning. The proposed method utilizes the task of
rotation prediction to improve the efficiency of existing state-of-the-art
methods. We demonstrate significant gains in performance using the proposed
method on multiple datasets, specifically for lower training epochs.

本研究提出一种新的辅助任务 —— 旋转预测，用于加强现有最先进的基于相似性和对比性方法，并在多个数据集上证明了我们的方法能显着提高性能。