Recent works have advanced the performance of self-supervised representation
learning by a large margin. The core among these methods is intra-image
invariance learning. Two different transformations of one image instance are
considered as a positive sample pair, where various tasks are designed to learn
invariant representations by comparing the pair. Analo