Large, pre-trained representation models trained using self-supervised
learning have gained popularity in various fields of machine learning because
they are able to extract high-quality salient features from input data. As
such, they have been frequently used as base networks for vari