Representation learning promises to unlock deep learning for the long tail of
vision tasks without expensive labelled datasets. Yet, the absence of a unified
evaluation for general visual representations hinders progress. Popular
protocols are often too constrained (linear classification), limited in
diversity (ImageNet, CIFAR, Pascal-VOC), or only weakly related to
representation quality (ELBO, reconstruction error). We present the Visual Task
Adaptation Benchmark (VTAB), which defines good representations as those that
adapt to diverse, unseen tasks with few examples. With VTAB, we conduct a
large-scale study of many popular publicly-available representation learning
algorithms. We carefully control confounders such as architecture and tuning
budget. We address questions like: How effective are ImageNet representations
beyond standard natural datasets? How do representations trained via generative
and discriminative models compare? To what extent can self-supervision replace
labels? And, how close are we to general visual representations?

通过自我监督、生成模型等方法训练的视觉特征表示可以非常好的通用于各种不同的视觉任务，并且对于一些任务可以取代需要大量标注数据的监督学习方法