Virtually all of deep learning literature relies on the assumption of large
amounts of available training data. Indeed, even the majority of few-shot
learning methods rely on a large set of "base classes" for pretraining. This
assumption, however, does not always hold. For some tasks, annotating a large
number of classes can be infeasible, and even collecting the images themselves
can be a challenge in some scenarios. In this paper, we study this problem and
call it "Small Data" setting, in contrast to "Big Data". To unlock the full
potential of small data, we propose to augment the models with annotations for
other related tasks, thus increasing their generalization abilities. In
particular, we use the richly annotated scene parsing dataset ADE20K to
construct our realistic Long-tail Recognition with Diverse Supervision (LRDS)
benchmark by splitting the object categories into head and tail based on their
distribution. Following the standard few-shot learning protocol, we use the
head classes for representation learning and the tail classes for evaluation.
Moreover, we further subsample the head categories and images to generate two
novel settings which we call "Scarce-Class" and "Scarce-Image", respectively
corresponding to the shortage of samples for rare classes and training images.
Finally, we analyze the effect of applying various additional supervision
sources under the proposed settings. Our experiments demonstrate that densely
labeling a small set of images can indeed largely remedy the small data
constraints.

本研究探讨了在小数据情况下的长尾识别问题，提出了一种以自然场景解析数据集 ADE20K 为基础的模型增强方法，并划分不同分布的头尾目标类别进行表示学习和评估，其中进一步围绕 “稀有类别” 和 “训练图像匮乏” 构建了两个新的研究方向，实验表明通过密集标注少量图像即可在一定程度上缓解小数据约束。