Many real-world classification problems often have classes with very few
labeled training samples. Moreover, all possible classes may not be initially
available for training, and may be given incrementally. Deep learning models
need to deal with this two-fold problem in order to perform well in real-life
situations. In this paper, we propose a novel Few-Shot Lifelong Learning (FSLL)
method that enables deep learning models to perform lifelong/continual learning
on few-shot data. Our method selects very few parameters from the model for
training every new set of classes instead of training the full model. This
helps in preventing overfitting. We choose the few parameters from the model in
such a way that only the currently unimportant parameters get selected. By
keeping the important parameters in the model intact, our approach minimizes
catastrophic forgetting. Furthermore, we minimize the cosine similarity between
the new and the old class prototypes in order to maximize their separation,
thereby improving the classification performance. We also show that integrating
our method with self-supervision improves the model performance significantly.
We experimentally show that our method significantly outperforms existing
methods on the miniImageNet, CIFAR-100, and CUB-200 datasets. Specifically, we
outperform the state-of-the-art method by an absolute margin of 19.27% for the
CUB dataset.

本文提出了一种新的少样本生命周期学习方法，通过仅训练模型的部分参数来防止过拟合，同时最大程度上减少了灾难性遗忘，并通过减小新旧类别原型之间的余弦相似度以最大化它们的分离来提高分类性能，同时还证明了结合自我监督的方法可以显著提高模型性能。