In class incremental learning (CIL) a model must learn new classes in a
sequential manner without forgetting old ones. However, conventional CIL
methods consider a balanced distribution for each new task, which ignores the
prevalence of long-tailed distributions in the real world. In this work we
propose two long-tailed CIL scenarios, which we term ordered and shuffled
LT-CIL. Ordered LT-CIL considers the scenario where we learn from head classes
collected with more samples than tail classes which have few. Shuffled LT-CIL,
on the other hand, assumes a completely random long-tailed distribution for
each task. We systematically evaluate existing methods in both LT-CIL scenarios
and demonstrate very different behaviors compared to conventional CIL
scenarios. Additionally, we propose a two-stage learning baseline with a
learnable weight scaling layer for reducing the bias caused by long-tailed
distribution in LT-CIL and which in turn also improves the performance of
conventional CIL due to the limited exemplars. Our results demonstrate the
superior performance (up to 6.44 points in average incremental accuracy) of our
approach on CIFAR-100 and ImageNet-Subset. The code is available at
this https URL

本文提出了两种长尾分布的增量学习场景，研究了在这两个场景下现有方法的表现，并提出了一种包含学习可调权重层的两阶段基线，用于减少由长尾分布引起的偏差，同时提高常规增量学习的性能。在 CIFAR-100 和 ImageNet-Subset 上，该方法表现卓越（最高平均增量精度提高 6.44 个百分点）。