Existing continual learning literature relies heavily on a strong assumption
that tasks arrive with a balanced data stream, which is often unrealistic in
real-world applications. In this work, we explore task-imbalanced continual
learning (TICL) scenarios where the distribution of task data is non-uniform
across the whole learning process. We find that imbalanced tasks significantly
challenge the capability of models to control the trade-off between stability
and plasticity from the perspective of recent prompt-based continual learning
methods. On top of the above finding, we propose Dynamically Anchored Prompting
(DAP), a prompt-based method that only maintains a single general prompt to
adapt to the shifts within a task stream dynamically. This general prompt is
regularized in the prompt space with two specifically designed prompt anchors,
called boosting anchor and stabilizing anchor, to balance stability and
plasticity in TICL. Remarkably, DAP achieves this balance by only storing a
prompt across the data stream, therefore offering a substantial advantage in
rehearsal-free CL. Extensive experiments demonstrate that the proposed DAP
results in 4.5% to 15% absolute improvements over state-of-the-art methods on
benchmarks under task-imbalanced settings. Our code is available at
this https URL

本研究探讨了任务不平衡连续学习（TICL）场景下，基于提示的动态锚定方法（DAP）在稳定性和可塑性之间寻求平衡，为 TICL 中的数据流改变提供了 4.5% 到 15% 的绝对改进。