Prompt tuning has emerged as an effective rehearsal-free technique for
class-incremental learning (CIL) that learns a tiny set of task-specific
parameters (or prompts) to instruct a pre-trained transformer to learn on a
sequence of tasks. Albeit effective, prompt tuning methods do not lend well in
the multi-label class incremental learning (MLCIL) scenario (where an image
contains multiple foreground classes) due to the ambiguity in selecting the
correct prompt(s) corresponding to different foreground objects belonging to
multiple tasks. To circumvent this issue we propose to eliminate the prompt
selection mechanism by maintaining task-specific pathways, which allow us to
learn representations that do not interact with the ones from the other tasks.
Since independent pathways in truly incremental scenarios will result in an
explosion of computation due to the quadratically complex multi-head
self-attention (MSA) operation in prompt tuning, we propose to reduce the
original patch token embeddings into summarized tokens. Prompt tuning is then
applied to these fewer summarized tokens to compute the final representation.
Our proposed method Multi-Label class incremental learning via summarising
pAtch tokeN Embeddings (MULTI-LANE) enables learning disentangled task-specific
representations in MLCIL while ensuring fast inference. We conduct experiments
in common benchmarks and demonstrate that our MULTI-LANE achieves a new
state-of-the-art in MLCIL. Additionally, we show that MULTI-LANE is also
competitive in the CIL setting. Source code available at
this https URL

通过提出的多标签增量学习方法 MULTI-LANE，我们能够在不同前景对象属于多个任务时，通过维护任务特定路径来消除选择提示的机制，并通过总结的标记对这些减少后的标记应用提示调整以计算最终表示，这使得我们能够学习在多标签增量学习中解耦的任务特定表示，并确保快速推断。