Multitask learning (MTL) has gained prominence for its ability to jointly
predict multiple tasks, achieving better per-task performance while using fewer
per-task model parameters than single-task learning. More recently,
decoder-focused architectures have considerably improved multitask performance
by refining task predictions using the features of other related tasks.
However, most of these refinement methods fail to simultaneously capture local
and global task-specific representations, as well as cross-task patterns in a
parameter-efficient manner. In this paper, we introduce the Efficient Multitask
Affinity Learning Network (EMA-Net), which is a lightweight framework that
enhances the task refinement capabilities of multitask networks. EMA-Net
adeptly captures local, global, and cross-task interactions using our novel
Cross-Task Affinity Learning (CTAL) module. The key innovation of CTAL lies in
its ability to manipulate task affinity matrices in a manner that is optimally
suited to apply parameter-efficient grouped convolutions without worrying about
information loss. Our results show that we achieve state-of-the-art MTL
performance for CNN-based decoder-focused models while using substantially
fewer model parameters. Our code is publicly available at
this https URL

通过引入 Efficient Multitask Affinity Learning Network (EMA-Net)，本文提出了一种轻量级框架用于增强多任务网络的任务改进能力，其关键创新点在于使用 Cross-Task Affinity Learning (CTAL) 模块来有效捕捉本地、全局和跨任务交互，并且能够进行信息损失最小化的参数高效分组卷积操作。实验结果表明，在卷积神经网络的解码器重点模型中，我们取得了最先进的多任务学习性能，同时使用了大大较少的模型参数。