We propose to incorporate neural architecture search (NAS) into
general-purpose multi-task learning (GP-MTL). Existing NAS methods typically
define different search spaces according to different tasks. In order to adapt
to different task combinations (i.e., task sets), we disentangle the GP-MTL
networks into single-task backbones (optionally encode the task priors), and a
hierarchical and layerwise features sharing/fusing scheme across them. This
enables us to design a novel and general task-agnostic search space, which
inserts cross-task edges (i.e., feature fusion connections) into fixed
single-task network backbones. Moreover, we also propose a novel single-shot
gradient-based search algorithm that closes the performance gap between the
searched architectures and the final evaluation architecture. This is realized
with a minimum entropy regularization on the architecture weights during the
search phase, which makes the architecture weights converge to near-discrete
values and therefore achieves a single model. As a result, our searched model
can be directly used for evaluation without (re-)training from scratch. We
perform extensive experiments using different single-task backbones on various
task sets, demonstrating the promising performance obtained by exploiting the
hierarchical and layerwise features, as well as the desirable generalizability
to different i) task sets and ii) single-task backbones. The code of our paper
is available at this https URL

本文提出了将神经架构搜索（NAS）应用于通用多任务学习（GP-MTL）中的方法。我们将 GP-MTL 网络分解成单任务骨干和层级分层特征共享 / 融合，设计了一个新颖的通用任务无关搜索空间，并提出了一种新颖的单次梯度基于搜索算法。通过对体系结构权重进行最小熵正则化，使体系结构权重收敛到近离散值，从而实现单个模型，达到可直接用于评估且不必从头开始培训。