Federated learning (FL) has enabled distributed learning of a model across
multiple clients in a privacy-preserving manner. One of the main challenges of
FL is to accommodate clients with varying hardware capacities; clients have
differing compute and memory requirements. To tackle this challenge, recent
state-of-the-art approaches leverage the use of early exits. Nonetheless, these
approaches fall short of mitigating the challenges of joint learning multiple
exit classifiers, often relying on hand-picked heuristic solutions for
knowledge distillation among classifiers and/or utilizing additional layers for
weaker classifiers. In this work, instead of utilizing multiple classifiers, we
propose a recurrent early exit approach named ReeFL that fuses features from
different sub-models into a single shared classifier. Specifically, we use a
transformer-based early-exit module shared among sub-models to i) better
exploit multi-layer feature representations for task-specific prediction and
ii) modulate the feature representation of the backbone model for subsequent
predictions. We additionally present a per-client self-distillation approach
where the best sub-model is automatically selected as the teacher of the other
sub-models at each client. Our experiments on standard image and speech
classification benchmarks across various emerging federated fine-tuning
baselines demonstrate ReeFL's effectiveness over previous works.

联合学习模型中，为了解决客户端硬件要求的不同挑战，本文提出了一种名为 ReeFL 的循环早期退出方法，通过融合不同子模型的特征到一个共享分类器中，利用基于 Transformer 的早期退出模块更好地利用多层次特征表示进行任务预测，并调节主干模型的特征表示用于后续预测，同时，通过每个客户端的自我蒸馏方法，在每个客户端自动选择最佳子模型作为其他子模型的教师模型。在标准图像和语音分类基准测试中，与之前的工作相比，实验证明了 ReeFL 的有效性。