Federated learning learns from scattered data by fusing collaborative models from local nodes. However, due to chaotic information distribution, the model fusion may suffer from structural misalignment with regard to unmatched parameters. In this work, we propose a novel federated learning framework to resolve this issue by establishing a firm structure-information alignment across collaborative models. Specifically, we design a feature-oriented regulation method ({$\Psi$-Net}) to ensure explicit feature information allocation in different neural network structures. Applying this regulating method to collaborative models, matchable structures with similar feature information can be initialized at the very early training stage. During the federated learning process under either IID or non-IID scenarios, dedicated collaboration schemes further guarantee ordered information distribution with definite structure matching, so as the comprehensive model alignment. Eventually, this framework effectively enhances the federated learning applicability to extensive heterogeneous settings, while providing excellent convergence speed, accuracy, and computation/communication efficiency.

本文提出了一种新颖的联邦学习框架，通过设计特征定向调节方法 (ψ-Net) 来确保显式特征信息在不同的神经网络结构中的分配，并应用于协作模型中，在通常分散和混乱的信息环境下，通过协定的时序，信息的有序分配及结构匹配，提高了联邦学习的适用性，同时提供了优秀的收敛速度、精度和计算/通信效率。

异构联邦学习