The emerging concern about data privacy and security has motivated the
proposal of federated learning, which allows nodes to only synchronize the
locally-trained models instead their own original data. Conventional federated
learning architecture, inherited from the parameter server design, relies on
highly centralized topologies and the assumption of large nodes-to-server
bandwidths. However, in real-world federated learning scenarios the network
capacities between nodes are highly uniformly distributed and smaller than that
in a datacenter. It is of great challenges for conventional federated learning
approaches to efficiently utilize network capacities between nodes. In this
paper, we propose a model segment level decentralized federated learning to
tackle this problem. In particular, we propose a segmented gossip approach,
which not only makes full utilization of node-to-node bandwidth, but also has
good training convergence. The experimental results show that even the training
time can be highly reduced as compared to centralized federated learning.

本文提出了一种基于模型细分的分散式联邦学习方法，并采用细分的 “流言” 方法来实现节点间对等带宽的充分利用和良好的训练收敛性，在实验中，与中心化联邦学习相比，能够大大缩短训练时间。