Under the organization of the base station (BS), wireless federated learning
(FL) enables collaborative model training among multiple devices. However, the
BS is merely responsible for aggregating local updates during the training
process, which incurs a waste of the computational resource at the BS. To
tackle this issue, we propose a semi-federated learning (SemiFL) paradigm to
leverage the computing capabilities of both the BS and devices for a hybrid
implementation of centralized learning (CL) and FL. Specifically, each device
sends both local gradients and data samples to the BS for training a shared
global model. To improve communication efficiency over the same time-frequency
resources, we integrate over-the-air computation for aggregation and
non-orthogonal multiple access for transmission by designing a novel
transceiver structure. To gain deep insights, we conduct convergence analysis
by deriving a closed-form optimality gap for SemiFL and extend the result to
two extra cases. In the first case, the BS uses all accumulated data samples to
calculate the CL gradient, while a decreasing learning rate is adopted in the
second case. Our analytical results capture the destructive effect of wireless
communication and show that both FL and CL are special cases of SemiFL. Then,
we formulate a non-convex problem to reduce the optimality gap by jointly
optimizing the transmit power and receive beamformers. Accordingly, we propose
a two-stage algorithm to solve this intractable problem, in which we provide
the closed-form solutions to the beamformers. Extensive simulation results on
two real-world datasets corroborate our theoretical analysis, and show that the
proposed SemiFL outperforms conventional FL and achieves 3.2% accuracy gain on
the MNIST dataset compared to state-of-the-art benchmarks.

通过提出一种半联合学习（SemiFL）范式，将基站（BS）和设备的计算能力结合起来，实现集中式学习（CL）和联邦学习（FL）的混合实施。通过设计一种新颖的收发器结构，将空中计算和非正交多址接入应用于聚合和传输，提高了通信效率，并证明了 FL 和 CL 是 SemiFL 的特例。然后，通过联合优化发送功率和接收波束形成器来减小最优性差距，并提供了解析解。两个真实数据集上的广泛模拟实验结果证实了我们的理论分析，并显示相比于最先进的基准，所提出的 SemiFL 在 MNIST 数据集上取得了 3.2% 的准确度提高。