Federated learning (FL) has been promoted as a popular technique for training
machine learning (ML) models over edge/fog networks. Traditional
implementations of FL have largely neglected the potential for inter-network
cooperation, treating edge/fog devices and other infrastructure participating
in ML as separate processing elements. Consequently, FL has been vulnerable to
several dimensions of network heterogeneity, such as varying computation
capabilities, communication resources, data qualities, and privacy demands. We
advocate for cooperative federated learning (CFL), a cooperative edge/fog ML
paradigm built on device-to-device (D2D) and device-to-server (D2S)
interactions. Through D2D and D2S cooperation, CFL counteracts network
heterogeneity in edge/fog networks through enabling a model/data/resource
pooling mechanism, which will yield substantial improvements in ML model
training quality and network resource consumption. We propose a set of core
methodologies that form the foundation of D2D and D2S cooperation and present
preliminary experiments that demonstrate their benefits. We also discuss new FL
functionalities enabled by this cooperative framework such as the integration
of unlabeled data and heterogeneous device privacy into ML model training.
Finally, we describe some open research directions at the intersection of
cooperative edge/fog and FL.

提出一种合作的边缘 / 雾设备机器学习范例 — 合作联邦学习 (CFL)，通过设备之间和设备与服务器之间的协作，实现模型 / 数据 / 资源池化机制，以解决边缘 / 雾网络中网络异构性问题，提高机器学习模型的质量和网络此消耗。同时，该范例还支持无标签数据和异构设备隐私等新功能。