BriefGPT.xyz
May, 2022
QUIC-FL: 快速无偏压缩联合学习
QUICK-FL: Quick Unbiased Compression for Federated Learning
HTML
PDF
Ran Ben Basat, Shay Vargaftik, Amit Portnoy, Gil Einziger, Yaniv Ben-Itzhak...
TL;DR
本文提出QUIC-FL算法,通过新颖的方法应用标准求解器来设计接近最优的无偏量化方案,以实现分布式平均估计。该算法不仅无偏,还具有快速的聚合时间和与最精确(聚合时间较长)的DME技术竞争力。
Abstract
distributed mean estimation
(DME) is a fundamental building block in communication efficient
federated learning
. In DME, clients communicate their lossily compressed gradients to the parameter server, which estim
→