BriefGPT.xyz
May, 2017
分布式SAGA：有限通信维持线性收敛速率
Distributed SAGA: Maintaining linear convergence rate with limited communication
HTML
PDF
Clément Calauzènes, Nicolas Le Roux
TL;DR
本研究提出了一种用于SAGA的分布式方案，该方案可以在节点间通信受限的情况下仍保持线性收敛速度，从而解决了大型数据集和集群推广时快速分布方法的需求。
Abstract
In recent years,
variance-reducing stochastic methods
have shown great practical performance, exhibiting
linear convergence rate
when other stochastic methods offered a sub-linear rate. However, as datasets grow
→