BriefGPT.xyz
Jun, 2016
ASAGA: 异步并行 SAGA
Asaga: Asynchronous Parallel Saga
HTML
PDF
Rémi Leblond, Fabian Pedregosa, Simon Lacoste-Julien
TL;DR
ASAGA是SAGA的异步并行版本,具有快速线性收敛率。通过重新访问并澄清了一些细微但重要的技术问题,ASAGA不需要稀疏假设即可在多核系统上获得线性加速,并通过40核架构的实现结果展示了实际加速以及硬件开销。
Abstract
We describe
asaga
, an asynchronous parallel version of the incremental gradient algorithm Saga that enjoys fast
linear convergence rates
. We highlight a subtle but important technical issue present in a large fra
→