BriefGPT.xyz
Dec, 2014
任意采样坐标下降 II: 期望可分离上估计
Coordinate Descent with Arbitrary Sampling II: Expected Separable Overapproximation
HTML
PDF
Zheng Qu, Peter Richtárik
TL;DR
研究并分析随机坐标下降方法的设计和复杂度,特别是每次迭代在一个随机子集(采样)中更新的变体,这取决于期望可分离过逼近(ESO)的概念。本文为一类函数和任意采样推导了这种不等式,该方法基于与采样和描述函数的数据相关的特征值的研究。
Abstract
The design and complexity analysis of
randomized coordinate descent
methods, and in particular of variants which update a random subset (sampling) of coordinates in each iteration, depends on the notion of
expected sepa
→