BriefGPT.xyz
Dec, 2019
基于松弛梯度支持追踪的高效稀疏受限非凸优化
Efficient Relaxed Gradient Support Pursuit for Sparsity Constrained Non-convex Optimization
HTML
PDF
Fanhua Shang, Bingkun Wei, Hongying Liu, Yuanyuan Liu, Jiacheng Zhuo
TL;DR
论文提出了一种新的松弛梯度支持追踪(RGraSP)框架,其中次算法只需满足弱下降条件,两个特定的半随机梯度硬阈值算法的硬阈值操作比SVRGHT少,每次迭代的平均成本更低,该方法具有更快的收敛速度。
Abstract
Large-scale non-convex
sparsity-constrained problems
have recently gained extensive attention. Most existing deterministic optimization methods (e.g., GraSP) are not suitable for large-scale and high-dimensional problems, and thus
→