BriefGPT.xyz
Jun, 2024
基于修正偏置动量的加速随机极小-极大优化
Accelerated Stochastic Min-Max Optimization Based on Bias-corrected Momentum
HTML
PDF
Haoyuan Cai, Sulaiman A. Alghunaim, Ali H. Sayed
TL;DR
针对非凸优化中最小最大优化问题,本研究提出了利用高效的Hessian-向量乘积的新型修正动量算法,建立了收敛条件并证明了所提算法的迭代复杂度为O(ε^{-3})。通过在实际数据集上进行鲁棒的逻辑回归的应用验证了该方法的有效性。
Abstract
Lower-bound analyses for nonconvex strongly-concave
minimax optimization
problems have shown that
stochastic first-order algorithms
require at least $\mathcal{O}(\varepsilon^{-4})$ oracle complexity to find an $\
→