BriefGPT.xyz
May, 2023
如何逃离尖锐的极小值
How to escape sharp minima
HTML
PDF
Kwangjun Ahn, Ali Jadbabaie, Suvrit Sra
TL;DR
探讨了如何高效地找到近似的优化算法的平坦极值，提出了基于梯度和随机扰动的算法，在训练数据成本函数的情况下，提出了更快的算法。
Abstract
Modern
machine learning
applications have seen a remarkable success of
optimization
algorithms that are designed to find
flat minima
. Moti
→