BriefGPT.xyz
Sep, 2019
探究神经网络训练中噪声的重要性
Towards Understanding the Importance of Noise in Training Neural Networks
HTML
PDF
Mo Zhou, Tianyi Liu, Yan Li, Dachao Lin, Enlu Zhou...
TL;DR
本文研究神经网络的训练优化问题，利用噪音及扰动的梯度下降和随机梯度下降算法能够在多项式时间内收敛到全局最优解，消除了局部最优解问题。
Abstract
Numerous empirical evidence has corroborated that the
noise
plays a crucial rule in effective and efficient training of
neural networks
. The theory behind, however, is still largely unknown. This paper studies th
→