BriefGPT.xyz
May, 2017
深度学习算法概览
The Landscape of Deep Learning Algorithms
HTML
PDF
Pan Zhou, Jiashi Feng
TL;DR
这篇论文通过理论分析神经网络的收敛行为、稳定点及特性研究其经验风险的实证风险的景观,证明线性神经网络的实证风险在训练样本量为n、总权重维数为d、每层权重的度量边界为r时,具有一致收敛到其总体风险的速率。深度非线性神经网络的实证风险的收敛行为、梯度和非退化稳定点的特性也得到分析。
Abstract
This paper studies the landscape of
empirical risk
of
deep neural networks
by theoretically analyzing its
convergence behavior
to the
→