BriefGPT.xyz
Apr, 2018
宽深神经网络中的高斯过程行为
Gaussian Process Behaviour in Wide Deep Neural Networks
HTML
PDF
Alexander G. de G. Matthews, Mark Rowland, Jiri Hron, Richard E. Turner, Zoubin Ghahramani
TL;DR
本研究研究了深度神经网络和高斯过程之间的联系,指出在广泛的条件下,随着体系结构越来越宽,隐含的随机函数在分布上会趋于高斯过程,并使用最大平均偏差评估收敛速率。最后,将贝叶斯深度网络与高斯过程进行比较,并从文献中回顾了非高斯替代模型。
Abstract
Whilst
deep neural networks
have shown great empirical success, there is still much work to be done to understand their theoretical properties. In this paper, we study the relationship between
gaussian processes
→