BriefGPT.xyz
Aug, 2023
从遍历理论角度看深度神经网络
Deep neural networks from the perspective of ergodic theory
HTML
PDF
Fan Zhang
TL;DR
深度神经网络的设计仍然更像是一门艺术而不是精确的科学，本文通过将网络视为动力系统的时间演化，并采用遍历论的考虑，将每一层视为一个时间实例，揭示了一些看似神秘的经验准则可以归因于启发式方法。
Abstract
The design of
deep neural networks
remains somewhat of an art rather than precise science. By tentatively adopting
ergodic theory
considerations on top of viewing the network as the time evolution of a
→