具有矩阵指数激活函数的三层网络的解析解

Jul, 2024

Analytical Solution of a Three-layer Network with a Matrix Exponential Activation Function

Kuo Gai, Shihua Zhang

TL;DR本文通过找到具有矩阵指数激活函数的三层网络的解析解，证明了深度和非线性激活函数的能力，表明深层网络比浅层网络更强大，且一层网络只能解决一个方程。

Abstract

In practice, deeper networks tend to be more powerful than shallow ones, but this has not been understood theoretically. In this paper, we find the →