BriefGPT.xyz
Jun, 2020
发现参数激活函数
Discovering Parametric Activation Functions
HTML
PDF
Garrett Bingham, Risto Miikkulainen
TL;DR
本文提出了一种使用进化搜索和梯度下降优化参数的方法来自动定制激活函数，实现对深度学习网络性能的可靠优化，验证结果表明该方法可以用作新任务的自动优化步骤。
Abstract
Recent studies have shown that the choice of
activation function
can significantly affect the performance of
deep learning
networks. However, the benefits of novel activation functions have been inconsistent and
→