BriefGPT.xyz
Oct, 2019
深度神经网络中Fisher信息度量及其变体的病态谱
Pathological spectra of the Fisher information metric and its variants in deep neural networks
HTML
PDF
Ryo Karakida, Shotaro Akaho, Shun-ichi Amari
TL;DR
本文研究了Fisher信息矩阵以及其在深度神经网络中的特性,发现其存在尺度依赖性,具有病态的特征值谱,本研究提供了FIM和其变体的统一视角,以便更深入地理解大规模深度神经网络对学习的作用。
Abstract
The
fisher information matrix
(FIM) plays an essential role in statistics and machine
learning
as a Riemannian metric tensor. Focusing on the FIM and its variants in
→