BriefGPT.xyz
Jan, 2018
MINE: 互信息神经估计
MINE: Mutual Information Neural Estimation
HTML
PDF
Ishmael Belghazi, Sai Rajeswar, Aristide Baratin, R Devon Hjelm, Aaron Courville
TL;DR
本文提出了互信息神经估计（MINE），利用神经网络通过梯度下降来估计高维连续随机变量之间的互信息，并使用MINE来改进对抗训练的生成模型，并应用信息瓶颈来进行监督分类，实现了灵活性和性能的显著提高。
Abstract
We argue that the estimation of the
mutual information
between high dimensional continuous random variables is achievable by gradient descent over
neural networks
. This paper presents a
→