BriefGPT.xyz
May, 2017
过滤变分目标
Filtering Variational Objectives
HTML
PDF
Chris J. Maddison, Dieterich Lawson, George Tucker, Nicolas Heess, Mohammad Norouzi...
TL;DR
通过粒子滤波器的估计量来定义一类下限,即过滤变分目标 (FIVOs),利用模型的顺序结构形成更紧的下限。实验证明,相对于使用 ELBO 进行训练,在顺序数据上使用 FIVO 可以显著提高模型性能。
Abstract
The evidence lower bound (
elbo
) appears in many algorithms for maximum likelihood estimation (MLE) with latent variables because it is a sharp lower bound of the marginal log-likelihood. For neural
latent variable model
→