BriefGPT.xyz
Mar, 2020
混合自动微分变分推断
Automatic Differentiation Variational Inference with Mixtures
HTML
PDF
Warren R. Morningstar, Sharad M. Vikram, Cusuh Ham, Andrew Gallagher, Joshua V. Dillon
TL;DR
本论文引入了分层抽样的方法,实现了对混合分布的自动微分变分推断(ADVI); 并且通过建立重要性加权自编码器(IWAE)类似的较紧下界,进一步验证了该方法相较于传统ELBO或IWAE的优势,特别是在latents变量中有多峰分布时,表现出更高的准确性和更好的校准性。
Abstract
automatic differentiation variational inference
(ADVI) is a useful tool for efficiently learning probabilistic models in
machine learning
. Generally approximate posteriors learned by ADVI are forced to be unimoda
→