BriefGPT.xyz
Jun, 2024
理解随机自然梯度变分推断
Understanding Stochastic Natural Gradient Variational Inference
HTML
PDF
Kaiwen Wu, Jacob R. Gardner
TL;DR
随机自然梯度变分推断方法(NGVI)在各种概率模型中被广泛应用,本文对其非渐近收敛速度进行研究,证明了对于共轭似然情况下的非渐近收敛率为1/T,而对于非共轭似然情况下的随机NGVI,证明了它隐式地优化了一个非凸目标。
Abstract
stochastic natural gradient variational inference
(NGVI) is a popular posterior inference method with applications in various
probabilistic models
. Despite its wide usage, little is known about the non-asymptotic
→