Latent Gaussian models have a rich history in statistics and machine
learning, with applications ranging from factor analysis to compressed sensing
to time series analysis. The classical method for maximizing the likelihood of
these models is the expectation-maximization (EM) algorithm. For problems with
high-dimensional latent variables and large datasets, EM scales poorly because
it needs to invert as many large covariance matrices as the number of data
points. We introduce probabilistic unrolling, a method that combines Monte
Carlo sampling with iterative linear solvers to circumvent matrix inversion.
Our theoretical analyses reveal that unrolling and backpropagation through the
iterations of the solver can accelerate gradient estimation for maximum
likelihood estimation. In experiments on simulated and real data, we
demonstrate that probabilistic unrolling learns latent Gaussian models up to an
order of magnitude faster than gradient EM, with minimal losses in model
performance.

本文提出了一种用概率展开和迭代线性求解器相结合的方法，以绕过矩阵求逆的问题来学习潜在高斯模型，在实验中发现，这种方法可以比传统梯度期望极大化算法快一个数量级地学习潜在高斯模型。