Stein variational gradient descent (SVGD) is a deterministic particle
inference algorithm that provides an efficient alternative to Markov chain
Monte Carlo. However, SVGD has been found to suffer from variance
underestimation when the dimensionality of the target distribution is high.
Recent developments have advocated projecting both the score function and the
data onto real lines to sidestep this issue, although this can severely
overestimate the epistemic (model) uncertainty. In this work, we propose
Grassmann Stein variational gradient descent (GSVGD) as an alternative
approach, which permits projections onto arbitrary dimensional subspaces.
Compared with other variants of SVGD that rely on dimensionality reduction,
GSVGD updates the projectors simultaneously for the score function and the
data, and the optimal projectors are determined through a coupled
Grassmann-valued diffusion process which explores favourable subspaces. Both
our theoretical and experimental results suggest that GSVGD enjoys efficient
state-space exploration in high-dimensional problems that have an intrinsic
low-dimensional structure.

本研究提出了一种名为 Grassmann Stein 变分梯度下降 (GSVGD) 的新概念，用于处理维度高的目标分布问题，具备在高维空间中探索低维结构等特性。GSVGD 方法与其他变体方法相比，更新打分函数和数据的投影器并通过一种耦合的 Grassmann 值扩散进程确定最优投影器。理论和实验结果表明，GSVGD 在高维问题中具有高效的状态空间探索能力。