Metropolis-Hastings (MH) is a commonly-used MCMC algorithm, but it can be
intractable on large datasets due to requiring computations over the whole
dataset. In this paper, we study minibatch MH methods, which instead use
subsamples to enable scaling. We observe that most existing minibatch MH
methods are inexact (i.e. they may change the target distribution), and show
that this inexactness can cause arbitrarily large errors in inference. We
propose a new exact minibatch MH method, TunaMH, which exposes a tunable
trade-off between its batch size and its theoretically guaranteed convergence
rate. We prove a lower bound on the batch size that any minibatch MH method
must use to retain exactness while guaranteeing fast convergence-the first such
bound for minibatch MH-and show TunaMH is asymptotically optimal in terms of
the batch size. Empirically, we show TunaMH outperforms other exact minibatch
MH methods on robust linear regression, truncated Gaussian mixtures, and
logistic regression.

本文提出了一种新的精确小批量 MH 方法 TunaMH，通过调节批大小与收敛速度之间的权衡来提高效率，并在鲁棒线性回归、截尾高斯混合以及逻辑回归中验证了 TunaMH 的优越性。