Out-of-distribution (OOD) generalization has long been a challenging problem
that remains largely unsolved. Gaussian processes (GP), as popular
probabilistic model classes, especially in the small data regime, presume
strong OOD generalization abilities. Surprisingly, their OOD generalization
abilities have been under-explored before compared with other lines of GP
research. In this paper, we identify that GP is not free from the problem and
propose a domain invariant learning algorithm for Gaussian processes (DIL-GP)
with a min-max optimization on the likelihood. DIL-GP discovers the
heterogeneity in the data and forces invariance across partitioned subsets of
data. We further extend the DIL-GP to improve Bayesian optimization's
adaptability on changing environments. Numerical experiments demonstrate the
superiority of DIL-GP for predictions on several synthetic and real-world
datasets. We further demonstrate the effectiveness of the DIL-GP Bayesian
optimization method on a PID parameters tuning experiment for a quadrotor. The
full version and source code are available at:
this https URL

高斯过程的领域不变学习算法（DIL-GP）使得预测在合成和真实的数据集上具备优越性；DIL-GP 贝叶斯优化方法在四旋翼 PID 参数调整实验中展现出有效性。