Existing calibration algorithms address the problem of covariate shift via unsupervised domain adaptation. However, these methods suffer from the following limitations: 1) they require unlabeled data from the target domain, which may not be available at the stage of calibration in real-world applications and 2) their performances heavily depend on the disparity between the distributions of the source and target domains. To address these two limitations, we present novel calibration solutions via domain generalization which, to the best of our knowledge, are the first of their kind. Our core idea is to leverage multiple calibration domains to reduce the effective distribution disparity between the target and calibration domains for improved calibration transfer without needing any data from the target domain. We provide theoretical justification and empirical experimental results to demonstrate the effectiveness of our proposed algorithms. Compared against the state-of-the-art calibration methods designed for domain adaptation, we observe a decrease of 8.86 percentage points in expected calibration error, equivalently an increase of 35 percentage points in improvement ratio, for multi-class classification on the Office-Home dataset.

本文提出一种基于域泛化的新型校准方法，通过利用多个校准域来减少目标域与校准域之间的分布差异，实现校准转移的改进，并且不需要来自目标域的数据，通过理论和实证实验的方法展示了该方法的有效性，并比较了其表现与其他基于域适应的最先进的校准方法。实验表明，在Office-Home数据集上的多类别分类中，我们所提出的校准方法的表现提高了35个百分点，期望校准误差降低了8.86个百分点。

基于协变量漂移的领域泛化可信度校准