When a model's performance differs across socially or culturally relevant
groups--like race, gender, or the intersections of many such groups--it is
often called "biased." While much of the work in algorithmic fairness over the
last several years has focused on developing various definitions of model
fairness (the absence of group-wise model performance disparities) and
eliminating such "bias," much less work has gone into rigorously measuring it.
In practice, it important to have high quality, human digestible measures of
model performance disparities and associated uncertainty quantification about
them that can serve as inputs into multi-faceted decision-making processes. In
this paper, we show both mathematically and through simulation that many of the
metrics used to measure group-wise model performance disparities are themselves
statistically biased estimators of the underlying quantities they purport to
represent. We argue that this can cause misleading conclusions about the
relative group-wise model performance disparities along different dimensions,
especially in cases where some sensitive variables consist of categories with
few members. We propose the "double-corrected" variance estimator, which
provides unbiased estimates and uncertainty quantification of the variance of
model performance across groups. It is conceptually simple and easily
implementable without statistical software package or numerical optimization.
We demonstrate the utility of this approach through simulation and show on a
real dataset that while statistically biased estimators of group-wise model
performance disparities indicate statistically significant differences, when
accounting for statistical bias in the estimator, the estimated between-group
disparities are no longer statistically significant.

通过数学和模拟，作者表明现有的用于测量群体间的模型性能差异的度量大多是基于统计偏差的估计量，因此提出了一种 “双校正” 方差估计器，提供了模型性能在群体间变化的无偏估计和不确定性量化，这种方法在现实数据集上的应用表明，在统计偏差的影响下，群组间的性能差异不再显著。