Most proposed algorithmic fairness techniques require access to data on a
"sensitive attribute" or "protected category" (such as race, ethnicity, gender,
or sexuality) in order to make performance comparisons and standardizations
across groups, however this data is largely unavailable in practice, hindering
the widespread adoption of algorithmic fairness. Through this paper, we
consider calls to collect more data on demographics to enable algorithmic
fairness and challenge the notion that discrimination can be overcome with
smart enough technical methods and sufficient data alone. We show how these
techniques largely ignore broader questions of data governance and systemic
oppression when categorizing individuals for the purpose of fairer algorithmic
processing. In this work, we explore under what conditions demographic data
should be collected and used to enable algorithmic fairness methods by
characterizing a range of social risks to individuals and communities. For the
risks to individuals we consider the unique privacy risks associated with the
sharing of sensitive attributes likely to be the target of fairness analysis,
the possible harms stemming from miscategorizing and misrepresenting
individuals in the data collection process, and the use of sensitive data
beyond data subjects' expectations. Looking more broadly, the risks to entire
groups and communities include the expansion of surveillance infrastructure in
the name of fairness, misrepresenting and mischaracterizing what it means to be
part of a demographic group or to hold a certain identity, and ceding the
ability to define for themselves what constitutes biased or unfair treatment.
We argue that, by confronting these questions before and during the collection
of demographic data, algorithmic fairness methods are more likely to actually
mitigate harmful treatment disparities without reinforcing systems of
oppression.

本文探讨了收集人口统计数据用于实现算法公平性所面临的风险和挑战，并呼吁在数据管理和系统性压抑等领域中解决这些问题。