Existing word embedding debiasing methods require social-group-specific word
pairs (e.g., "man"-"woman") for each social attribute (e.g., gender), which
cannot be used to mitigate bias for other social groups, making these methods
impractical or costly to incorporate understudied social groups in debiasing.
We propose that the Stereotype Content Model (SCM), a theoretical framework
developed in social psychology for understanding the content of stereotypes,
which structures stereotype content along two psychological dimensions -
"warmth" and "competence" - can help debiasing efforts to become
social-group-agnostic by capturing the underlying connection between bias and
stereotypes. Using only pairs of terms for warmth (e.g., "genuine"-"fake") and
competence (e.g.,"smart"-"stupid"), we perform debiasing with established
methods and find that, across gender, race, and age, SCM-based debiasing
performs comparably to group-specific debiasing

本文提出一种基于 Stereotype Content Model（SCM）的单词嵌入去偏见方法，使用具有 “温暖” 和 “能力” 的特定单词对嵌入矢量进行偏差修正，并在不同社会群体中进行了性能比较。

基于刻板印象内容模型的社会群体不可知词嵌入去偏置

Social-Group-Agnostic Word Embedding Debiasing via the Stereotype Content Model

We examine whether neural natural language processing (NLP) systems reflect
historical biases in training data. We define a general benchmark to quantify
gender bias in a variety of neural NLP tasks. Our empirical evaluation with
state-of-the-art neural coreference resolution and textbook RNN-based language
models trained on benchmark datasets finds significant gender bias in how
models view occupations. We then mitigate bias with CDA: a generic methodology
for corpus augmentation via causal interventions that breaks associations
between gendered and gender-neutral words. We empirically show that CDA
effectively decreases gender bias while preserving accuracy. We also explore
the space of mitigation strategies with CDA, a prior approach to word embedding
debiasing (WED), and their compositions. We show that CDA outperforms WED,
drastically so when word embeddings are trained. For pre-trained embeddings,
the two methods can be effectively composed. We also find that as training
proceeds on the original data set with gradient descent the gender bias grows
as the loss reduces, indicating that the optimization encourages bias; CDA
mitigates this behavior.

本文研究了神经自然语言处理系统是否反映了训练数据中的历史偏见。通过定义量化神经自然语言处理任务中的性别偏见的基准测试，实证研究发现目前最先进的神经语言模型和基于基准数据集的循环神经网络在职业看待上存在显著的性别偏见。作者提出了一种基于因果干预的语料库增强通用方法，CDA，以减轻偏见而保留矫正前的准确性。作者发现 CDA 优于词嵌入去偏的先前方法，尤其是在词嵌入训练时；对于预先训练的嵌入，两种方法可以被有效地组合。作者还发现原始数据集在优化时会鼓励性别偏见增加；而 CDA 可以缓解这种行为。