Disparate biases associated with datasets and trained classifiers in hateful
and abusive content identification tasks have raised many concerns recently.
Although the problem of biased datasets on abusive language detection has been
addressed more frequently, biases arising from trained classifiers have not yet
been a matter of concern. Here, we first introduce a transfer learning approach
for hate speech detection based on an existing pre-trained language model
called BERT and evaluate the proposed model on two publicly available datasets
annotated for racism, sexism, hate or offensive content on Twitter. Next, we
introduce a bias alleviation mechanism in hate speech detection task to
mitigate the effect of bias in training set during the fine-tuning of our
pre-trained BERT-based model. Toward that end, we use an existing
regularization method to reweight input samples, thereby decreasing the effects
of high correlated training set' s n-grams with class labels, and then
fine-tune our pre-trained BERT-based model with the new re-weighted samples. To
evaluate our bias alleviation mechanism, we employ a cross-domain approach in
which we use the trained classifiers on the aforementioned datasets to predict
the labels of two new datasets from Twitter, AAE-aligned and White-aligned
groups, which indicate tweets written in African-American English (AAE) and
Standard American English (SAE) respectively. The results show the existence of
systematic racial bias in trained classifiers as they tend to assign tweets
written in AAE from AAE-aligned group to negative classes such as racism,
sexism, hate, and offensive more often than tweets written in SAE from
White-aligned. However, the racial bias in our classifiers reduces
significantly after our bias alleviation mechanism is incorporated. This work
could institute the first step towards debiasing hate speech and abusive
language detection systems.

通过使用预训练语言模型 BERT 进行迁移学习，本文提出了一种在推特上进行种族主义、性别主义、仇恨性或冒犯性内容检测的算法，并将对算法进行合理地裁剪降低出现倾向性的缺陷。