As large language models (LLMs) have been used in many downstream tasks, the
internal stereotypical representation may affect the fairness of the outputs.
In this work, we introduce human knowledge into natural language interventions
and study pre-trained language models' (LMs) behaviors within the context of
gender bias. Inspired by CheckList behavioral testing, we present a
checklist-style task that aims to probe and quantify LMs' unethical behaviors
through question-answering (QA). We design three comparison studies to evaluate
LMs from four aspects: consistency, biased tendency, model preference, and
gender preference switch. We probe one transformer-based QA model trained on
SQuAD-v2 dataset and one autoregressive large language model. Our results
indicate that transformer-based QA model's biased tendency positively
correlates with its consistency, whereas LLM shows the opposite relation. Our
proposed task provides the first dataset that involves human knowledge for LLM
bias evaluation.

通过引入人类知识进行自然语言干预，本研究探索了预训练语言模型的行为特征，以性别偏见为背景，通过问答评估了模型的一致性、偏见倾向、模型偏好和性别偏好切换，并提供了首个基于人类知识的大语言模型偏见评估数据集。