In this paper, we investigate the impact of objects on gender bias in image
captioning systems. Our results show that only gender-specific objects have a
strong gender bias (e.g., women-lipstick). In addition, we propose a visual
semantic-based gender score that measures the degree of bias and can be used as
a plug-in for any image captioning system. Our experiments demonstrate the
utility of the gender score, since we observe that our score can measure the
bias relation between a caption and its related gender; therefore, our score
can be used as an additional metric to the existing Object Gender Co-Occ
approach. Code and data are publicly available at
https://github.com/ahmedssabir/GenderScore.

研究了物体对图像字幕系统中的性别偏见的影响，结果表明只有特定于性别的物体才有强烈的性别偏见（例如，女性口红）。此外，提出了一种基于视觉语义的性别得分，用来度量偏见程度并可作为任何图像字幕系统的插件。实验证明了性别得分的实用性，因为我们观察到我们的得分可以测量字幕和相关性别之间的偏见关系；因此，我们的得分可以作为现有的对象性别共项方法的补充指标。代码和数据公开可用于 https://github.com/ahmedssabir/GenderScore。