Gender inequality is embedded in our communication practices and perpetuated in translation technologies. This becomes particularly apparent when translating into grammatical gender languages, where machine translation (MT) often defaults to masculine and stereotypical representations by making undue binary gender assumptions. Our work addresses the rising demand for inclusive language by focusing head-on on gender-neutral translation from English to Italian. We start from the essentials: proposing a dedicated benchmark and exploring automated evaluation methods. First, we introduce GeNTE, a natural, bilingual test set for gender-neutral translation, whose creation was informed by a survey on the perception and use of neutral language. Based on GeNTE, we then overview existing reference-based evaluation approaches, highlight their limits, and propose a reference-free method more suitable to assess gender-neutral translation.

我们的研究主要关注从英语到意大利语的性别中性翻译，通过提出专门的基准和探索自动评估方法来满足包容性语言的不断增长的需求。我们介绍了GeNTE，这是一个自然、双语的性别中性翻译测试集，其创建受到有关中性语言感知和使用的调查的启发。基于GeNTE，我们概述了现有的基于参考的评估方法，突出了它们的局限性，并提出了一种更适合评估性别中性翻译的无参考方法。

基于GeNTE语料库的性别中性机器翻译基准测试