BriefGPT.xyz
May, 2023
评估语言模型中的语言推广能力:面向巴西葡萄牙语的数据集
Assessing Linguistic Generalisation in Language Models: A Dataset for Brazilian Portuguese
HTML
PDF
Rodrigo Wilkens, Leonardo Zilio, Aline Villavicencio
TL;DR
本研究提出了一种评估方法,针对用于巴西葡萄牙文的语言模型,通过固定的语言格式,考察语言信息的编码方式,评估不同的语言模型在处理语法结构和多词表达方面的泛化能力,解决了语言模型黑盒且缺乏可解释性的问题。
Abstract
Much recent effort has been devoted to creating large-scale
language models
. Nowadays, the most prominent approaches are based on
deep neural networks
, such as BERT. However, they lack transparency and interpreta
→