BriefGPT.xyz
May, 2020
神经语言模型中的语法推广的系统评估
A Systematic Assessment of Syntactic Generalization in Neural Language Models
HTML
PDF
Jennifer Hu, Jon Gauthier, Peng Qian, Ethan Wilcox, Roger P. Levy
TL;DR
我们对神经语言模型的句法知识进行了系统评估，发现模型架构的不同对句法泛化性能产生了显著影响，而不同数据集大小的影响相对较低。
Abstract
State-of-the-art
neural network models
have achieved dizzyingly low perplexity scores on major language modeling benchmarks, but it remains unknown whether optimizing for broad-coverage predictive performance leads to human-like
→