Neural language models have achieved state-of-the-art performances on many
NLP tasks, and recently have been shown to learn a number of
hierarchically-sensitive syntactic dependencies between individual words.
However, equally important for language processing is the ability to combine
words into phrasal constituents, and use constituent-level features to drive
downstream expectations. Here we investigate neural models' ability to
represent constituent-level features, using coordinated noun phrases as a case
study. We assess whether different neural language models trained on English
and French represent phrase-level number and gender features, and use those
features to drive downstream expectations. Our results suggest that models use
a linear combination of NP constituent number to drive CoordNP/verb number
agreement. This behavior is highly regular and even sensitive to local
syntactic context, however it differs crucially from observed human behavior.
Models have less success with gender agreement. Models trained on large corpora
perform best, and there is no obvious advantage for models trained using
explicit syntactic supervision.

研究了神经语言模型代表短语级别特征的能力，使用协调名词短语作为研究案例，发现模型使用 NP 成分数量的线性组合来驱动 CoordNP/​​verb 数量协议。模型在性别协议方面成功较少。使用大型语料库训练的模型表现最佳，并且使用显式句法监督训练的模型没有明显的优势。