BriefGPT.xyz
May, 2019
探究上下文词向量的句子结构学习
What do you learn from context? Probing for sentence structure in contextualized word representations
HTML
PDF
Ian Tenney, Patrick Xia, Berlin Chen, Alex Wang, Adam Poliak...
TL;DR
研究比较四种最近的模型对句子结构的编码情况，发现语言模型和翻译模型训练出的模型对句法现象具有强大的表现，但对语义任务的改进相对较小。
Abstract
contextualized representation models
such as
elmo
(Peters et al., 2018a) and
bert
(Devlin et al., 2018) have recently achieved state-of-th
→