BriefGPT.xyz
Jun, 2017
学习将单词嵌入上下文以执行句法任务
Learning to Embed Words in Context for Syntactic Tasks
HTML
PDF
Lifu Tu, Kevin Gimpel, Karen Livescu
TL;DR
我们提出了一种基于标准神经网络架构的简单,高效的令牌嵌入模型,并通过大量未注释的文本学习了令牌嵌入,评估它们作为基于少量注释的数据训练的词性标注器和依存分析器的特征,发现词嵌入在各种上下文窗口和训练集大小下都能一致优于基准预测模型。
Abstract
We present models for embedding words in the context of surrounding words. Such models, which we refer to as
token embeddings
, represent the characteristics of a word that are specific to a given context, such as
word s
→