利用 Context-to-Vector 和 Graph Retrofitting 改进词嵌入

Oct, 2022

利用 Context-to-Vector 和 Graph Retrofitting 改进词嵌入

Using Context-to-Vector with Graph Retrofitting to Improve Word Embeddings

Jiangbin Zheng, Yile Wang, Ge Wang, Jun Xia, Yufei Huang...

TL;DR通过将上下文信息与传统静态嵌入相结合，以及使用预先的同义词知识和加权向量分布来提高词嵌入的效果。

Abstract

Although contextualized embeddings generated from large-scale pre-trained models perform well in many tasks, traditional static embeddings (e.g., skip-gram, Word2Vec) still play an important role in low-resource