BriefGPT.xyz
Dec, 2020
Corrected CBOW 与 Skip-gram 表现相当
kōan: A Corrected CBOW Implementation
HTML
PDF
Ozan İrsoy, Adrian Benton, Karl Stratos
TL;DR
对比CBOW 和 Skip-gram 两种词向量嵌入方法，发现CBOW实现时出现了误差，经过纠正后，可以在训练速度更快的情况下，和Skip-gram 实现相比取得和在各自内在和外在任务上的同等竞争力。
Abstract
It is a common belief in the NLP community that continuous bag-of-words (
cbow
)
word embeddings
tend to underperform
skip-gram
(SG) embeddi
→