Recent work has explored methods for learning continuous vector space word
representations reflecting the underlying semantics of words. Simple vector
space arithmetic using cosine distances has been shown to capture certain types
of analogies, such as reasoning about plurals from singulars, past tense from
present tense, etc. In this paper, we introduce a new approach to capture
analogies in continuous word representations, based on modeling not just
individual word vectors, but rather the subspaces spanned by groups of words.
We exploit the property that the set of subspaces in n-dimensional Euclidean
space form a curved manifold space called the Grassmannian, a quotient subgroup
of the Lie group of rotations in n- dimensions. Based on this mathematical
model, we develop a modified cosine distance model based on geodesic kernels
that captures relation-specific distances across word categories. Our
experiments on analogy tasks show that our approach performs significantly
better than the previous approaches for the given task.

本文介绍了一种基于 Grassmannian 的新方法，旨在通过建模单词集合所围成的子空间来捕获连续词向量表示中的类比关系，该方法利用测地核的修改余弦距离模型捕获跨单词类别的关系特定距离，实验结果表明与以前的方法相比，本方法在类比任务上表现显著改善。