Cross-lingual word embeddings are becoming increasingly important in
multilingual NLP. Recently, it has been shown that these embeddings can be
effectively learned by aligning two disjoint monolingual vector spaces through
linear transformations, using no more than a small bilingual dictionary as
supervision. In this work, we propose to apply an additional transformation
after the initial alignment step, which moves cross-lingual synonyms towards a
middle point between them. By applying this transformation our aim is to obtain
a better cross-lingual integration of the vector spaces. In addition, and
perhaps surprisingly, the monolingual spaces also improve by this
transformation. This is in contrast to the original alignment, which is
typically learned such that the structure of the monolingual spaces is
preserved. Our experiments confirm that the resulting cross-lingual embeddings
outperform state-of-the-art models in both monolingual and cross-lingual
evaluation tasks.

本研究中，我们提出了一种修改交叉语言同义词向中心点移动的方法，可通过最初的线性变换对两个不相交的单语向量空间进行对准来有效学习交叉语言词嵌入，并实现更好的交叉语言整合。同时，我们的实验结果表明该方法明显优于现有方法在单语和跨语言评估任务方面的表现。