Motivations like domain adaptation, transfer learning, and feature learning
have fueled interest in inducing embeddings for rare or unseen words, n-grams,
synsets, and other textual features. This paper introduces a la carte
embedding, a simple and general alternative to the usual word2vec-based
approaches for building such representations that is based upon recent
theoretical results for GloVe-like embeddings. Our method relies mainly on a
linear transformation that is efficiently learnable using pretrained word
vectors and linear regression. This transform is applicable on the fly in the
future when a new text feature or rare word is encountered, even if only a
single usage example is available. We introduce a new dataset showing how the a
la carte method requires fewer examples of words in context to learn
high-quality embeddings and we obtain state-of-the-art results on a nonce task
and some unsupervised document classification tasks.

本文通过使用预训练词向量和线性回归，基于 GloVe 等嵌入的新理论结果，提出了 a la carte embedding 方法，该方法适用于未知词、n-gram、synset 和其他文本特征。实验结果表明，此方法只需少量文本样本，即可获得高质量的嵌入表示，并在一些无监督的文档分类任务中取得了最好的效果。