We present an efficient document representation learning framework, Document
Vector through Corruption (Doc2VecC). Doc2VecC represents each document as a
simple average of word embeddings. It ensures a representation generated as
such captures the semantic meanings of the document during learning. A
corruption model is included, which introduces a data-dependent regularization
that favors informative or rare words while forcing the embeddings of common
and non-discriminative ones to be close to zero. Doc2VecC produces
significantly better word embeddings than Word2Vec. We compare Doc2VecC with
several state-of-the-art document representation learning algorithms. The
simple model architecture introduced by Doc2VecC matches or out-performs the
state-of-the-art in generating high-quality document representations for
sentiment analysis, document classification as well as semantic relatedness
tasks. The simplicity of the model enables training on billions of words per
hour on a single machine. At the same time, the model is very efficient in
generating representations of unseen documents at test time.

本文介绍了一个有效的文档表示学习框架，Doc2VecC。Doc2VecC 通过词嵌入的简单平均来表示每个文档，并引入一个数据相关的正则化模型以捕捉文档的语义含义。该模型在训练时能够较好地捕捉文本信息，同时能够在生成文档表示方面与当前最先进算法匹配或超越，并且其模型结构简单，能够高效地处理海量文档。