Deep generative models trained with large amounts of unlabelled data have
proven to be powerful within the domain of unsupervised learning. Many real
life data sets contain a small amount of labelled data points, that are
typically disregarded when training generative models. We propose the
Cluster-aware Generative Model, that uses unlabelled information to infer a
latent representation that models the natural clustering of the data, and
additional labelled data points to refine this clustering. The generative
performances of the model significantly improve when labelled information is
exploited, obtaining a log-likelihood of -79.38 nats on permutation invariant
MNIST, while also achieving competitive semi-supervised classification
accuracies. The model can also be trained fully unsupervised, and still improve
the log-likelihood performance with respect to related methods.

本文介绍了 Cluster-aware Generative Model 这一基于深度生成模型的半监督学习方法，利用未标记的数据点探索数据自然聚类模式，同时引入部分带标记的数据对模型进行优化，有效提高了模型性能。该模型也能够在完全无监督的情况下实现优异的对数似然性能。