This work explores conditional image generation with a new image density model based on the PixelCNN architecture. The model can be conditioned on any vector, including descriptive labels or tags, or latent embeddings created by other networks. When conditioned on class labels from the ImageNet database, the model is able to generate diverse, realistic scenes representing distinct animals, objects, landscapes and structures. When conditioned on an embedding produced by a convolutional network given a single image of an unseen face, it generates a variety of new portraits of the same person with different facial expressions, poses and lighting conditions. We also show that conditional PixelCNN can serve as a powerful decoder in an image autoencoder, creating. Additionally, the gated convolutional layers in the proposed model improve the log-likelihood of PixelCNN to match the state-of-the-art performance of PixelRNN on ImageNet, with greatly reduced computational cost.

本研究使用基于PixelCNN架构的新图像密度模型探索了有条件的图像生成技术。模型可以以任何的向量作为条件，包括描述性标签或标记或其他网络产生的潜在嵌入向量。当以来自ImageNet数据库的类标签作为条件时，模型能够生成多样化、逼真的场景。同时，研究还证明了该模型可以作为强大的自编码器解码器，且具有比PixelRNN更高的性能且计算成本更低。

具有PixelCNN解码器的条件图像生成