Novel view synthesis from a single image has recently achieved remarkable
results, although the requirement of some form of 3D, pose, or multi-view
supervision at training time limits the deployment in real scenarios. This work
aims at relaxing these assumptions enabling training of conditional generative
models for novel view synthesis in a completely unsupervised manner. We first
pre-train a purely generative decoder model using a 3D-aware GAN formulation
while at the same time train an encoder network to invert the mapping from
latent space to images. Then, we swap encoder and decoder and train the network
as a conditioned GAN with a mixture of an autoencoder-like objective and
self-distillation. At test time, given a view of an object, our model first
embeds the image content in a latent code and regresses its pose, then
generates novel views of it by keeping the code fixed and varying the pose. We
test our framework on both synthetic datasets such as ShapeNet and on
unconstrained collections of natural images, where no competing methods can be
trained.

本论文提出了一种基于生成对抗网络的条件生成模型，通过无监督学习实现在没有多视角、3D 和姿态监督的情况下进行从单一图像到新视角的合成。