Recent generative models can synthesize "views" of artificial images that mimic real-world variations, such as changes in color or pose, simply by learning from unlabeled image collections. Here, we investigate whether such views can be applied to real images to benefit downstream analysis tasks such as image classification. Using a pretrained generator, we first find the latent code corresponding to a given real input image. Applying perturbations to the code creates natural variations of the image, which can then be ensembled together at test-time. We use StyleGAN2 as the source of generative augmentations and investigate this setup on classification tasks involving facial attributes, cat faces, and cars. Critically, we find that several design decisions are required towards making this process work; the perturbation procedure, weighting between the augmentations and original image, and training the classifier on synthesized images can all impact the result. Currently, we find that while test-time ensembling with GAN-based augmentations can offer some small improvements, the remaining bottlenecks are the efficiency and accuracy of the GAN reconstructions, coupled with classifier sensitivities to artifacts in GAN-generated images.

使用预训练生成器，通过对潜在代码进行扰动以创建自然图像的变化，然后使用 StyleGAN2 进行分类任务，并发现该过程存在多个设计决策，包括扰动程序、增强图像和原始图像之间的加权以及对合成图像进行训练的分类器等，最终发现，虽然使用基于 GAN 的增强可以带来小幅改进，但 GAN 重构的效率和精度，以及分类器对 GAN 生成图像的敏感性仍然是瓶颈。

深度生成视图集成