Existing GAN inversion methods fail to provide latent codes for reliable reconstruction and flexible editing simultaneously. This paper presents a transformer-based image inversion and editing model for pretrained StyleGAN which is not only with less distortions, but also of high quality and flexibility for editing. The proposed model employs a CNN encoder to provide multi-scale image features as keys and values. Meanwhile it regards the style code to be determined for different layers of the generator as queries. It first initializes query tokens as learnable parameters and maps them into W+ space. Then the multi-stage alternate self- and cross-attention are utilized, updating queries with the purpose of inverting the input by the generator. Moreover, based on the inverted code, we investigate the reference- and label-based attribute editing through a pretrained latent classifier, and achieve flexible image-to-image translation with high quality results. Extensive experiments are carried out, showing better performances on both inversion and editing tasks within StyleGAN.

本文介绍了一种基于Transformer的图像逆转和编辑模型，用于预先训练过的StyleGAN，通过CNN编码器在多个尺度上提供图像特征作为键和值，并将样式代码视为查询，以在生成器中反转输入。无论是在逆转还是编辑任务中，该方法在StyleGAN上都取得了更好的性能表现。

图像倒置和编辑的风格变换器