Progress in GANs has enabled the generation of high-resolution photorealistic
images of astonishing quality. StyleGANs allow for compelling attribute
modification on such images via mathematical operations on the latent style
vectors in the W/W+ space that effectively modulate the rich hierarchical
representations of the generator. Such operations have recently been
generalized beyond mere attribute swapping in the original StyleGAN paper to
include interpolations. In spite of many significant improvements in StyleGANs,
they are still seen to generate unnatural images. The quality of the generated
images is predicated on two assumptions; (a) The richness of the hierarchical
representations learnt by the generator, and, (b) The linearity and smoothness
of the style spaces. In this work, we propose a Hierarchical Semantic
Regularizer (HSR) which aligns the hierarchical representations learnt by the
generator to corresponding powerful features learnt by pretrained networks on
large amounts of data. HSR is shown to not only improve generator
representations but also the linearity and smoothness of the latent style
spaces, leading to the generation of more natural-looking style-edited images.
To demonstrate improved linearity, we propose a novel metric - Attribute
Linearity Score (ALS). A significant reduction in the generation of unnatural
images is corroborated by improvement in the Perceptual Path Length (PPL)
metric by 16.19% averaged across different standard datasets while
simultaneously improving the linearity of attribute-change in the attribute
editing tasks.

本文研究了如何通过提出的层次语义约束器（HSR）来改善 StyleGANs 生成的图像的真实性和自然性，同时提出新的 Attribute Linearity Score (ALS) 来衡量属性变量的线性度。实验表明，HSR 可以对生成器学习到的分层表征进行约束，从而提高样式编辑后的图像的自然度和真实性，并同时提高了其属性变量的线性度。