We present a caricature generation framework based on shape and style manipulation using StyleGAN. Our framework, dubbed StyleCariGAN, automatically creates a realistic and detailed caricature from an input photo with optional controls on shape exaggeration degree and color stylization type. The key component of our method is shape exaggeration blocks that are used for modulating coarse layer feature maps of StyleGAN to produce desirable caricature shape exaggerations. We first build a layer-mixed StyleGAN for photo-to-caricature style conversion by swapping fine layers of the StyleGAN for photos to the corresponding layers of the StyleGAN trained to generate caricatures. Given an input photo, the layer-mixed model produces detailed color stylization for a caricature but without shape exaggerations. We then append shape exaggeration blocks to the coarse layers of the layer-mixed model and train the blocks to create shape exaggerations while preserving the characteristic appearances of the input. Experimental results show that our StyleCariGAN generates realistic and detailed caricatures compared to the current state-of-the-art methods. We demonstrate StyleCariGAN also supports other StyleGAN-based image manipulations, such as facial expression control.

通过 StyleGAN，我们提出了一个基于形状和风格调整的讽刺画生成框架，名为 StyleCariGAN，它可以从输入照片自动生成真实而详细的讽刺画，并支持形状夸张度和颜色风格化类型的可选控制。我们的关键方法是形状夸张模块，它用于调制 StyleGAN 的粗糙层特征图以产生所需的讽刺画形状夸张。我们的实验结果表明，相比当前最先进的方法，StyleCariGAN 生成的讽刺画更加真实和详细，并且还支持其他基于 StyleGAN 的图像操作，如面部表情控制。

StyleCariGAN：基于StyleGAN特征映射调制的漫画生成