Generative adversarial networks (GANs) are a recent approach to train generative models of data, which have been shown to work particularly well on image data. In the current paper we introduce a new model for texture synthesis based on GAN learning. By extending the input noise distribution space from a single vector to a whole spatial tensor, we create an architecture with properties well suited to the task of texture synthesis, which we call spatial GAN (SGAN). To our knowledge, this is the first successful completely data-driven texture synthesis method based on GANs. Our method has the following features which make it a state of the art algorithm for texture synthesis: high image quality of the generated textures, very high scalability w.r.t. the output texture size, fast real-time forward generation, the ability to fuse multiple diverse source images in complex textures. To illustrate these capabilities we present multiple experiments with different classes of texture images and use cases. We also discuss some limitations of our method with respect to the types of texture images it can synthesize, and compare it to other neural techniques for texture generation.

本文介绍了一种基于生成对抗网络的新型纹理合成模型，即空间 GAN（SGAN），其通过将输入噪声分布空间从单一向量延展至整个空间张量，实现了高品质、高可扩展性和快速实时正向生成等特点，并能够将多个不同类别的源图像融合到复杂的纹理中。同时，本文还讨论了该方法的一些局限性，并将其与其他神经纹理生成技术进行了比较。

空间生成对抗网络纹理合成