Artistic style transfer is an image synthesis problem where the content of an image is reproduced with the style of another. Recent works show that a visually appealing style transfer can be achieved by using the hidden activations of a pretrained convolutional neural network. However, existing methods either apply (i) an optimization procedure that works for any style image but is very expensive, or (ii) an efficient feedforward network that only allows a limited number of trained styles. In this work we propose a simpler optimization objective based on local matching that combines the content structure and style textures in a single layer of the pretrained network. We show that our objective has desirable properties such as a simpler optimization landscape, intuitive parameter tuning, and consistent frame-by-frame performance on video. Furthermore, we use 80,000 natural images and 80,000 paintings to train an inverse network that approximates the result of the optimization. This results in a procedure for artistic style transfer that is efficient but also allows arbitrary content and style images.

本文提出了一种基于局部匹配和卷积神经网络的简单优化目标，该目标可以在保持效率的同时，产生艺术风格迁移的高品质结果。同时，本文结合内容结构和风格纹理，利用预训练网络的单层来实现该目标，并且使用 80,000 张自然图像和 80,000 张绘画进行反向优化网络的训练，这使得整个算法支持任意图像进行迁移。

任意风格的快速基于块的风格转移