A number of recent approaches have used deep convolutional neural networks
(CNNs) to build texture representations. Nevertheless, it is still unclear how
these models represent texture and invariances to categorical variations. This
work conducts a systematic evaluation of recent CNN-based texture descriptors
for recognition and attempts to understand the nature of invariances captured
by these representations. First we show that the recently proposed bilinear CNN
model [25] is an excellent general-purpose texture descriptor and compares
favorably to other CNN-based descriptors on various texture and scene
recognition benchmarks. The model is translationally invariant and obtains
better accuracy on the ImageNet dataset without requiring spatial jittering of
data compared to corresponding models trained with spatial jittering. Based on
recent work [13, 28] we propose a technique to visualize pre-images, providing
a means for understanding categorical properties that are captured by these
representations. Finally, we show preliminary results on how a unified
parametric model of texture analysis and synthesis can be used for
attribute-based image manipulation, e.g. to make an image more swirly,
honeycombed, or knitted. The source code and additional visualizations are
available at this http URL

本文通过对最近的 CNN-based 描述符进行系统评估和比较，梳理深度卷积神经网络在纹理表示和分类变量不变性方面的性质，并提出了一个可视化的方法来理解这个性质。最后，作者介绍了一个关于纹理分析和合成的参数化模型，可以用于基于属性的图像操作以及图像的纹理化处理。