This paper presents a novel hierarchical spatiotemporal orientation
representation for spacetime image analysis. It is designed to combine the
benefits of the multilayer architecture of ConvNets and a more controlled
approach to spacetime analysis. A distinguishing aspect of the approach is that
unlike most contemporary convolutional networks no learning is involved;
rather, all design decisions are specified analytically with theoretical
motivations. This approach makes it possible to understand what information is
being extracted at each stage and layer of processing as well as to minimize
heuristic choices in design. Another key aspect of the network is its recurrent
nature, whereby the output of each layer of processing feeds back to the input.
To keep the network size manageable across layers, a novel cross-channel
feature pooling is proposed. The multilayer architecture that results
systematically reveals hierarchical image structure in terms of multiscale,
multiorientation properties of visual spacetime. To illustrate its utility, the
network has been applied to the task of dynamic texture recognition. Empirical
evaluation on multiple standard datasets shows that it sets a new
state-of-the-art.

本文介绍了一种新颖的分层时空方向表示，用于时空图像分析，并将多层 ConvNets 的优点与更可控的时空分析方法相结合。它的一些关键方面是无需学习，采用理论推导进行设计，并具有循环性质、交叉通道特征汇集和层级结构。它在动态纹理识别方面性能表现优异。