Skeleton-based action recognition has made great progress recently, but many problems still remain unsolved. For example, most of the previous methods model the representations of skeleton sequences without abundant spatial structure information and detailed temporal dynamics features. In this paper, we propose a novel model with spatial reasoning and temporal stack learning (SR-TSL) for skeleton based action recognition, which consists of a spatial reasoning network (SRN) and a temporal stack learning network (TSLN). The SRN can capture the high-level spatial structural information within each frame by a residual graph neural network, while the TSLN can model the detailed temporal dynamics of skeleton sequences by a composition of multiple skip-clip LSTMs. During training, we propose a clip-based incremental loss to optimize the model. We perform extensive experiments on the SYSU 3D Human-Object Interaction dataset and NTU RGB+D dataset and verify the effectiveness of each network of our model. The comparison results illustrate that our approach achieves much better results than state-of-the-art methods.

本研究提出了一种新的基于骨架的动作识别模型，包括空间推理网络（SRN）和时间堆叠学习网络（TSLN），SRN通过残差图神经网络捕获每帧内的高级空间结构信息，而TSLN通过多个跳跃剪辑LSTM的组合模拟骨架序列的详细时间动态，最终实验结果表明与最先进的方法相比，该方法表现出更好的表现。

基于骨架的动作识别：空间推理和时域堆叠学习