Person-person mutual action recognition (also referred to as interaction
recognition) is an important research branch of human activity analysis.
Current solutions in the field -- mainly dominated by CNNs, GCNs and LSTMs --
often consist of complicated architectures and mechanisms to embed the
relationships between the two persons on the architecture itself, to ensure the
interaction patterns can be properly learned. Our main contribution with this
work is by proposing a simpler yet very powerful architecture, named
Interaction Relational Network, which utilizes minimal prior knowledge about
the structure of the human body. We drive the network to identify by itself how
to relate the body parts from the individuals interacting. In order to better
represent the interaction, we define two different relationships, leading to
specialized architectures and models for each. These multiple relationship
models will then be fused into a single and special architecture, in order to
leverage both streams of information for further enhancing the relational
reasoning capability. Furthermore we define important structured pair-wise
operations to extract meaningful extra information from each pair of joints --
distance and motion. Ultimately, with the coupling of an LSTM, our IRN is
capable of paramount sequential relational reasoning. These important
extensions we made to our network can also be valuable to other problems that
require sophisticated relational reasoning. Our solution is able to achieve
state-of-the-art performance on the traditional interaction recognition
datasets SBU and UT, and also on the mutual actions from the large-scale
dataset NTU RGB+D. Furthermore, it obtains competitive performance in the NTU
RGB+D 120 dataset interactions subset.

我们提出了交互关系网络（Interaction Relational Network），它是一种简单而强大的架构，利用了关于人体结构的最少先验知识，通过定义不同的关系和重要的有结构的成对运算来更好地表示交互，并使用 LSTM 来进行关系推论，实现了与先前最先进的方法相似的结果。