As a fundamental problem in ubiquitous computing and machine learning,
sensor-based human activity recognition (HAR) has drawn extensive attention and
made great progress in recent years. HAR aims to recognize human activities
based on the availability of rich time-series data collected from multi-modal
sensors such as accelerometers and gyroscopes. However, recent deep learning
methods are focusing on one view of the data, i.e., the temporal view, while
shallow methods tend to utilize the hand-craft features for recognition, e.g.,
the statistics view. In this paper, to extract a better feature for advancing
the performance, we propose a novel method, namely multi-view fusion
transformer (MVFT) along with a novel attention mechanism. First, MVFT encodes
three views of information, i.e., the temporal, frequent, and statistical views
to generate multi-view features. Second, the novel attention mechanism uncovers
inner- and cross-view clues to catalyze mutual interactions between three views
for detailed relation modeling. Moreover, extensive experiments on two datasets
illustrate the superiority of our methods over several state-of-the-art
methods.

本文介绍了一种新方法，即多视图融合变压器（MVFT），通过编码时间视图、频繁视图和统计视图来生成多视图特征，并提出一种新的注意机制以揭示细节关系建模。实验表明，该方法比几种最先进的方法更优异。