Action recognition from video data forms a cornerstone with wide-ranging
applications. Single-view action recognition faces limitations due to its
reliance on a single viewpoint. In contrast, multi-view approaches capture
complementary information from various viewpoints for improved accuracy.
Recently, event cameras have emerged as innovative bio-inspired sensors,
leading to advancements in event-based action recognition. However, existing
works predominantly focus on single-view scenarios, leaving a gap in multi-view
event data exploitation, particularly in challenges like information deficit
and semantic misalignment. To bridge this gap, we introduce HyperMV, a
multi-view event-based action recognition framework. HyperMV converts discrete
event data into frame-like representations and extracts view-related features
using a shared convolutional network. By treating segments as vertices and
constructing hyperedges using rule-based and KNN-based strategies, a multi-view
hypergraph neural network that captures relationships across viewpoint and
temporal features is established. The vertex attention hypergraph propagation
is also introduced for enhanced feature fusion. To prompt research in this
area, we present the largest multi-view event-based action dataset
$\text{THU}^{\text{MV-EACT}}\text{-50}$, comprising 50 actions from 6
viewpoints, which surpasses existing datasets by over tenfold. Experimental
results show that HyperMV significantly outperforms baselines in both
cross-subject and cross-view scenarios, and also exceeds the state-of-the-arts
in frame-based multi-view action recognition.

多视角基于事件的行为识别框架 HyperMV 在多视角事件数据利用方面填补了现有研究的差距，并引入了最大的多视角基于事件的行为数据集 THU-MV-EACT-50，通过实验结果证明 HyperMV 在跨主体和跨视角情况下明显优于基线模型，同时在基于帧的多视角行为识别方面超越了现有的技术水平。