Event Stream Super-Resolution (ESR) aims to address the challenge of insufficient spatial resolution in event streams, which holds great significance for the application of event cameras in complex scenarios. Previous works for ESR often process positive and negative events in a mixed paradigm. This paradigm limits their ability to effectively model the unique characteristics of each event and mutually refine each other by considering their correlations. In this paper, we propose a bilateral event mining and complementary network (BMCNet) to fully leverage the potential of each event and capture the shared information to complement each other simultaneously. Specifically, we resort to a two-stream network to accomplish comprehensive mining of each type of events individually. To facilitate the exchange of information between two streams, we propose a bilateral information exchange (BIE) module. This module is layer-wisely embedded between two streams, enabling the effective propagation of hierarchical global information while alleviating the impact of invalid information brought by inherent characteristics of events. The experimental results demonstrate that our approach outperforms the previous state-of-the-art methods in ESR, achieving performance improvements of over 11\% on both real and synthetic datasets. Moreover, our method significantly enhances the performance of event-based downstream tasks such as object recognition and video reconstruction. Our code is available at https://github.com/Lqm26/BMCNet-ESR.

本研究提出了一种双边事件挖掘和互补网络（BMCNet），旨在完全发挥每个事件的潜力，同时捕捉共享信息以相互补充，通过两流网络实现对每种类型事件的全面挖掘，并通过双边信息交换（BIE）模块促进两个流之间的信息交流，在事件的固有特性带来的无效信息的影响下减轻有效信息的传播，实验证明我们的方法在事件流超分辨率方面优于现有方法，并在真实数据集和合成数据集上分别实现了超过11％的性能提升，此外，我们的方法显著改善了基于事件的下游任务的性能，如目标识别和视频重构。

事件流超分辨率的双边事件挖掘与补充