In this paper, we make the first attempt at achieving the cross-modal (i.e.,
image-to-events) adaptation for event-based object recognition without
accessing any labeled source image data owning to privacy and commercial
issues. Tackling this novel problem is non-trivial due to the novelty of event
cameras and the distinct modality gap between images and events. In particular,
as only the source model is available, a hurdle is how to extract the knowledge
from the source model by only using the unlabeled target event data while
achieving knowledge transfer. To this end, we propose a novel framework, dubbed
EventDance for this unsupervised source-free cross-modal adaptation problem.
Importantly, inspired by event-to-video reconstruction methods, we propose a
reconstruction-based modality bridging (RMB) module, which reconstructs
intensity frames from events in a self-supervised manner. This makes it
possible to build up the surrogate images to extract the knowledge (i.e.,
labels) from the source model. We then propose a multi-representation knowledge
adaptation (MKA) module that transfers the knowledge to target models learning
events with multiple representation types for fully exploring the
spatiotemporal information of events. The two modules connecting the source and
target models are mutually updated so as to achieve the best performance.
Experiments on three benchmark datasets with two adaption settings show that
EventDance is on par with prior methods utilizing the source data.

通过无标签目标事件数据的提取知识，提出了一种用于无监督源自由跨模态适应问题的新框架 EventDance，包括基于重构的模态桥接模块（RMB）和多表示知识适应模块（MKA），并与源模型相互更新，从而使得 EventDance 能在多个领域进行知识传递和跨模态适应。实验结果表明，EventDance 与利用源数据的先前方法具有相当的性能。