As an increasingly popular task in multimedia information retrieval, video
moment retrieval (VMR) aims to localize the target moment from an untrimmed
video according to a given language query. Most previous methods depend heavily
on numerous manual annotations (i.e., moment boundaries), which are extremely
expensive to acquire in practice. In addition, due to the domain gap between
different datasets, directly applying these pre-trained models to an unseen
domain leads to a significant performance drop. In this paper, we focus on a
novel task: cross-domain VMR, where fully-annotated datasets are available in
one domain (``source domain''), but the domain of interest (``target domain'')
only contains unannotated datasets. As far as we know, we present the first
study on cross-domain VMR. To address this new task, we propose a novel
Multi-Modal Cross-Domain Alignment (MMCDA) network to transfer the annotation
knowledge from the source domain to the target domain. However, due to the
domain discrepancy between the source and target domains and the semantic gap
between videos and queries, directly applying trained models to the target
domain generally leads to a performance drop. To solve this problem, we develop
three novel modules: (i) a domain alignment module is designed to align the
feature distributions between different domains of each modality; (ii) a
cross-modal alignment module aims to map both video and query features into a
joint embedding space and to align the feature distributions between different
modalities in the target domain; (iii) a specific alignment module tries to
obtain the fine-grained similarity between a specific frame and the given query
for optimal localization. By jointly training these three modules, our MMCDA
can learn domain-invariant and semantic-aligned cross-modal representations.

本文提出了一种用于跨域视频时刻检索的 Multi-Modal Cross-Domain Alignment 网络以及三个模块：域对齐模块、跨模态对齐模块和特定对齐模块，通过联合训练这些模块，实现域内不变和语义对齐的跨模态表示。