A key challenge in visible-infrared person re-identification (V-I ReID) is
training a backbone model capable of effectively addressing the significant
discrepancies across modalities. State-of-the-art methods that generate a
single intermediate bridging domain are often less effective, as this generated
domain may not adequately capture sufficient common discriminant information.
This paper introduces the Bidirectional Multi-step Domain Generalization
(BMDG), a novel approach for unifying feature representations across diverse
modalities. BMDG creates multiple virtual intermediate domains by finding and
aligning body part features extracted from both I and V modalities. Indeed,
BMDG aims to reduce the modality gaps in two steps. First, it aligns modalities
in feature space by learning shared and modality-invariant body part prototypes
from V and I images. Then, it generalizes the feature representation by
applying bidirectional multi-step learning, which progressively refines feature
representations in each step and incorporates more prototypes from both
modalities. In particular, our method minimizes the cross-modal gap by
identifying and aligning shared prototypes that capture key discriminative
features across modalities, then uses multiple bridging steps based on this
information to enhance the feature representation. Experiments conducted on
challenging V-I ReID datasets indicate that our BMDG approach outperforms
state-of-the-art part-based models or methods that generate an intermediate
domain from V-I person ReID.

该研究提出了一种名为 Bidirectional Multi-step Domain Generalization (BMDG) 的新方法，用于在不同的感官模态中统一特征表示，通过学习共享和模态不变的人体部位原型来对齐特征空间，然后利用多步学习逐步改进特征表示，并在此基础上使用多个桥接步骤来增强特征表示，有效地减少了感官模态之间的差距。实验证明，BMDG 方法在具有挑战性的可见 - 红外人物重新识别数据集上优于现有的基于部位的模型或通过可见 - 红外人物重新识别生成中间域的方法。