Domain generalized semantic segmentation (DGSS) is a critical yet challenging
task, where the model is trained only on source data without access to any
target data. Despite the proposal of numerous DGSS strategies, the
generalization capability remains limited in CNN architectures. Though some
Transformer-based segmentation models show promising performance, they
primarily focus on capturing intra-sample attentive relationships, disregarding
inter-sample correlations which can potentially benefit DGSS. To this end, we
enhance the attention modules in Transformer networks for improving DGSS by
incorporating information from other independent samples in the same batch,
enriching contextual information, and diversifying the training data for each
attention block. Specifically, we propose two alternative intra-batch attention
mechanisms, namely mean-based intra-batch attention (MIBA) and element-wise
intra-batch attention (EIBA), to capture correlations between different
samples, enhancing feature representation and generalization capabilities.
Building upon intra-batch attention, we introduce IBAFormer, which integrates
self-attention modules with the proposed intra-batch attention for DGSS.
Extensive experiments demonstrate that IBAFormer achieves SOTA performance in
DGSS, and ablation studies further confirm the effectiveness of each introduced
component.

通过在 Transformer 网络中增强注意力模块，结合同一批次的其他独立样本信息以提高域广义语义分割（DGSS）的性能，我们的提出的 IBAFormer 方法在 DGSS 中取得了最先进的性能，消融研究进一步证实了每个引入组件的有效性。