In this paper, we introduce Saliency-Based Adaptive Masking (SBAM), a novel
and cost-effective approach that significantly enhances the pre-training
performance of Masked Image Modeling (MIM) approaches by prioritizing token
salience. Our method provides robustness against variations in masking ratios,
effectively mitigating the performance instability issues common in existing
methods. This relaxes the sensitivity of MIM-based pre-training to masking
ratios, which in turn allows us to propose an adaptive strategy for `tailored'
masking ratios for each data sample, which no existing method can provide.
Toward this goal, we propose an Adaptive Masking Ratio (AMR) strategy that
dynamically adjusts the proportion of masking for the unique content of each
image based on token salience. We show that our method significantly improves
over the state-of-the-art in mask-based pre-training on the ImageNet-1K
dataset.

SBAM 通过优先考虑标记的显著性，引入一种新颖且经济高效的方法，显著增强了基于掩膜图像建模的预训练性能，提供了针对每个数据样本的 ' 量身定制 ' 掩膜比例的自适应策略，并在 ImageNet-1K 数据集上显著提升了基于掩膜的预训练的最新方法。