Cross-modal embeddings, between textual and visual modalities, aim to
organise multimodal instances by their semantic correlations. State-of-the-art
approaches use maximum-margin methods, based on the hinge-loss, to enforce a
constant margin m, to separate projections of multimodal instances from
different categories. In this paper, we propose a novel scheduled adaptive
maximum-margin (SAM) formulation that infers triplet-specific constraints
during training, therefore organising instances by adaptively enforcing
inter-category and inter-modality correlations. This is supported by a
scheduled adaptive margin function, that is smoothly activated, replacing a
static margin by an adaptively inferred one reflecting triplet-specific
semantic correlations while accounting for the incremental learning behaviour
of neural networks to enforce category cluster formation and enforcement.
Experiments on widely used datasets show that our model improved upon
state-of-the-art approaches, by achieving a relative improvement of up to
~12.5% over the second best method, thus confirming the effectiveness of our
scheduled adaptive margin formulation.

本文提出一种新的逐步自适应最大边界（SAM）公式，通过推断在训练期间的三元约束，从而通过自适应地强制执行类别之间和模态之间的相关性，组织实例。在广泛使用的数据集上，实验证明了 SAM 方法的相对改进，达到了比第二佳方法高约 12.5% 的效果，从而确认了我们的可调自适应边界公式的有效性。