Recurrent neural networks (RNN) are popular for many computer vision tasks,
including multi-label classification. Since RNNs produce sequential outputs,
labels need to be ordered for the multi-label classification task. Current
approaches sort labels according to their frequency, typically ordering them in
either rare-first or frequent-first. These imposed orderings do not take into
account that the natural order to generate the labels can change for each
image, e.g.\ first the dominant object before summing up the smaller objects in
the image. Therefore, in this paper, we propose ways to dynamically order the
ground truth labels with the predicted label sequence. This allows for the
faster training of more optimal LSTM models for multi-label classification.
Analysis evidences that our method does not suffer from duplicate generation,
something which is common for other models. Furthermore, it outperforms other
CNN-RNN models, and we show that a standard architecture of an image encoder
and language decoder trained with our proposed loss obtains the
state-of-the-art results on the challenging MS-COCO, WIDER Attribute and
PA-100K and competitive results on NUS-WIDE.

本文提出一种动态排序正解标签的方法，用于多标签分类任务，以加快更优 LSTM 模型的训练。实验证明，该方法避免了生成重复标签，并超过了其他 CNN-RNN 模型的性能，证明了在挑战性的数据集上使用标准结构的图像编码器和语言解码器采用提出的损失函数可以得到最先进的结果。