Learning an effective representation in multi-label text classification
(MLTC) is a significant challenge in NLP. This challenge arises from the
inherent complexity of the task, which is shaped by two key factors: the
intricate connections between labels and the widespread long-tailed
distribution of the data. To overcome this issue, one potential approach
involves integrating supervised contrastive learning with classical supervised
loss functions. Although contrastive learning has shown remarkable performance
in multi-class classification, its impact in the multi-label framework has not
been thoroughly investigated. In this paper, we conduct an in-depth study of
supervised contrastive learning and its influence on representation in MLTC
context. We emphasize the importance of considering long-tailed data
distributions to build a robust representation space, which effectively
addresses two critical challenges associated with contrastive learning that we
identify: the "lack of positives" and the "attraction-repulsion imbalance".
Building on this insight, we introduce a novel contrastive loss function for
MLTC. It attains Micro-F1 scores that either match or surpass those obtained
with other frequently employed loss functions, and demonstrates a significant
improvement in Macro-F1 scores across three multi-label datasets.

我们进行了关于有监督对比学习在多标签文本分类中的影响以及如何构建稳健的表示空间的研究，提出了一种新的对比损失函数，并在三个多标签数据集上实现了显著的宏 F1 分数改进。