Multi-label document classification is a traditional task in NLP. Compared to
single-label classification, each document can be assigned multiple classes.
This problem is crucially important in various domains, such as tagging
scientific articles. Documents are often structured into several sections such
as abstract and title. Current approaches treat different sections equally for
multi-label classification. We argue that this is not a realistic assumption,
leading to sub-optimal results. Instead, we propose a new method called
Learning Section Weights (LSW), leveraging the contribution of each distinct
section for multi-label classification. Via multiple feed-forward layers, LSW
learns to assign weights to each section of, and incorporate the weights in the
prediction. We demonstrate our approach on scientific articles. Experimental
results on public (arXiv) and private (Elsevier) datasets confirm the
superiority of LSW, compared to state-of-the-art multi-label document
classification methods. In particular, LSW achieves a 1.3% improvement in terms
of macro averaged F1-score while it achieves 1.3% in terms of macro averaged
recall on the publicly available arXiv dataset.

多标签文档分类中，我们通过引入学习部分权重（LSW）的新方法，能够更准确地处理科学文章等多种领域中的文本分类任务。我们的实验结果表明，相对于现有的方法，LSW 在公开（arXiv）和私人（Elsevier）数据集上取得了显著优势，分别在宏平均 F1 分数和宏平均召回率上提升了 1.3%。

多标签文档分类的学习部分权重

Learning Section Weights for Multi-Label Document Classification

The task of automatic text summarization produces a concise and fluent text
summary while preserving key information and overall meaning. Recent approaches
to document-level summarization have seen significant improvements in recent
years by using models based on the Transformer architecture. However, the
quadratic memory and time complexities with respect to the sequence length make
them very expensive to use, especially with long sequences, as required by
document-level summarization. Our work addresses the problem of document-level
summarization by studying how efficient Transformer techniques can be used to
improve the automatic summarization of very long texts. In particular, we will
use the arXiv dataset, consisting of several scientific papers and the
corresponding abstracts, as baselines for this work. Then, we propose a novel
retrieval-enhanced approach based on the architecture which reduces the cost of
generating a summary of the entire document by processing smaller chunks. The
results were below the baselines but suggest a more efficient memory a
consumption and truthfulness.

本文研究使用 Transformer 技术来提高自动文本摘要的效率，提出基于检索的方法，可以降低处理整个文档的成本。实验结果表明，相较于基线，该方法的存储占用更少，且保证了文本摘要的可靠性。