This paper aims to tackle the challenge posed by the increasing integration
of software tools in research across various disciplines by investigating the
application of Falcon-7b for the detection and classification of software
mentions within scholarly texts. Specifically, the study focuses on solving
Subtask I of the Software Mention Detection in Scholarly Publications (SOMD),
which entails identifying and categorizing software mentions from academic
literature. Through comprehensive experimentation, the paper explores different
training strategies, including a dual-classifier approach, adaptive sampling,
and weighted loss scaling, to enhance detection accuracy while overcoming the
complexities of class imbalance and the nuanced syntax of scholarly writing.
The findings highlight the benefits of selective labelling and adaptive
sampling in improving the model's performance. However, they also indicate that
integrating multiple strategies does not necessarily result in cumulative
improvements. This research offers insights into the effective application of
large language models for specific tasks such as SOMD, underlining the
importance of tailored approaches to address the unique challenges presented by
academic text analysis.

通过研究 Falcon-7b 在学术文本中检测和分类软件提及的应用，本研究的主要目标是解决软件提及检测在学术出版物中的子任务一，即从学术文献中识别和分类软件提及。通过综合实验，本论文探讨了不同的训练策略，包括双分类器方法、自适应抽样和加权损失缩放，以提高检测准确性并克服类别不平衡和学术写作的复杂语法等问题。研究结果强调了选择性标注和自适应抽样在改善模型性能方面的益处。然而，研究还表明，整合多种策略并不一定会累积改进。该研究为特定任务如 SOMD 的大型语言模型的有效应用提供了见解，突出了解决学术文本分析中所面临的独特挑战的个性化方法的重要性。

学术文件中的软件提及检测的 Falcon 7b

Falcon 7b for Software Mention Detection in Scholarly Documents

This paper describes our systems for the sub-task I in the Software Mention
Detection in Scholarly Publications shared-task. We propose three approaches
leveraging different pre-trained language models (BERT, SciBERT, and XLM-R) to
tackle this challenge. Our bestperforming system addresses the named entity
recognition (NER) problem through a three-stage framework. (1) Entity Sentence
Classification - classifies sentences containing potential software mentions;
(2) Entity Extraction - detects mentions within classified sentences; (3)
Entity Type Classification - categorizes detected mentions into specific
software types. Experiments on the official dataset demonstrate that our
three-stage framework achieves competitive performance, surpassing both other
participating teams and our alternative approaches. As a result, our framework
based on the XLM-R-based model achieves a weighted F1-score of 67.80%,
delivering our team the 3rd rank in Sub-task I for the Software Mention
Recognition task.

本文通过使用不同的预训练语言模型（BERT，SciBERT 和 XLM-R）提出了三个方法来解决学术出版物中软件提及检测的子任务 I。我们的最佳系统通过一个三阶段框架来解决命名实体识别问题，实验证明我们的方法在官方数据集上取得了竞争性的性能，超过了其他参赛队伍和我们的替代方法，基于 XLM-R 模型的框架达到了 67.80% 的加权 F1 得分，在软件提及识别任务中获得了第三名。