Large bibliometric databases, such as Web of Science, Scopus, and OpenAlex, facilitate bibliometric analyses, but are performative, affecting the visibility of scientific outputs and the impact measurement of participating entities. Recently, these databases have taken up the UN's Sustainable Development Goals (SDGs) in their respective classifications, which have been criticised for their diverging nature. This work proposes using the feature of large language models (LLMs) to learn about the "data bias" injected by diverse SDG classifications into bibliometric data by exploring five SDGs. We build a LLM that is fine-tuned in parallel by the diverse SDG classifications inscribed into the databases' SDG classifications. Our results show high sensitivity in model architecture, classified publications, fine-tuning process, and natural language generation. The wide arbitrariness at different levels raises concerns about using LLM in research practice.

通过利用大型语言模型，本研究探讨了多样的可持续发展目标分类对文献计量数据注入的“数据偏见”，结果表明模型架构、分类出版物、微调过程和自然语言生成中存在广泛的任意性，从而对使用语言模型在研究实践中的应用引发了顾虑。

大型文献计量数据库中SDG分类的执行性