Materials language processing (MLP) is one of the key facilitators of
materials science research, as it enables the extraction of structured
information from massive materials science literature. Prior works suggested
high-performance MLP models for text classification, named entity recognition
(NER), and extractive question answering (QA), which require complex model
architecture, exhaustive fine-tuning and a large number of human-labelled
datasets. In this study, we develop generative pretrained transformer
(GPT)-enabled pipelines where the complex architectures of prior MLP models are
replaced with strategic designs of prompt engineering. First, we develop a
GPT-enabled document classification method for screening relevant documents,
achieving comparable accuracy and reliability compared to prior models, with
only small dataset. Secondly, for NER task, we design an entity-centric
prompts, and learning few-shot of them improved the performance on most of
entities in three open datasets. Finally, we develop an GPT-enabled extractive
QA model, which provides improved performance and shows the possibility of
automatically correcting annotations. While our findings confirm the potential
of GPT-enabled MLP models as well as their value in terms of reliability and
practicability, our scientific methods and systematic approach are applicable
to any materials science domain to accelerate the information extraction of
scientific literature.

材料语言处理 (MLP) 是材料科学研究的关键推动者之一，通过从大量的材料科学文献中提取结构化信息，使得研究变得可能。我们开发了基于生成预训练变换器 (GPT) 的流水线工具，其中基于先前 MLP 模型的复杂架构被战略性的提示工程设计所取代。我们的发现证实了 GPT-MLP 模型的潜力以及它们在可靠性和实用性方面的价值，并且我们的科学方法和系统性方法适用于加速科学文献的信息提取的任何材料科学领域。