During times of increasing antibiotic resistance and the spread of infectious
diseases like COVID-19, it is important to classify genes related to antibiotic
resistance. As natural language processing has advanced with transformer-based
language models, many language models that learn characteristics of nucleotide
sequences have also emerged. These models show good performance in classifying
various features of nucleotide sequences. When classifying nucleotide
sequences, not only the sequence itself, but also various background knowledge
is utilized. In this study, we use not only a nucleotide sequence-based
language model but also a text language model based on PubMed articles to
reflect more biological background knowledge in the model. We propose a method
to fine-tune the nucleotide sequence language model and the text language model
based on various databases of antibiotic resistance genes. We also propose an
LLM-based augmentation technique to supplement the data and an ensemble method
to effectively combine the two models. We also propose a benchmark for
evaluating the model. Our method achieved better performance than the
nucleotide sequence language model in the drug resistance class prediction.

通过使用核苷酸序列语言模型和基于 PubMed 文章的文本语言模型，我们提出了一种细调核苷酸序列语言模型和文本语言模型的方法，以及一种 LLM 基础上的数据增强技术和有效结合两个模型的集成方法。我们还提出了一种用于评估模型的基准，在药物抗性类别预测中，我们的方法表现出比核苷酸序列语言模型更好的性能。