Recent advancements in specialized large-scale architectures for training
image and language have profoundly impacted the field of computer vision and
natural language processing (NLP). Language models, such as the recent ChatGPT
and GPT4 have demonstrated exceptional capabilities in processing, translating,
and generating human languages. These breakthroughs have also been reflected in
protein research, leading to the rapid development of numerous new methods in a
short time, with unprecedented performance. Language models, in particular,
have seen widespread use in protein research, as they have been utilized to
embed proteins, generate novel ones, and predict tertiary structures. In this
book chapter, we provide an overview of the use of protein generative models,
reviewing 1) language models for the design of novel artificial proteins, 2)
works that use non-Transformer architectures, and 3) applications in directed
evolution approaches.

该研究总结了在蛋白质研究中使用语言模型的应用，包括设计新型人工蛋白质、使用非 Transformer 结构以及应用于定向进化方面。这些成果已经快速提升了蛋白质研究的发展和性能。