Exploring the application of large-scale language models to graph learning is a novel endeavor. However, the vast amount of information inherent in large graphs poses significant challenges to this process. This paper focuses on the link prediction task and introduces LPNL (Link Prediction via Natural Language), a framework based on a large language model designed for scalable link prediction on large-scale heterogeneous graphs.We design novel prompts for link prediction that articulate graph details in natural language. We propose a two-stage sampling pipeline to extract crucial information from large-scale heterogeneous graphs, and a divide-and-conquer strategy to control the input token count within predefined limits, addressing the challenge of overwhelming information. We fine-tune a T5 model based on our self-supervised learning designed for for link prediction. Extensive experiments on a large public heterogeneous graphs demonstrate that LPNL outperforms various advanced baselines, highlighting its remarkable performance in link prediction tasks on large-scale graphs.

这篇论文描述了如何将大规模语言模型应用于图学习，提出了LPNL（通过自然语言进行链接预测）框架来处理大规模异构图上的可扩展链接预测任务，并通过自我监督学习细调了基于T5模型的链接预测模型，实验证明LPNL在大规模图链接预测任务上表现出色。

大规模异构图中基于大型语言模型的可扩展链接预测