The use of pre-training is an emerging technique to enhance a neural model's
performance, which has been shown to be effective for many neural language
models such as BERT. This technique has also been used to enhance the
performance of recommender systems. In such recommender systems, pre-training
models are used to learn a better initialisation for both users and items.
However, recent existing pre-trained recommender systems tend to only
incorporate the user interaction data at the pre-training stage, making it
difficult to deliver good recommendations, especially when the interaction data
is sparse. To alleviate this common data sparsity issue, we propose to
pre-train the recommendation model not only with the interaction data but also
with other available information such as the social relations among users,
thereby providing the recommender system with a better initialisation compared
with solely relying on the user interaction data. We propose a novel
recommendation model, the Social-aware Gaussian Pre-trained model (SGP), which
encodes the user social relations and interaction data at the pre-training
stage in a Graph Neural Network (GNN). Afterwards, in the subsequent
fine-tuning stage, our SGP model adopts a Gaussian Mixture Model (GMM) to
factorise these pre-trained embeddings for further training, thereby benefiting
the cold-start users from these pre-built social relations. Our extensive
experiments on three public datasets show that, in comparison to 16 competitive
baselines, our SGP model significantly outperforms the best baseline by upto
7.7% in terms of NDCG@10. In addition, we show that SGP permits to effectively
alleviate the cold-start problem, especially when users newly register to the
system through their friends' suggestions.

我们提出了一种名为 SGP 的推荐模型，它在预训练阶段使用图神经网络（GNN）对用户的社交关系和互动数据进行编码，并在后续的微调阶段采用高斯混合模型（GMM）来对这些预训练嵌入进行分解，从而使冷启动用户受益于这些预先建立的社交关系。我们在三个公开数据集上进行了广泛的实验，结果表明，与 16 个竞争基线相比，我们的 SGP 模型在 NDCG@10 方面的性能提升高达 7.7%。此外，我们证明了 SGP 能够有效缓解冷启动问题，特别是当用户通过朋友的推荐新注册系统时。