In modern e-commerce, item content features in various modalities offer accurate yet comprehensive information to recommender systems. The majority of previous work either focuses on learning effective item representation during modelling user-item interactions, or exploring item-item relationships by analysing multi-modal features. Those methods, however, fail to incorporate the collaborative item-user-item relationships into the multi-modal feature-based item structure. In this work, we propose a graph-based item structure enhancement method MM-GEF: Multi-Modal recommendation with Graph Early-Fusion, which effectively combines the latent item structure underlying multi-modal contents with the collaborative signals. Instead of processing the content feature in different modalities separately, we show that the early-fusion of multi-modal features provides significant improvement. MM-GEF learns refined item representations by injecting structural information obtained from both multi-modal and collaborative signals. Through extensive experiments on four publicly available datasets, we demonstrate systematical improvements of our method over state-of-the-art multi-modal recommendation methods.

现代电子商务中，多种内容形式的物品特征为推荐系统提供了精确而全面的信息。本研究提出了一种基于图形的物品结构增强方法MM-GEF：多模态图形早期融合推荐，通过将多模态特征的潜在物品结构与协作信号相结合，有效地改善了物品表示。在四个公开数据集上进行的大量实验证明了我们方法在多模态推荐技术方面的系统改进。

MM-GEF：多模态表示与协同过滤相遇