Learning dynamic user preference has become an increasingly important
component for many online platforms (e.g., video-sharing sites, e-commerce
systems) to make sequential recommendations. Previous works have made many
efforts to model item-item transitions over user interaction sequences, based
on various architectures, e.g., recurrent neural networks and self-attention
mechanism. Recently emerged graph neural networks also serve as useful backbone
models to capture item dependencies in sequential recommendation scenarios.
Despite their effectiveness, existing methods have far focused on item sequence
representation with singular type of interactions, and thus are limited to
capture dynamic heterogeneous relational structures between users and items
(e.g., page view, add-to-favorite, purchase). To tackle this challenge, we
design a Multi-Behavior Hypergraph-enhanced Transformer framework (MBHT) to
capture both short-term and long-term cross-type behavior dependencies.
Specifically, a multi-scale Transformer is equipped with low-rank
self-attention to jointly encode behavior-aware sequential patterns from
fine-grained and coarse-grained levels. Additionally, we incorporate the global
multi-behavior dependency into the hypergraph neural architecture to capture
the hierarchical long-range item correlations in a customized manner.
Experimental results demonstrate the superiority of our MBHT over various
state-of-the-art recommendation solutions across different settings. Further
ablation studies validate the effectiveness of our model design and benefits of
the new MBHT framework. Our implementation code is released at:
this https URL.

设计了一种多行为超图增强 Transformer 框架（MBHT），用于捕获基于多个交互类型的短期和长期行为依赖关系，该框架通过低秩自注意力和超图神经网络结构实现。