Abstract:Recent Transformer-based architectures have achieved encouraging performance for sequential recommendation, whereas their computational complexity is quadratic to the sequence length. MLP4Rec is a promising solution to settle this issue, which captures item transition patterns by a MLP-Mixer layer. Despite effectiveness, we argue that it still faces two critical limitations. On the one hand, it employs the one-hot ID technique to generate each user/item embedding, which has no specific semantics apart from being an identifier. In this case, given these ID embeddings as the original input of a MLP-Mixer layer, it is non-trivial to distill the useful information for other layers. On the other hand, it fails to explicitly differentiate the significance of different factors of an item, which is unrealistic to capture the user’s true taste in a short context; meanwhile, it also does not discriminate the importance of each item instance given the recent actions of a user. To overcome such two limitations, we propose a new solution for sequential recommendation, namely a graph Gating-Mixer Recommender (GMRec). Our solution decomposes the sequential recommendation workflow into three steps. First, by means of graph neural networks, we embed a linear graph propagation module to produce high-quality user and item embeddings. Afterwards, we replace the MLP-Mixer layer in MLP4Rec with a devised dual gating block, which could dynamically control what features and which items can be passed to the downstream layers. Lastly, we devise a user-specific gating strategy to adaptively integrate two components in GMRec. Extensive experiments are performed on the Beauty, Cellphone, Gowalla, and ML-10M datasets, demonstrating the rationality and effectiveness of our solution. Specifically, when Precision@10, Recall@10, MAP@10, and NDCG@10 are adopted as evaluation metrics, the performance gains of GMRec over recent state-of-the-art methods on four datasets are 11.91%, 19.46%, 9.56%, and 13.01%, respectively. Our implemented codes and datasets are available via https://github.com/wubinzzu/GMRec.

Learning Global and Multi-granularity Local Representation with MLP for Sequential Recommendation.

MMMLP: Multi-modal Multilayer Perceptron for Sequential Recommendations

SMLP4Rec: An Efficient all-MLP Architecture for Sequential Recommendations

TriMLP: A Foundational MLP-like Architecture for Sequential Recommendation

MLP4Rec: A Pure MLP Architecture for Sequential Recommendations

TriMLP: Revenge of a MLP-like Architecture in Sequential Recommendation

MV-RNN: A Multi-View Recurrent Neural Network for Sequential Recommendation

Graph Gating-Mixer for Sequential Recommendation

Filter-enhanced MLP is All You Need for Sequential Recommendation

Discrete Listwise Personalized Ranking for Fast Top-N Recommendation with Implicit Feedback

Multi-Grained Fusion Graph Neural Networks for Sequential Recommendation.

AutoMLP: Automated MLP for Sequential Recommendations

Collaborative Sequential Recommendations via Multi-View GNN-Transformers

MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendation

LGMRec: Local and Global Graph Learning for Multimodal Recommendation

Sequence Neural Network for Recommendation with Multi-Feature Fusion

When Multi-Level Meets Multi-Interest: A Multi-Grained Neural Model for Sequential Recommendation

Multi-modal Mixture of Experts Represetation Learning for Sequential Recommendation

MGT: Multi-Granularity Transformer Leveraging Multi-Level Relation for Sequential Recommendation

Attention And Convolution Enhanced Memory Network For Sequential Recommendation