Abstract:Recent Transformer-based architectures have achieved encouraging performance for sequential recommendation, whereas their computational complexity is quadratic to the sequence length. MLP4Rec is a promising solution to settle this issue, which captures item transition patterns by a MLP-Mixer layer. Despite effectiveness, we argue that it still faces two critical limitations. On the one hand, it employs the one-hot ID technique to generate each user/item embedding, which has no specific semantics apart from being an identifier. In this case, given these ID embeddings as the original input of a MLP-Mixer layer, it is non-trivial to distill the useful information for other layers. On the other hand, it fails to explicitly differentiate the significance of different factors of an item, which is unrealistic to capture the user’s true taste in a short context; meanwhile, it also does not discriminate the importance of each item instance given the recent actions of a user. To overcome such two limitations, we propose a new solution for sequential recommendation, namely a graph Gating-Mixer Recommender (GMRec). Our solution decomposes the sequential recommendation workflow into three steps. First, by means of graph neural networks, we embed a linear graph propagation module to produce high-quality user and item embeddings. Afterwards, we replace the MLP-Mixer layer in MLP4Rec with a devised dual gating block, which could dynamically control what features and which items can be passed to the downstream layers. Lastly, we devise a user-specific gating strategy to adaptively integrate two components in GMRec. Extensive experiments are performed on the Beauty, Cellphone, Gowalla, and ML-10M datasets, demonstrating the rationality and effectiveness of our solution. Specifically, when Precision@10, Recall@10, MAP@10, and NDCG@10 are adopted as evaluation metrics, the performance gains of GMRec over recent state-of-the-art methods on four datasets are 11.91%, 19.46%, 9.56%, and 13.01%, respectively. Our implemented codes and datasets are available via https://github.com/wubinzzu/GMRec.

TriMLP: A Foundational MLP-like Architecture for Sequential Recommendation

TriMLP: Revenge of a MLP-like Architecture in Sequential Recommendation

SMLP4Rec: An Efficient all-MLP Architecture for Sequential Recommendations

MMMLP: Multi-modal Multilayer Perceptron for Sequential Recommendations

AutoMLP: Automated MLP for Sequential Recommendations

Learning Global and Multi-granularity Local Representation with MLP for Sequential Recommendation.

MLP4Rec: A Pure MLP Architecture for Sequential Recommendations

MOI-Mixer: Improving MLP-Mixer with Multi Order Interactions in Sequential Recommendation

Filter-enhanced MLP is All You Need for Sequential Recommendation

Graph Gating-Mixer for Sequential Recommendation

Discrete Listwise Personalized Ranking for Fast Top-N Recommendation with Implicit Feedback

DRDT: Dynamic Reflection with Divergent Thinking for LLM-based Sequential Recommendation

Rethinking Large Language Model Architectures for Sequential Recommendations

SLMRec: Empowering Small Language Models for Sequential Recommendation

MaTrRec: Uniting Mamba and Transformer for Sequential Recommendation

AdaMCT: Adaptive Mixture of CNN-Transformer for Sequential Recommendation

When Multi-Level Meets Multi-Interest: A Multi-Grained Neural Model for Sequential Recommendation

Improving Sequential Recommendations with LLMs

Pre-train, Align, and Disentangle: Empowering Sequential Recommendation with Large Language Models

Molar: Multimodal LLMs with Collaborative Filtering Alignment for Enhanced Sequential Recommendation

MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendation