Abstract:Self-attention models have achieved the state-of-the-art performance in sequential recommender systems by capturing the sequential dependencies among user-item interactions. However, they rely on adding positional embeddings to the item sequence to retain the sequential information, which may break the semantics of item embeddings due to the heterogeneity between these two types of embeddings. In addition, most existing works assume that such dependencies exist solely in the item embeddings, but neglect their existence among the item features. In our previous study, we proposed a novel sequential recommendation model, i.e., MLP4Rec, based on the recent advances of MLP-Mixer architectures, which is naturally sensitive to the order of items in a sequence because matrix elements related to different positions of a sequence will be given different weights in training. We developed a tri-directional fusion scheme to coherently capture sequential, cross-channel, and cross-feature correlations with linear computational complexity as well as much fewer model parameters than existing self-attention methods. However, the cascading mixer structure, the large number of normalization layers between different mixer layers, and the noise generated by these operations limit the efficiency of information extraction and the effectiveness of MLP4Rec. In this extended version, we propose a novel framework – SMLP4Rec for sequential recommendation to address the aforementioned issues. The new framework changes the flawed cascading structure to a parallel mode, and integrates normalization layers to minimize their impact on the model’s efficiency while maximizing their effectiveness. As a result, the training speed and prediction accuracy of SMLP4Rec are vastly improved in comparison to MLP4Rec. Extensive experimental results demonstrate that the proposed method is significantly superior to the state-of-the-art approaches. The implementation code is available online to ease reproducibility.

MMMLP: Multi-modal Multilayer Perceptron for Sequential Recommendations

Contrastive Intra- and Inter-Modality Generation for Enhancing Incomplete Multimedia Recommendation

BMLP: Behavior-aware MLP for Heterogeneous Sequential Recommendation

SMLP4Rec: An Efficient all-MLP Architecture for Sequential Recommendations

MMREC: LLM Based Multi-Modal Recommender System

AutoMLP: Automated MLP for Sequential Recommendations

An Empirical Study of Training ID-Agnostic Multi-modal Sequential Recommenders

MOI-Mixer: Improving MLP-Mixer with Multi Order Interactions in Sequential Recommendation

Multimodal Difference Learning for Sequential Recommendation

Harnessing Multimodal Large Language Models for Multimodal Sequential Recommendation

MLP4Rec: A Pure MLP Architecture for Sequential Recommendations

Multi-Modal Self-Supervised Learning for Recommendation

MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendation

Multimodal Pre-training Framework for Sequential Recommendation via Contrastive Learning

Memory Augmented Multi-Instance Contrastive Predictive Coding for Sequential Recommendation

Multimodal Interactive Network for Sequential Recommendation

Online Distillation-enhanced Multi-modal Transformer for Sequential Recommendation

Multi-modal Recommendation Based on Knowledge Graph

MV-RNN: A Multi-View Recurrent Neural Network for Sequential Recommendation

Train Once, Deploy Anywhere: Matryoshka Representation Learning for Multimodal Recommendation