Abstract:Sequential recommendation typically utilizes deep neural networks to mine rich information in interaction sequences. However, existing methods often face the issue of insufficient interaction data. To alleviate the sparsity issue, self-supervised learning is introduced into sequential recommendation. Despite its effectiveness, we argue that current self-supervised learning-based (i.e., SSL-based) sequential recommendation models have the following limitations: (1) using only a single self-supervised learning method, either contrastive self-supervised learning or generative self-supervised learning. (2) employing a simple data augmentation strategy in either the graph structure domain or the node feature domain. We believe that they have not fully utilized the capabilities of both self-supervised methods and have not sufficiently explored the advantages of combining graph augmentation schemes. As a result, they often fail to learn better item representations. In light of this, we propose a novel multi-task sequential recommendation framework named Adaptive Self-supervised Learning for sequential Recommendation (ASLRec). Specifically, our framework combines contrastive and generative self-supervised learning methods adaptively, simultaneously applying different perturbations at both the graph topology and node feature levels. This approach constructs diverse augmented graph views and employs multiple loss functions (including contrastive loss, generative loss, mask loss, and prediction loss) for joint training. By encompassing the capabilities of various methods, our model learns item representations across different augmented graph views to achieve better performance and effectively mitigate interaction noise and sparsity. In addition, we add a small proportion of random uniform noise to item representations, making the item representations more uniform and mitigating the inherent popularity bias in interaction records. We conduct extensive experiments on three publicly available benchmark datasets to evaluate our model. The results demonstrate that our approach achieves state-of-the-art performance compared to 14 other competitive methods: the hit rate (HR) improved by over 14.39%, and the normalized discounted cumulative gain (NDCG) increased by over 18.67%.

Integrating the Pre-trained Item Representations with Reformed Self-attention Network for Sequential Recommendation

Deep Bi-LSTM Networks for Sequential Recommendation

A Unified Hierarchical Attention Framework for Sequential Recommendation by Fusing Long and Short-Term Preferences

Adaptive self-supervised learning for sequential recommendation

Attentive Hybrid Recurrent Neural Networks for sequential recommendation

Combining Non-sampling and Self-attention for Sequential Recommendation.

Long- and short-term collaborative attention networks for sequential recommendation

Feature-Level Deeper Self-Attention Network with Contrastive Learning for Sequential Recommendation

Self-Attention Based Sequential Recommendation with Graph Convolutional Networks

Feature Interaction Dual Self-attention network for sequential recommendation

FISSA: Fusing Item Similarity Models with Self-Attention Networks for Sequential Recommendation

An improved sequential recommendation model based on spatial self-attention mechanism and meta learning

S3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization

Sequential Recommendation with a Pre-trained Module Learning Multi-modal Information

Graph convolutional network and self-attentive for sequential recommendation

Long- and short-term self-attention network for sequential recommendation

Self-Supervised Multi-Modal Sequential Recommendation

Intention Enhanced Dual Heterogeneous Graph Attention Network for Sequential Recommendation

HSA: Hyperbolic Self-attention for Sequential Recommendation

Long-short Interest Network with Graph-Based Method for Sequential Recommendation

Learning Neighbor User Intention on User-Item Interaction Graphs for Better Sequential Recommendation