Abstract:Sequential recommendation typically utilizes deep neural networks to mine rich information in interaction sequences. However, existing methods often face the issue of insufficient interaction data. To alleviate the sparsity issue, self-supervised learning is introduced into sequential recommendation. Despite its effectiveness, we argue that current self-supervised learning-based (i.e., SSL-based) sequential recommendation models have the following limitations: (1) using only a single self-supervised learning method, either contrastive self-supervised learning or generative self-supervised learning. (2) employing a simple data augmentation strategy in either the graph structure domain or the node feature domain. We believe that they have not fully utilized the capabilities of both self-supervised methods and have not sufficiently explored the advantages of combining graph augmentation schemes. As a result, they often fail to learn better item representations. In light of this, we propose a novel multi-task sequential recommendation framework named Adaptive Self-supervised Learning for sequential Recommendation (ASLRec). Specifically, our framework combines contrastive and generative self-supervised learning methods adaptively, simultaneously applying different perturbations at both the graph topology and node feature levels. This approach constructs diverse augmented graph views and employs multiple loss functions (including contrastive loss, generative loss, mask loss, and prediction loss) for joint training. By encompassing the capabilities of various methods, our model learns item representations across different augmented graph views to achieve better performance and effectively mitigate interaction noise and sparsity. In addition, we add a small proportion of random uniform noise to item representations, making the item representations more uniform and mitigating the inherent popularity bias in interaction records. We conduct extensive experiments on three publicly available benchmark datasets to evaluate our model. The results demonstrate that our approach achieves state-of-the-art performance compared to 14 other competitive methods: the hit rate (HR) improved by over 14.39%, and the normalized discounted cumulative gain (NDCG) increased by over 18.67%.

Lighter and Better: Low-Rank Decomposed Self-Attention Networks for Next-Item Recommendation

Graph Contextualized Self-Attention Network for Session-based Recommendation

Session-based Recommendation with Self-Attention Networks

Next Item Recommendation with Self-Attention

DMRAN: A Hierarchical Fine-Grained Attention-Based Network for Recommendation.

Self-Attention Mechanism Enhanced User Interests Modeling for Personalized Recommendation Services in Cyber-Physical-Social Systems.

SANST: A Self-Attentive Network for Next Point-of-Interest Recommendation

Long- and short-term collaborative attention networks for sequential recommendation

Mixed Attention Network for Cross-domain Sequential Recommendation

Self-Attention Based Time-Rating-Aware Context Recommender System

Dynamic Memory based Attention Network for Sequential Recommendation

Adaptive self-supervised learning for sequential recommendation

SANS: Setwise Attentional Neural Similarity Method for Few-Shot Recommendation

Deep Bi-LSTM Networks for Sequential Recommendation

Next-Item Recommendation with Deep Adaptable Co-Embedding Neural Networks

Dual Contrastive Network for Sequential Recommendation

Co-refining User and Item Representations with Feature-level Self-attention for Enhanced Recommendation

Self-Attentive Sequential Recommendation

DCAN: Diversified News Recommendation with Coverage-Attentive Networks

Time Interval Aware Self-Attention for Sequential Recommendation