Abstract:Sequential recommendation (SR) is an essential component of modern recommender systems. It models the dynamic interest of users based on their sequential interactions. Recently, several studies have utilized sequential deep learning models such as Recurrent Neural Networks and Transformers to facilitate sequential recommendation, which shows promising results. Inspired by the rise of contrastive learning techniques, some methods are devoted to enhance sequential deep learning models by designing contrastive learning loss on self-supervised signals. However, there are still a number of obstacles that make it challenging to efficiently learn user representations by contrastive learning. These issues include, but are not limited to, data sparsity, noisy data, and sampling bias ( e.g., false negative), particularly in complex, parameter-intensive models. In light of these challenges, we examine how to deal with data sparsity and noisy data by implementing contrastive Self-Supervised Learning (SSL) and Momentum Contrast (MoCo) to the sequential recommendation. Except typical in-batch negatives, our basic idea is to maintain a dynamic queue to expand negative samples with a moving-averaged encoder. After being augmented by sequence-level and embedding-level methods, the representations from all historical encoder output are pushed into the dynamic queue, which usually leads to sampling bias when potential positives in the queue are used as expanded negative samples in contrastive learning. To tackle this issue, we integrate momentum updating mechanism with a novel instance weighting mechanism to penalize false negatives and guarantee the model's efficacy. To this end, we introduce a fresh framework called Mo mentum Co ntrastive Learning Framework for S equential Rec ommendation ( MoCo4SRec ). Experiments on seven real-world datasets demonstrate how the suggested strategy might boost model performance over current benchmarks by adopting improved user representations.

Contrastive Learning with Frequency Domain for Sequential Recommendation

TFCSRec: Time–frequency consistency based contrastive learning for sequential recommendation

Adaptive Frequency Domain Data Augmentation for Sequential Recommendation

Attention-based Frequency-aware Multi-scale Network for Sequential Recommendation

Contrastive Enhanced Slide Filter Mixer for Sequential Recommendation

CFSeRec: A Contrastive Framework for Sequential Recommendation

Equivariant Contrastive Learning for Sequential Recommendation

Long and short-term interest contrastive learning under filter-enhanced sequential recommendation

Hierarchical Contrastive Learning with Multiple Augmentation for Sequential Recommendation

Contrastive Pre-training for Sequential Recommendation

Cross-domain sequential recommendation base on Fourier transform and contrastive variational augmentation

Diffusion-based Contrastive Learning for Sequential Recommendation

Learnable Model Augmentation Contrastive Learning for Sequential Recommendation

Simple Debiased Contrastive Learning for Sequential Recommendation

Graph Neural Network-Guided Contrastive Learning for Sequential Recommendation

Frequency Enhanced Hybrid Attention Network for Sequential Recommendation

Contrastive Self-supervised Sequential Recommendation with Robust Augmentation

Feature-Level Deeper Self-Attention Network with Contrastive Learning for Sequential Recommendation

MoCo4SRec: A momentum contrastive learning framework for sequential recommendation

Explanation Guided Contrastive Learning for Sequential Recommendation