Abstract:Sequential recommendation (SR) is an essential component of modern recommender systems. It models the dynamic interest of users based on their sequential interactions. Recently, several studies have utilized sequential deep learning models such as Recurrent Neural Networks and Transformers to facilitate sequential recommendation, which shows promising results. Inspired by the rise of contrastive learning techniques, some methods are devoted to enhance sequential deep learning models by designing contrastive learning loss on self-supervised signals. However, there are still a number of obstacles that make it challenging to efficiently learn user representations by contrastive learning. These issues include, but are not limited to, data sparsity, noisy data, and sampling bias ( e.g., false negative), particularly in complex, parameter-intensive models. In light of these challenges, we examine how to deal with data sparsity and noisy data by implementing contrastive Self-Supervised Learning (SSL) and Momentum Contrast (MoCo) to the sequential recommendation. Except typical in-batch negatives, our basic idea is to maintain a dynamic queue to expand negative samples with a moving-averaged encoder. After being augmented by sequence-level and embedding-level methods, the representations from all historical encoder output are pushed into the dynamic queue, which usually leads to sampling bias when potential positives in the queue are used as expanded negative samples in contrastive learning. To tackle this issue, we integrate momentum updating mechanism with a novel instance weighting mechanism to penalize false negatives and guarantee the model's efficacy. To this end, we introduce a fresh framework called Mo mentum Co ntrastive Learning Framework for S equential Rec ommendation ( MoCo4SRec ). Experiments on seven real-world datasets demonstrate how the suggested strategy might boost model performance over current benchmarks by adopting improved user representations.

TFCSRec: Time–frequency consistency based contrastive learning for sequential recommendation

Temporal Density-aware Sequential Recommendation Networks with Contrastive Learning

A Time-Aware Self-Attention Based Neural Network Model for Sequential Recommendation.

Long and short-term interest contrastive learning under filter-enhanced sequential recommendation

MoCo4SRec: A momentum contrastive learning framework for sequential recommendation

Continuous-Time Sequential Recommendation with Temporal Graph Collaborative Transformer

Sequential Recommendation with Multiple Contrast Signals

Dual Contrastive Network for Sequential Recommendation

Time Interval Aware Self-Attention for Sequential Recommendation

Mutual Harmony: Sequential Recommendation with Dual Contrastive Network

UniRec: A Dual Enhancement of Uniformity and Frequency in Sequential Recommendations

Contrastive Pre-training for Sequential Recommendation

Sequential Recommendation with Recurrent Convolutional Model

Graph Neural Network-Guided Contrastive Learning for Sequential Recommendation

Cross-domain sequential recommendation base on Fourier transform and contrastive variational augmentation

Empowering Sequential Recommendation from Collaborative Signals and Semantic Relatedness

FSASA: Sequential recommendation based on fusing session-aware models and self-attention networks

Time Matters: Sequential Recommendation with Complex Temporal Information

Contrastive Enhanced Slide Filter Mixer for Sequential Recommendation

Time Interval-Enhanced Graph Neural Network for Shared-Account Cross-Domain Sequential Recommendation

Intent Contrastive Learning with Cross Subsequences for Sequential Recommendation