Abstract:Traditional sequential recommendation methods assume that users' sequence data is clean enough to learn accurate sequence representations to reflect user preferences. In practice, users' sequences inevitably contain noise (e.g., accidental interactions), leading to incorrect reflections of user preferences. Consequently, some pioneer studies have explored modeling sequentiality and correlations in sequences to implicitly or explicitly reduce noise's influence. However, relying on only available intra-sequence information (i.e., sequentiality and correlations in a sequence) is insufficient and may result in over-denoising and under-denoising problems (OUPs), especially for short sequences. To improve reliability, we propose to augment sequences by inserting items before denoising. However, due to the data sparsity issue and computational costs, it is challenging to select proper items from the entire item universe to insert into proper positions in a target sequence. Motivated by the above observation, we propose a novel framework--Self-augmented Sequence Denoising for sequential Recommendation (SSDRec) with a three-stage learning paradigm to solve the above challenges. In the first stage, we empower SSDRec by a global relation encoder to learn multi-faceted inter-sequence relations in a data-driven manner. These relations serve as prior knowledge to guide subsequent stages. In the second stage, we devise a self-augmentation module to augment sequences to alleviate OUPs. Finally, we employ a hierarchical denoising module in the third stage to reduce the risk of false augmentations and pinpoint all noise in raw sequences. Extensive experiments on five real-world datasets demonstrate the superiority of \model over state-of-the-art denoising methods and its flexible applications to mainstream sequential recommendation models. The source code is available at

Sequenced-Replacement Sampling for Deep Learning.

Soft Random Sampling: A Theoretical and Empirical Analysis

Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks

SamplingAug: on the Importance of Patch Sampling Augmentation for Single Image Super-Resolution.

Accelerating Stratified Sampling SGD by Reconstructing Strata

Reinforcement Learning for Sampling on Temporal Medical Imaging Sequences

Curriculum-Based Neighborhood Sampling For Sequence Prediction

Repeated Random Sampling for Minimizing the Time-to-Accuracy of Learning

DeepRSD: A Deep Regression Method for Sequential Data

Adaptive Sampling for Deep Learning via Efficient Nonparametric Proxies

SLADS-Net: Supervised Learning Approach for Dynamic Sampling using Deep Neural Networks

$k$-Neighbor Based Curriculum Sampling for Sequence Prediction

One Backward from Ten Forward, Subsampling for Large-Scale Deep Learning

Towards Better Generalization of Deep Neural Networks via Non-Typicality Sampling Scheme

Deep Sampling Networks

AdaSelection: Accelerating Deep Learning Training through Data Subsampling

Unravelling Small Sample Size Problems in the Deep Learning World

Posterior Sampling for Deep Reinforcement Learning

SSDRec: Self-Augmented Sequence Denoising for Sequential Recommendation

An Improved Mini-Batching Technique: Sample-and-Learn

SRK-Augment: A Self-Replacement and Discriminative Region Keeping Augmentation Scheme for Better Classification.