Abstract:Generative models, such as Variational Auto-Encoder (VAE) and Generative Adversarial Network (GAN), have been successfully applied in sequential recommendation. These methods require sampling from probability distributions and adopt auxiliary loss functions to optimize the model, which can capture the uncertainty of user behaviors and alleviate exposure bias. However, existing generative models still suffer from the posterior collapse problem or the model collapse problem, thus limiting their applications in sequential recommendation. To tackle the challenges mentioned above, we leverage a new paradigm of the generative models, i.e., diffusion models, and present sequential recommendation with diffusion models (DiffRec), which can avoid the issues of VAE- and GAN-based models and show better performance. While diffusion models are originally proposed to process continuous image data, we design an additional transition in the forward process together with a transition in the reverse process to enable the processing of the discrete recommendation data. We also design a different noising strategy that only noises the target item instead of the whole sequence, which is more suitable for sequential recommendation. Based on the modified diffusion process, we derive the objective function of our framework using a simplification technique and design a denoise sequential recommender to fulfill the objective function. As the lengthened diffusion steps substantially increase the time complexity, we propose an efficient training strategy and an efficient inference strategy to reduce training and inference cost and improve recommendation diversity. Extensive experiment results on three public benchmark datasets verify the effectiveness of our approach and show that DiffRec outperforms the state-of-the-art sequential recommendation models.

SSRGAN: A Generative Adversarial Network for Streaming Sequential Recommendation

GAG: Global Attributed Graph Neural Network for Streaming Session-based Recommendation

Neural Memory Streaming Recommender Networks with Adversarial Training.

SRecGAN: Pairwise Adversarial Training for Sequential Recommendation.

Enhancing sequential recommendation with contrastive Generative Adversarial Network

Generative Session-based Recommendation

Adaptive Attention-Aware Gated Recurrent Unit for Sequential Recommendation

Streaming Recommender Systems

Utilizing Generative Adversarial Networks for Recommendation Based on Ratings and Reviews.

Stratified and time-aware sampling based adaptive ensemble learning for streaming recommendations

Dynamic Graph Neural Networks for Sequential Recommendation

Conditional Denoising Diffusion for Sequential Recommendation

DCFGAN: An adversarial deep reinforcement learning framework with improved negative sampling for session-based recommender systems

SSR: Joint Optimization of Recommendation and Adaptive Bitrate Streaming for Short-form Video Feed

Non-autoregressive Generative Models for Reranking Recommendation

Sampling-Decomposable Generative Adversarial Recommender

Sequential Recommendation with Diffusion Models

Empowering Sequential Recommendation from Collaborative Signals and Semantic Relatedness

RsyGAN: Generative Adversarial Network for Recommender Systems.

Diffusion Augmentation for Sequential Recommendation