Abstract:The key problem of sequential recommendation is how to capture user sequential patterns and enrich user sequential representations from historical interactions, mainly due to the uncertainty of user behavior and the limited information. The RNN-based methods capture the long- and short-term level patterns. The CNN-based methods treat the representation of the user’s historical interaction as an “image”, and discover the point-level patterns, union-level patterns and union-level with skip once. The attention-based methods mine the focus-level patterns. However, all the previous methods have only studied how to capture users’ sequential patterns in the time domain. In many cases, if we only consider the time domain information, these methods will have trouble in mining the user’s sequential patterns. To solve this problem, we consider the frequency domain to capture frequency-level patterns for the first time. Because a non-periodic historical behavior sequence in the time domain may be brutal to reflect the user’s intention but much more accessible in the frequency domain. In light of this, we propose a novel Attention-based Frequency-aware Multi-scale Network (AFMN) for Sequential Recommendation. We introduce Fourier transform to decompose the simple embedding vector, the representation of the user’s historical interaction, into a multi-frequency embedding vector to enrich the user’s behavior sequence representation. The frequency-aware attention layers adaptively focus on the important frequency components and output a refined multi-frequency embedding vector. Given the multi-frequency embedding vector, we develop a non-local attention module to aggregate attribute-level and item-level features of the previous L items. Empirical results on four public benchmark datasets show that our method can achieve a significant improvement over the state-of-the-art baselines.

Multi-channel Orthogonal Decomposition Attention Network for Sequential Recommendation

Double Attention Convolutional Neural Network for Sequential Recommendation.

Attention-based Frequency-aware Multi-scale Network for Sequential Recommendation

Online Distillation-enhanced Multi-modal Transformer for Sequential Recommendation

Sequential Recommendation with Decomposed Item Feature Routing

Dynamic Memory based Attention Network for Sequential Recommendation

Multimodal Interactive Network for Sequential Recommendation

Multi-Order Attentive Ranking Model for Sequential Recommendation

Deep Bi-LSTM Networks for Sequential Recommendation

Sequential Recommender System Based on Hierarchical Attention Networks.

Mutual Harmony: Sequential Recommendation with Dual Contrastive Network

Attention-based sequential recommendation system using multimodal data

Attentive Hybrid Recurrent Neural Networks for sequential recommendation

Multimodal Difference Learning for Sequential Recommendation

Self-Supervised Multi-Modal Sequential Recommendation

Multi-interest sequential recommendation with contrastive learning and temporal analysis

Multi-Grained Fusion Graph Neural Networks for Sequential Recommendation.

Sequence-Aware Recommendation with Long-Term and Short-Term Attention Memory Networks

Intention Enhanced Dual Heterogeneous Graph Attention Network for Sequential Recommendation

Mixed Attention Network for Cross-domain Sequential Recommendation