Abstract:A recent study has shown that diffusion models are well-suited for modeling the generative process of user-item interactions in recommender systems due to their denoising nature. However, existing diffusion model-based recommender systems do not explicitly leverage high-order connectivities that contain crucial collaborative signals for accurate recommendations. Addressing this gap, we propose CF-Diff, a new diffusion model-based collaborative filtering (CF) method, which is capable of making full use of collaborative signals along with multi-hop neighbors. Specifically, the forward-diffusion process adds random noise to user-item interactions, while the reverse-denoising process accommodates our own learning model, named cross-attention-guided multi-hop autoencoder (CAM-AE), to gradually recover the original user-item interactions. CAM-AE consists of two core modules: 1) the attention-aided AE module, responsible for precisely learning latent representations of user-item interactions while preserving the model's complexity at manageable levels, and 2) the multi-hop cross-attention module, which judiciously harnesses high-order connectivity information to capture enhanced collaborative signals. Through comprehensive experiments on three real-world datasets, we demonstrate that CF-Diff is (a) Superior: outperforming benchmark recommendation methods, achieving remarkable gains up to 7.29% compared to the best competitor, (b) Theoretically-validated: reducing computations while ensuring that the embeddings generated by our model closely approximate those from the original cross-attention, and (c) Scalable: proving the computational efficiency that scales linearly with the number of users or items.

A Distributional Representation Model For Collaborative Filtering

Using latent class models for neighbors selection in collaborative filtering

Improving Recommendations With Collaborative Factors

A unified latent factor correction scheme for collaborative filtering

Confidence-Learning Based Collaborative Filtering With Heterogeneous Implicit Feedbacks

Attentive and Collaborative Deep Learning for Recommendation

Information Filtering Via Collaborative User Clustering Modeling.

Fusion Recommendation Algorithm Based on DeepWalk and Item-Based Collaborative Filtering

Incorporating Community Detection and Clustering Techniques into Collaborative Filtering Model

Learning Distributed Representations from Reviews for Collaborative Filtering

Learning Continuous User and Item Representations for Neural Collaborative Filtering

Deep Social Collaborative Filtering

Collaborative Deep Ranking: A Hybrid Pair-Wise Recommendation Algorithm with Implicit Feedback

Collaborative Filtering Based on Diffusion Models: Unveiling the Potential of High-Order Connectivity

A Probabilistic Model for Collaborative Filtering.

DeepCF: A Unified Framework of Representation Learning and Matching Function Learning in Recommender System

Dual-regularized One-Class Collaborative Filtering with Implicit Feedback

Disentangled Graph Collaborative Filtering

Representation Learning with Pair-wise Constraints for Collaborative Ranking

Deep Collaborative Filtering Combined with High-Level Feature Generation on Latent Factor Model

Collaborative Filtering: Weighted Nonnegative Matrix Factorization Incorporating User and Item Graphs.