Abstract:In the mobile Internet era, recommender systems have become an irreplaceable tool to help users discover useful items, thus alleviating the information overload problem. Recent research on deep neural network (DNN)-based recommender systems have made significant progress in improving prediction accuracy, largely attributed to the widely accessible large-scale user data. Such data is commonly collected from users' personal devices and then centrally stored in the cloud server to facilitate model training. However, with the rising public concerns on user privacy leakage in online platforms, online users are becoming increasingly anxious over abuses of user privacy. Therefore, it is urgent and beneficial to develop a recommender system that can achieve both high prediction accuracy and strong privacy protection. To this end, we propose a DNN-based recommendation model called PrivRec running on the decentralized federated learning (FL) environment, which ensures that a user's data is fully retained on her/his personal device while contributing to training an accurate model. On the other hand, to better embrace the data heterogeneity (e.g., users' data vary in scale and quality significantly) in FL, we innovatively introduce a first-order meta-learning method that enables fast on-device personalization with only a few data points. Furthermore, to defend against potential malicious participants that pose serious security threat to other users, we further develop a user-level differentially private model, namely DP-PrivRec, so attackers are unable to identify any arbitrary user from the trained model. To compensate for the loss by adding noise during model updates, we introduce a two-stage training approach. Finally, we conduct extensive experiments on two large-scale datasets in a simulated FL environment, and the results validate the superiority of both PrivRec and DP-PrivRec.

DeepRec: On-device Deep Learning for Privacy-Preserving Sequential Recommendation in Mobile Commerce.

$C^3DRec$: Cloud-Client Cooperative Deep Learning for Temporal Recommendation in the Post-GDPR Era

Fast-adapting and privacy-preserving federated recommender system

CoRec: an Efficient Internet Behavior-based Recommendation Framework with Edge-cloud Collaboration on Deep Convolution Neural Networks.

Deep Learning-Based User Privacy Settings Recommendation in Online Social Networks

SDRM-LDP: A Recommendation Model Based on Local Differential Privacy

Practical Privacy Preserving POI Recommendation

Privacy-aware Location Privacy Preference Recommendations

A Federated Multi-View Deep Learning Framework for Privacy-Preserving Recommendations

DPLCF: Differentially Private Local Collaborative Filtering

CryptoRec: Privacy-preserving Recommendation as a Service

AdaRec: Adaptive Sequential Recommendation for Reinforcing Long-term User Engagement

Decentralized Graph Neural Network for Privacy-Preserving Recommendation

Diffusion-Based Cloud-Edge-Device Collaborative Learning for Next POI Recommendations

Quantize Sequential Recommenders Without Private Data

AeroRec: an Efficient On-Device Recommendation Framework Using Federated Self-Supervised Knowledge Distillation

DeepApp: characterizing dynamic user interests for mobile application recommendation

FedRec: Privacy-Preserving News Recommendation with Federated Learning

Medical Privacy-preserving Service Recommendation.

Federated Privacy-preserving Collaborative Filtering for On-Device Next App Prediction

An Effective Federated Recommendation Framework with Differential Privacy