Abstract:The increasing data privacy concerns in recommendation systems have made federated recommendations (FedRecs) attract more and more attention. Existing FedRecs mainly focus on how to effectively and securely learn personal interests and preferences from their on-device interaction data. Still, none of them considers how to efficiently erase a user's contribution to the federated training process. We argue that such a dual setting is necessary. First, from the privacy protection perspective, ``the right to be forgotten'' requires that users have the right to withdraw their data contributions. Without the reversible ability, FedRecs risk breaking data protection regulations. On the other hand, enabling a FedRec to forget specific users can improve its robustness and resistance to malicious clients' attacks. To support user unlearning in FedRecs, we propose an efficient unlearning method FRU (Federated Recommendation Unlearning), inspired by the log-based rollback mechanism of transactions in database management systems. It removes a user's contribution by rolling back and calibrating the historical parameter updates and then uses these updates to speed up federated recommender reconstruction. However, storing all historical parameter updates on resource-constrained personal devices is challenging and even infeasible. In light of this challenge, we propose a small-sized negative sampling method to reduce the number of item embedding updates and an importance-based update selection mechanism to store only important model updates. To evaluate the effectiveness of FRU, we propose an attack method to disturb FedRecs via a group of compromised users and use FRU to recover recommenders by eliminating these users' influence. Finally, we conduct experiments on two real-world recommendation datasets with two widely used FedRecs to show the efficiency and effectiveness of our proposed approaches.

Making recommender systems forget: Learning and unlearning for erasable recommendation

UltraRE: Enhancing RecEraser for Recommendation Unlearning Via Error Decomposition.

Selective and Collaborative Influence Function for Efficient Recommendation Unlearning

ERASER: Machine Unlearning in MLaaS via an Inference Serving-Aware Approach

Forgetting Fast in Recommender Systems

Towards Efficient and Effective Unlearning of Large Language Models for Recommendation

CURE4Rec: A Benchmark for Recommendation Unlearning with Deeper Influence

Exact and Efficient Unlearning for Large Language Model-based Recommendation

On the Effectiveness of Unlearning in Session-Based Recommendation

LMEraser: Large Model Unlearning through Adaptive Prompt Tuning

Recommendation Unlearning via Influence Function

Reinforcement Unlearning

Learning with Recoverable Forgetting

Federated Unlearning for On-Device Recommendation

Making Users Indistinguishable: Attribute-wise Unlearning in Recommender Systems

Unlearn What You Want to Forget: Efficient Unlearning for LLMs

RRL: Recommendation Reverse Learning

A Duty to Forget, a Right to Be Assured? Exposing Vulnerabilities in Machine Unlearning Services

Recommendation Unlearning via Matrix Correction

Unified Parameter-Efficient Unlearning for LLMs