Abstract:Over the past decades, the abundance of personal data has led to the rapid development of machine learning models and important advances in artificial intelligence (AI). However, alongside all the achievements, there are increasing privacy threats and security risks that may cause significant losses for data providers. Recent legislation requires that the private information about a user should be removed from a database as well as machine learning models upon certain deletion requests. While erasing data records from memory storage is straightforward, it is often challenging to remove the influence of particular data samples from a model that has already been trained. Machine unlearning is an emerging paradigm that aims to make machine learning models "forget" what they have learned about particular data. Nevertheless, the unlearning issue for federated learning has not been completely addressed due to its special working mode. First, existing solutions crucially rely on retraining-based model calibration, which is likely unavailable and can pose new privacy risks for federated learning frameworks. Second, today's efficient unlearning strategies are mainly designed for convex problems, which are incapable of handling more complicated learning tasks like neural networks. To overcome these limitations, we took advantage of differential privacy and developed an efficient machine unlearning algorithm named FedRecovery. The FedRecovery erases the impact of a client by removing a weighted sum of gradient residuals from the global model, and tailors the Gaussian noise to make the unlearned model and retrained model statistically indistinguishable. Furthermore, the algorithm neither requires retraining-based fine-tuning nor needs the assumption of convexity. Theoretical analyses show the rigorous indistinguishability guarantee. Additionally, the experiment results on real-world datasets demonstrate that the FedRecovery is efficient and is able to produce a model that performs similarly to the retrained one.

FedME2: Memory Evaluation & Erase Promoting Federated Unlearning in DTMN

FedME 2 : Memory Evaluation & Erase Promoting Federated Unlearning in DTMN

FedDGP: Disentangling Global and Personal Models for Federated Learning

TARGET: Federated Class-Continual Learning Via Exemplar-Free Distillation

Dmaf: Data-Model Anti-Forgetting for Federated Incremental Learning

FedQUIT: On-Device Federated Unlearning via a Quasi-Competent Virtual Teacher

Mitigating Poor Data Quality Impact with Federated Unlearning for Human-Centric Metaverse

Forgettable Federated Linear Learning with Certified Data Unlearning

FedEraser: Enabling Efficient Client-Level Data Removal from Federated Learning Models

Federated Unlearning With Momentum Degradation

Federated Unlearning via Active Forgetting

Computation Offloading and Resource Allocation Based on DT-MEC-Assisted Federated Learning Framework

The Right to Be Forgotten in Federated Learning: an Efficient Realization with Rapid Retraining

Towards Federated Domain Unlearning: Verification Methodologies and Challenges

FedMeS: Personalized Federated Continual Learning Leveraging Local Memory

FedRecovery: Differentially Private Machine Unlearning for Federated Learning Frameworks.

FedCIO: Efficient Exact Federated Unlearning with Clustering, Isolation, and One-shot Aggregation.

Acceleration of Federated Learning with Alleviated Forgetting in Local Training

FedML-HE: An Efficient Homomorphic-Encryption-Based Privacy-Preserving Federated Learning System

Efficient Vertical Federated Unlearning via Fast Retraining

FedMPT: Federated Learning for Multiple Personalized Tasks Over Mobile Computing