Abstract:Federated Unlearning (FU) is gaining prominence for its capability to eliminate influences of Federated Learning (FL) users' data from trained global FL models. A straightforward FU method involves removing the unlearned users and subsequently retraining a new global FL model from scratch with all remaining users, a process that leads to considerable overhead. To enhance unlearning efficiency, a widely adopted strategy employs clustering, dividing FL users into clusters, with each cluster maintaining its own FL model. The final inference is then determined by aggregating the majority vote from the inferences of these sub-models. This method confines unlearning processes to individual clusters for removing a user, thereby enhancing unlearning efficiency by eliminating the need for participation from all remaining users. However, current clustering-based FU schemes mainly concentrate on refining clustering to boost unlearning efficiency but overlook the potential information leakage from FL users' gradients, a privacy concern that has been extensively studied. Typically, integrating secure aggregation (SecAgg) schemes within each cluster can facilitate a privacy-preserving FU. Nevertheless, crafting a clustering methodology that seamlessly incorporates SecAgg schemes is challenging, particularly in scenarios involving adversarial users and dynamic users. In this connection, we systematically explore the integration of SecAgg protocols within the most widely used federated unlearning scheme, which is based on clustering, to establish a privacy-preserving FU framework, aimed at ensuring privacy while effectively managing dynamic user participation. Comprehensive theoretical assessments and experimental results show that our proposed scheme achieves comparable unlearning effectiveness, alongside offering improved privacy protection and resilience in the face of varying user participation.

A Survey on Federated Unlearning: Challenges, Methods, and Future Directions

A Survey on Federated Unlearning: Challenges, Methods, and Future Directions

A Survey of Federated Unlearning: A Taxonomy, Challenges and Future Directions

Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metrics

Streamlined Federated Unlearning: Unite as One to Be Highly Efficient

Towards Federated Domain Unlearning: Verification Methodologies and Challenges

Federated Unlearning: a Perspective of Stability and Fairness

Guaranteeing Data Privacy in Federated Unlearning with Dynamic User Participation

The Right to Be Forgotten in Federated Learning: an Efficient Realization with Rapid Retraining

SoK: Challenges and Opportunities in Federated Unlearning

Unlearning during Learning: An Efficient Federated Machine Unlearning Method

Enable the Right to be Forgotten with Federated Client Unlearning in Medical Imaging

A Generalized Look at Federated Learning: Survey and Perspectives

Forgettable Federated Linear Learning with Certified Data Unlearning

FedUHB: Accelerating Federated Unlearning via Polyak Heavy Ball Method

Subspace Based Federated Unlearning

FedCSA: Boosting the Convergence Speed of Federated Unlearning under Data Heterogeneity

Forgetting Through Transforming: Enabling Federated Unlearning via Class-Aware Representation Transformation

A Survey on Federated Learning Technology.

A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection

Communication Efficient and Provable Federated Unlearning