Abstract:The advent of Federated Learning (FL) has revolutionized the way distributed systems handle collaborative model training while preserving user privacy. Recently, Federated Unlearning (FU) has emerged to address demands for the "right to be forgotten"" and unlearning of the impact of poisoned clients without requiring retraining in FL. Most FU algorithms require the cooperation of retained or target clients (clients to be unlearned), introducing additional communication overhead and potential security risks. In addition, some FU methods need to store historical models to execute the unlearning process. These challenges hinder the efficiency and memory constraints of the current FU methods. Moreover, due to the complexity of nonlinear models and their training strategies, most existing FU methods for deep neural networks (DNN) lack theoretical certification. In this work, we introduce a novel FL training and unlearning strategy in DNN, termed Forgettable Federated Linear Learning (F^2L^2). F^2L^2 considers a common practice of using pre-trained models to approximate DNN linearly, allowing them to achieve similar performance as the original networks via Federated Linear Training (FLT). We then present FedRemoval, a certified, efficient, and secure unlearning strategy that enables the server to unlearn a target client without requiring client communication or adding additional storage. We have conducted extensive empirical validation on small- to large-scale datasets, using both convolutional neural networks and modern foundation models. These experiments demonstrate the effectiveness of F^2L^2 in balancing model accuracy with the successful unlearning of target clients. F^2L^2 represents a promising pipeline for efficient and trustworthy FU. The code is available here.

FedFRR: Federated Forgetting-Resistant Representation Learning

Accurate Forgetting for Heterogeneous Federated Continual Learning

RRA-FFSCIL: Inter-intra classes representation and relationship augmentation federated few-shot incremental learning

Federated Probability Memory Recall for Federated Continual Learning

Addressing Catastrophic Forgetting in Federated Learning on Resource-Constrained Devices: A Feature Replay Approach

Forgetting Through Transforming: Enabling Federated Unlearning via Class-Aware Representation Transformation

Forgettable Federated Linear Learning with Certified Data Unlearning

Federated Unlearning via Active Forgetting

Acceleration of Federated Learning with Alleviated Forgetting in Local Training

Towards Efficient Replay in Federated Incremental Learning

Revocable Federated Learning: A Benchmark of Federated Forest

Rehearsal-free Federated Domain-incremental Learning

Overcoming Forgetting in Federated Learning on Non-IID Data

Resource-Efficient Heterogenous Federated Continual Learning on Edge

Dmaf: Data-Model Anti-Forgetting for Federated Incremental Learning

The Right to Be Forgotten in Federated Learning: an Efficient Realization with Rapid Retraining

Federated Class-Incremental Learning with New-Class Augmented Self-Distillation

FPPL: An Efficient and Non-IID Robust Federated Continual Learning Framework

Diffusion-Driven Data Replay: A Novel Approach to Combat Forgetting in Federated Class Continual Learning

FedINC: an Exemplar-Free Continual Federated Learning Framework with Small Labeled Data

Federated Learning With Long-Tailed Data via Representation Unification and Classifier Rectification