Abstract:The advent of Federated Learning (FL) has revolutionized the way distributed systems handle collaborative model training while preserving user privacy. Recently, Federated Unlearning (FU) has emerged to address demands for the "right to be forgotten"" and unlearning of the impact of poisoned clients without requiring retraining in FL. Most FU algorithms require the cooperation of retained or target clients (clients to be unlearned), introducing additional communication overhead and potential security risks. In addition, some FU methods need to store historical models to execute the unlearning process. These challenges hinder the efficiency and memory constraints of the current FU methods. Moreover, due to the complexity of nonlinear models and their training strategies, most existing FU methods for deep neural networks (DNN) lack theoretical certification. In this work, we introduce a novel FL training and unlearning strategy in DNN, termed Forgettable Federated Linear Learning (F^2L^2). F^2L^2 considers a common practice of using pre-trained models to approximate DNN linearly, allowing them to achieve similar performance as the original networks via Federated Linear Training (FLT). We then present FedRemoval, a certified, efficient, and secure unlearning strategy that enables the server to unlearn a target client without requiring client communication or adding additional storage. We have conducted extensive empirical validation on small- to large-scale datasets, using both convolutional neural networks and modern foundation models. These experiments demonstrate the effectiveness of F^2L^2 in balancing model accuracy with the successful unlearning of target clients. F^2L^2 represents a promising pipeline for efficient and trustworthy FU. The code is available here.

F2UL: Fairness-Aware Federated Unlearning for Data Trading

E2FL: Equal and Equitable Federated Learning

Ada‐FFL: Adaptive Computing Fairness Federated Learning

Toward the Tradeoffs between Privacy, Fairness and Utility in Federated Learning

Multi-Dimensional Fair Federated Learning

Federated Fairness Analytics: Quantifying Fairness in Federated Learning

Rethinking the Representation in Federated Unsupervised Learning with Non-IID Data

Achieving Model Fairness in Vertical Federated Learning

FAIR: Quality-Aware Federated Learning with Precise User Incentive and Model Aggregation.

Unified Fair Federated Learning for Digital Healthcare

Improving Federated Learning with Quality-Aware User Incentive and Auto-Weighted Model Aggregation.

Fairness-Aware Client Selection for Federated Learning

Privacy and Fairness in Federated Learning: on the Perspective of Trade-off

PUFFLE: Balancing Privacy, Utility, and Fairness in Federated Learning

WassFFed: Wasserstein Fair Federated Learning

FedFDP: Fairness-Aware Federated Learning with Differential Privacy

FedFair^3: Unlocking Threefold Fairness in Federated Learning

FedUP: Bridging Fairness and Efficiency in Cross-Silo Federated Learning

Fairness-aware Agnostic Federated Learning

Forgettable Federated Linear Learning with Certified Data Unlearning

FIFL: A Fair Incentive Mechanism for Federated Learning