Abstract:Federated learning is a promising privacy-preserving paradigm for distributed machine learning. In this context, there is sometimes a need for a specialized process called machine unlearning, which is required when the effect of some specific training samples needs to be removed from a learning model due to privacy, security, usability, and/or legislative factors. However, problems arise when current centralized unlearning methods are applied to existing federated learning, in which the server aims to remove all information about a class from the global model. Centralized unlearning usually focuses on simple models or is premised on the ability to access all training data at a central node. However, training data cannot be accessed on the server under the federated learning paradigm, conflicting with the requirements of the centralized unlearning process. Additionally, there are high computation and communication costs associated with accessing clients' data, especially in scenarios involving numerous clients or complex global models. To address these concerns, we propose a more effective and efficient federated unlearning scheme based on the concept of model explanation. Model explanation involves understanding deep networks and individual channel importance, so that this understanding can be used to determine which model channels are critical for classes that need to be unlearned. We select the most influential channels within an already-trained model for the data that need to be unlearned and fine-tune only influential channels to remove the contribution made by those data. In this way, we can simultaneously avoid huge consumption costs and ensure that the unlearned model maintains good performance. Experiments with different training models on various datasets demonstrate the effectiveness of the proposed approach.

Towards Efficient Target-Level Machine Unlearning Based on Essential Graph

Don't Forget Too Much: Towards Machine Unlearning on Feature Level

Towards Effective and General Graph Unlearning via Mutual Evolution

Erase then Rectify: A Training-Free Parameter Editing Approach for Cost-Effective Graph Unlearning

Targeted Therapy in Data Removal: Object Unlearning Based on Scene Graphs

Decoupling the Class Label and the Target Concept in Machine Unlearning

Unlink to Unlearn: Simplifying Edge Unlearning in GNNs

Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representations

Unlearning Graph Classifiers with Limited Data Resources

Game-Theoretic Machine Unlearning: Mitigating Extra Privacy Leakage

ERM-KTP: Knowledge-Level Machine Unlearning Via Knowledge Transfer

Update Selective Parameters: Federated Machine Unlearning Based on Model Explanation

Data Selection for Transfer Unlearning

Community-Centric Graph Unlearning

Machine Unlearning: Taxonomy, Metrics, Applications, Challenges, and Prospects

Unlearning from Weakly Supervised Learning

MUter: Machine Unlearning on Adversarially Trained Models

A hybrid framework for effective and efficient machine unlearning

Machine Unlearning: A Comprehensive Survey

Machine Unlearning with Minimal Gradient Dependence for High Unlearning Ratios

Markov Chain Monte Carlo-Based Machine Unlearning: Unlearning What Needs to be Forgotten