Abstract:Federated Learning (FL) has evolved as a powerful tool for collaborative model training across multiple entities, ensuring data privacy in sensitive sectors such as healthcare and finance. However, the introduction of the Right to Be Forgotten (RTBF) poses new challenges, necessitating federated unlearning to delete data without full model retraining. Traditional FL unlearning methods, not originally designed with domain specificity in mind, inadequately address the complexities of multi-domain scenarios, often affecting the accuracy of models in non-targeted domains or leading to uniform forgetting across all domains. Our work presents the first comprehensive empirical study on Federated Domain Unlearning, analyzing the characteristics and challenges of current techniques in multi-domain contexts. We uncover that these methods falter, particularly because they neglect the nuanced influences of domain-specific data, which can lead to significant performance degradation and inaccurate model behavior. Our findings reveal that unlearning disproportionately affects the model's deeper layers, erasing critical representational subspaces acquired during earlier training phases. In response, we propose novel evaluation methodologies tailored for Federated Domain Unlearning, aiming to accurately assess and verify domain-specific data erasure without compromising the model's overall integrity and performance. This investigation not only highlights the urgent need for domain-centric unlearning strategies in FL but also sets a new precedent for evaluating and implementing these techniques effectively.

What problem does this paper attempt to address?

### The problems the paper attempts to solve This paper aims to solve the problem of data forgetting (Domain Unlearning) in the multi - domain environment in Federated Learning (FL). Specifically, the paper focuses on how to efficiently remove the data influence of a specific domain without completely retraining the model while maintaining the performance and integrity of the model in other domains under the premise of complying with the "Right to Be Forgotten" (RTBF). ### Background and challenges 1. **Federated learning and privacy**: - Federated learning is a distributed machine - learning method that allows multiple entities to collaboratively train a model without sharing the original data, thus protecting data privacy. This method is especially important in sensitive fields such as medical and financial. - However, with the introduction of data privacy regulations (such as GDPR and CCPA), the RTBF requires the deletion of users' personal data, which brings new challenges to federated learning. 2. **Limitations of traditional federated forgetting methods**: - Traditional federated forgetting methods are mainly designed for single - domain scenarios and fail to fully consider the complexity in the multi - domain environment. - These methods often lead to a decline in the model performance of non - target domains or evenly forget data in all domains, thus affecting the overall accuracy of the model. 3. **Specialties of the multi - domain environment**: - In multi - domain federated learning, the data of different clients come from different domains, resulting in the heterogeneity (non - IID) of data distribution. This heterogeneity makes it difficult for traditional forgetting methods to effectively respond. - In particular, these methods ignore the subtle influence of domain - specific data, which may lead to the erasure of the deep - level representation space of the model and then affect the overall performance of the model. ### Main contributions of the paper 1. **The first comprehensive empirical study**: - This paper conducts the first comprehensive empirical study on Federated Domain Unlearning, analyzing the characteristics and challenges of current technologies in the multi - domain environment. 2. **Revealing the deficiencies of existing methods**: - Through detailed quantitative analysis, the paper points out that existing methods perform poorly in the multi - domain environment and often lead to a decline in the model performance of non - target domains or data forgetting across the board. 3. **Proposing innovative verification methods**: - In order to evaluate the forgetting effect of domain - specific data, the paper proposes new verification methods. These methods aim to accurately evaluate and confirm the complete deletion of target - domain data without compromising the overall integrity and performance of the model. ### Methods and experiments 1. **Experimental setup**: - Three datasets containing multi - domain data (Domain - Digits, Office - Caltech, DomainNet) are used for experiments. - The model architectures include convolutional neural networks and VGG16. - In the federated learning process, each client is assigned a complete domain data, the number of local update rounds is 10, and the global training round number is 50. 2. **Evaluating the effectiveness of existing methods**: - Five advanced federated forgetting methods are evaluated, including Retrain, Rapid Retraining, FedEraser, Increase Loss, and Class - Discriminative Pruning. - The experimental results show that the existing forgetting methods have different effects in the multi - domain environment and generally have a negative impact on the performance of non - target domains. ### Conclusion The paper reveals the complexity of multi - domain federated forgetting and the limitations of existing methods through empirical research, and proposes new verification methods to evaluate the forgetting effect of domain - specific data. These contributions not only provide directions for future research but also provide strong support for data privacy protection in practical applications.

Towards Federated Domain Unlearning: Verification Methodologies and Challenges

Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metrics

A Survey on Federated Unlearning: Challenges, Methods, and Future Directions

FedME2: Memory Evaluation & Erase Promoting Federated Unlearning in DTMN

Communication Efficient and Provable Federated Unlearning

SoK: Challenges and Opportunities in Federated Unlearning

A Survey of Federated Unlearning: A Taxonomy, Challenges and Future Directions

VeriFi: Towards Verifiable Federated Unlearning.

The Right to Be Forgotten in Federated Learning: an Efficient Realization with Rapid Retraining

Fast-FedUL: A Training-Free Federated Unlearning with Provable Skew Resilience

FedEraser: Enabling Efficient Client-Level Data Removal from Federated Learning Models

Streamlined Federated Unlearning: Unite as One to Be Highly Efficient

Federated Unlearning via Active Forgetting

FedCSA: Boosting the Convergence Speed of Federated Unlearning under Data Heterogeneity

Federated Unlearning With Momentum Degradation

Forgettable Federated Linear Learning with Certified Data Unlearning

Vertical Federated Unlearning via Backdoor Certification

Federated Unlearning for Human Activity Recognition

Guaranteeing Data Privacy in Federated Unlearning with Dynamic User Participation

Subspace Based Federated Unlearning