What makes unlearning hard and what to do about it

Kairan Zhao,Meghdad Kurmanji,George-Octavian Bărbulescu,Eleni Triantafillou,Peter Triantafillou

2024-10-31

Abstract:Machine unlearning is the problem of removing the effect of a subset of training data (the ''forget set'') from a trained model without damaging the model's utility e.g. to comply with users' requests to delete their data, or remove mislabeled, poisoned or otherwise problematic data. With unlearning research still being at its infancy, many fundamental open questions exist: Are there interpretable characteristics of forget sets that substantially affect the difficulty of the problem? How do these characteristics affect different state-of-the-art algorithms? With this paper, we present the first investigation aiming to answer these questions. We identify two key factors affecting unlearning difficulty and the performance of unlearning algorithms. Evaluation on forget sets that isolate these identified factors reveals previously-unknown behaviours of state-of-the-art algorithms that don't materialize on random forget sets. Based on our insights, we develop a framework coined Refined-Unlearning Meta-algorithm (RUM) that encompasses: (i) refining the forget set into homogenized subsets, according to different characteristics; and (ii) a meta-algorithm that employs existing algorithms to unlearn each subset and finally delivers a model that has unlearned the overall forget set. We find that RUM substantially improves top-performing unlearning algorithms. Overall, we view our work as an important step in (i) deepening our scientific understanding of unlearning and (ii) revealing new pathways to improving the state-of-the-art.

Machine Learning

What problem does this paper attempt to address?

### What problem does this paper attempt to solve?

This paper explores the "unlearning" problem in machine learning, that is, how to remove the influence of a specific training data set (called the "forget set") from an already - trained model. Specifically, the paper focuses on the following aspects:

1. **Understanding the difficulty of unlearning**: The paper studies which factors will affect the difficulty of unlearning and analyzes the impact of these factors on the performance of existing unlearning algorithms.

2. **Proposing an improvement plan**: Based on the understanding of the difficulty of unlearning, the paper proposes a new framework named "Refined - Unlearning Meta - algorithm (RUM)" to improve the existing unlearning algorithms.

### Main contributions of the paper

1. **Identifying the key factors affecting the difficulty of unlearning**:
- **Degree of entanglement between the retention set and the forget set**: If the retention set and the forget set are highly entangled in the embedding space, the unlearning task will become more difficult.
- **Degree of memory of the forget set**: If the samples in the forget set are highly memorized by the model, the unlearning task will also be more difficult.

2. **Proposing the RUM framework**:
- **Refinement process**: Divide the forget set into multiple homogeneous subsets, and each subset is processed according to its characteristics.
- **Meta - algorithm**: Use different existing algorithms to perform unlearning operations on each subset and finally combine them into an overall model.

### Research background

With the wide application of deep - learning models, the demand for user data privacy and model updates is increasing day by day. The importance of the unlearning problem is reflected in the following aspects:

- **User privacy protection**: Users may request the deletion of their personal data to ensure that their privacy is not violated.
- **Data quality maintenance**: It is necessary to remove mislabeled or toxic data points to maintain the accuracy and reliability of the model.
- **Legal compliance**: Some regulations (such as GDPR) require enterprises to be able to respond to users' data deletion requests.

### Methodology

The paper conducts research through the following steps:

1. **Defining and measuring the difficulty of unlearning**: Introduce an index to measure the difficulty of unlearning - "Tug - of - War (ToW)" - to evaluate the performance of unlearning algorithms in different situations.
2. **Experimental verification**: By generating forget sets with different characteristics (such as low, medium, and high degrees of entanglement and low, medium, and high degrees of memory), verify the impact of the above two key factors on the difficulty of unlearning.
3. **Developing the RUM framework**: Based on the experimental results, design a new meta - algorithm framework to optimize the unlearning process.

### Conclusion

Through in - depth research on the difficulty of unlearning, the paper reveals the limitations of existing unlearning algorithms and proposes a brand - new framework to meet these challenges. The RUM framework not only improves the performance of unlearning algorithms but also provides a new direction for future research.

---

If you have more specific questions or need further information, please feel free to let me know!