Abstract:Today, computer systems hold large amounts of personal data. Yet while such an abundance of data allows breakthroughs in artificial intelligence, and especially machine learning (ML), its existence can be a threat to user privacy, and it can weaken the bonds of trust between humans and AI. Recent regulations now require that, on request, private information about a user must be removed from both computer systems and from ML models, i.e. ``the right to be forgotten''). While removing data from back-end databases should be straightforward, it is not sufficient in the AI context as ML models often `remember' the old data. Contemporary adversarial attacks on trained models have proven that we can learn whether an instance or an attribute belonged to the training data. This phenomenon calls for a new paradigm, namely machine unlearning, to make ML models forget about particular data. It turns out that recent works on machine unlearning have not been able to completely solve the problem due to the lack of common frameworks and resources. Therefore, this paper aspires to present a comprehensive examination of machine unlearning's concepts, scenarios, methods, and applications. Specifically, as a category collection of cutting-edge studies, the intention behind this article is to serve as a comprehensive resource for researchers and practitioners seeking an introduction to machine unlearning and its formulations, design criteria, removal requests, algorithms, and applications. In addition, we aim to highlight the key findings, current trends, and new research areas that have not yet featured the use of machine unlearning but could benefit greatly from it. We hope this survey serves as a valuable resource for ML researchers and those seeking to innovate privacy technologies. Our resources are publicly available at <a class="link-external link-https" href="https://github.com/tamlhp/awesome-machine-unlearning" rel="external noopener nofollow">this https URL</a>.

Towards Understanding the Feasibility of Machine Unlearning

Machine Unlearning: A Comprehensive Survey

Machine Unlearning: Taxonomy, Metrics, Applications, Challenges, and Prospects

An Overview of Machine Unlearning

Learn to Unlearn: A Survey on Machine Unlearning

Gone but Not Forgotten: Improved Benchmarks for Machine Unlearning

A Survey of Machine Unlearning

Game-Theoretic Machine Unlearning: Mitigating Extra Privacy Leakage

Towards Reliable Empirical Machine Unlearning Evaluation: A Game-Theoretic View

Unlearn and Burn: Adversarial Machine Unlearning Requests Destroy Model Accuracy

Adversarial Machine Unlearning

A Duty to Forget, a Right to Be Assured? Exposing Vulnerabilities in Machine Unlearning Services

Evaluating of Machine Unlearning: Robustness Verification Without Prior Modifications

A More Practical Approach to Machine Unlearning

Machine unlearning through fine-grained model parameters perturbation

Learn What You Want to Unlearn: Unlearning Inversion Attacks against Machine Unlearning

Machine Unlearning for Traditional Models and Large Language Models: A Short Survey

Fair Machine Unlearning: Data Removal while Mitigating Disparities

Verification of Machine Unlearning is Fragile

A Closer Look at Machine Unlearning for Large Language Models

Towards Machine Unlearning Benchmarks: Forgetting the Personal Identities in Facial Recognition Systems