Abstract:With the increasing emphasis on data privacy, the significance of machine unlearning has grown substantially. Class unlearning, which involves enabling a trained model to forget data belonging to a specific class learned before, is important as classification tasks account for the majority of today's machine learning as a service (MLaaS). Retraining the model on the original data, excluding the data to be forgotten (a.k.a forgetting data), is a common approach to class unlearning. However, the availability of original data during the unlearning phase is not always guaranteed, leading to the exploration of class unlearning with restricted data access. While current unlearning methods with restricted data access usually generate proxy sample via the trained neural network classifier, they typically focus on training and forgetting balanced data. However, the imbalanced original data can cause trouble for these proxies and unlearning, particularly when the forgetting data consists predominantly of the majority class. To address this issue, we propose the GENerative Imbalanced Unlearning (GENIU) framework. GENIU utilizes a Variational Autoencoder (VAE) to concurrently train a proxy generator alongside the original model. These generated proxies accurately represent each class and are leveraged in the unlearning phase, eliminating the reliance on the original training data. To further mitigate the performance degradation resulting from forgetting the majority class, we introduce an in-batch tuning strategy that works with the generated proxies. GENIU is the first practical framework for class unlearning in imbalanced data settings and restricted data access, ensuring the preservation of essential information for future unlearning. Experimental results confirm the superiority of GENIU over existing methods, establishing its effectiveness in empirical scenarios.

Generative Adversarial Networks Unlearning

Machine Unlearning using a Multi-GAN based Model

Machine Unlearning for Image-to-Image Generative Models

One for All: A Universal Generator for Concept Unlearnability Via Multi-Modal Alignment

Controllable Unlearning for Image-to-Image Generative Models Via Ε-Constrained Optimization

Machine unlearning via GAN

Adapt then Unlearn: Exploiting Parameter Space Semantics for Unlearning in Generative Adversarial Networks

Conditional Matching GAN Guided Reconstruction Attack in Machine Unlearning

Learn while Unlearn: An Iterative Unlearning Framework for Generative Language Models

Generative Unlearning for Any Identity

Unlearning Targeted Information via Single Layer Unlearning Gradient

GENIU: A Restricted Data Access Unlearning for Imbalanced Data

Boundary Unlearning

Machine Unlearning for Image Retrieval: A Generative Scrubbing Approach

Unlearn and Burn: Adversarial Machine Unlearning Requests Destroy Model Accuracy

Boosting Alignment for Post-Unlearning Text-to-Image Generative Models

Deep Unlearning: Fast and Efficient Gradient-free Approach to Class Forgetting

A More Practical Approach to Machine Unlearning

Boundary Unlearning: Rapid Forgetting of Deep Networks Via Shifting the Decision Boundary

Unlearning Graph Classifiers with Limited Data Resources

On the Limitations and Prospects of Machine Unlearning for Generative AI