Abstract:Large Language Models are trained on extensive datasets that often contain sensitive, human-generated information, raising significant concerns about privacy breaches. While certified unlearning approaches offer strong privacy guarantees, they rely on restrictive model assumptions that are not applicable to LLMs. As a result, various unlearning heuristics have been proposed, with the associated privacy risks assessed only empirically. The standard evaluation pipelines typically randomly select data for removal from the training set, apply unlearning techniques, and use membership inference attacks to compare the unlearned models against models retrained without the to-be-unlearned data. However, since every data point is subject to the right to be forgotten, unlearning should be considered in the worst-case scenario from the privacy perspective. Prior work shows that data outliers may exhibit higher memorization effects. Intuitively, they are harder to be unlearn and thus the privacy risk of unlearning them is underestimated in the current evaluation. In this paper, we leverage minority data to identify such a critical flaw in previously widely adopted evaluations. We substantiate this claim through carefully designed experiments, including unlearning canaries related to minority groups, inspired by privacy auditing literature. Using personally identifiable information as a representative minority identifier, we demonstrate that minority groups experience at least 20% more privacy leakage in most cases across six unlearning approaches, three MIAs, three benchmark datasets, and two LLMs of different scales. Given that the right to be forgotten should be upheld for every individual, we advocate for a more rigorous evaluation of LLM unlearning methods. Our minority-aware evaluation framework represents an initial step toward ensuring more equitable assessments of LLM unlearning efficacy.

Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity Dataset

Towards Machine Unlearning Benchmarks: Forgetting the Personal Identities in Facial Recognition Systems

Vertical Federated Unlearning via Backdoor Certification

Single Image Unlearning: Efficient Machine Unlearning in Multimodal Large Language Models

LLM Unlearning via Loss Adjustment with Only Forget Data

Underestimated Privacy Risks for Minority Populations in Large Language Model Unlearning

TOFU: A Task of Fictitious Unlearning for LLMs

Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench

Boundary Unlearning

Gone but Not Forgotten: Improved Benchmarks for Machine Unlearning

Unlearn What You Want to Forget: Efficient Unlearning for LLMs

A Closer Look at Machine Unlearning for Large Language Models

Vertical Federated Unlearning on the Logistic Regression Model

The Phantom Menace: Unmasking Privacy Leakages in Vision-Language Models

VeriFi: Towards Verifiable Federated Unlearning.

One-Shot Unlearning of Personal Identities

Boundary Unlearning: Rapid Forgetting of Deep Networks Via Shifting the Decision Boundary

Learn while Unlearn: An Iterative Unlearning Framework for Generative Language Models

RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models

A Duty to Forget, a Right to Be Assured? Exposing Vulnerabilities in Machine Unlearning Services

Position: LLM Unlearning Benchmarks are Weak Measures of Progress