Abstract:We explore a knowledge sanitization approach to mitigate the privacy concerns associated with large language models (LLMs). LLMs trained on a large corpus of Web data can memorize and potentially reveal sensitive or confidential information, raising critical security concerns. Our technique efficiently fine-tunes these models using the Low-Rank Adaptation (LoRA) method, prompting them to generate harmless responses such as ``I don't know'' when queried about specific information. Experimental results in a closed-book question-answering task show that our straightforward method not only minimizes particular knowledge leakage but also preserves the overall performance of LLMs. These two advantages strengthen the defense against extraction attacks and reduces the emission of harmful content such as hallucinations.

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? This paper aims to address the issue of large language models (LLMs) potentially leaking personal and sensitive information during training. Specifically, the paper proposes a knowledge purification method that effectively adjusts these models to generate harmless responses, such as "I don't know," when asked for specific information. This method not only reduces the leakage of specific knowledge but also maintains the overall performance of the model. #### Main Objectives: 1. **Prevent Privacy Leakage**: Avoid the model leaking personal or confidential information when answering questions. 2. **Ensure Harmless Generation**: Ensure the model generates harmless responses when faced with specific information queries. 3. **Maintain Overall Performance**: Maintain the model's performance in other aspects while performing purification. #### Method Overview: - Use Low-Rank Adaptation (LoRA) to fine-tune the pre-trained model. - Guide the model to generate predefined safe phrases (e.g., "I don't know") when queried for specific knowledge. - Validate the purified model's performance in closed-book question-answering tasks through experiments and assess its robustness against extraction attacks. #### Experimental Results: - The knowledge purification method excels in preventing the leakage of specific information while maintaining high accuracy for other non-target information. - The purified model's performance in common-sense reasoning and reading comprehension tasks is comparable to the original model, indicating that its performance in non-generative tasks is unaffected. Through this method, the paper demonstrates how to effectively address privacy leakage issues while maintaining the overall performance of the model.

Knowledge Sanitization of Large Language Models

Precision Knowledge Editing: Enhancing Safety in Large Language Models

Towards Safer Large Language Models through Machine Unlearning

Large Scale Knowledge Washing

Learn to Refuse: Making Large Language Models More Controllable and Reliable through Knowledge Scope Limitation and Refusal Mechanism

Knowledge Boundary of Large Language Models: A Survey

Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful Knowledge

How Much are Large Language Models Contaminated? A Comprehensive Survey and the LLMSanitize Library

On the Risk of Misinformation Pollution with Large Language Models

To Forget or Not? Towards Practical Knowledge Unlearning for Large Language Models

Machine Unlearning in Large Language Models

Towards Robust and Cost-Efficient Knowledge Unlearning for Large Language Models

Large Language Models Can Be Good Privacy Protection Learners

Preserving Privacy in Large Language Models: A Survey on Current Threats and Solutions

Security and Privacy Challenges of Large Language Models: A Survey

Can LLMs be Fooled? Investigating Vulnerabilities in LLMs

Robustifying Safety-Aligned Large Language Models through Clean Data Curation

Are LLMs Really Not Knowledgable? Mining the Submerged Knowledge in LLMs' Memory

Making Harmful Behaviors Unlearnable for Large Language Models