Abstract:Despite the general capabilities of Large Language Models (LLM), these models still request fine-tuning or adaptation with customized data when meeting specific business demands. However, this process inevitably introduces new threats, particularly against the Fine-tuning based Jailbreak Attack (FJAttack) under the setting of Language-Model-as-a-Service (LMaaS), where the model's safety has been significantly compromised by fine-tuning users' uploaded examples contain just a few harmful examples. Though potential defenses have been proposed that the service providers can integrate safety examples into the fine-tuning dataset to reduce safety issues, such approaches require incorporating a substantial amount of data, making it inefficient. To effectively defend against the FJAttack with limited safety examples under LMaaS, we propose the Backdoor Enhanced Safety Alignment method inspired by an analogy with the concept of backdoor attacks. In particular, service providers will construct prefixed safety examples with a secret prompt, acting as a "backdoor trigger". By integrating prefixed safety examples into the fine-tuning dataset, the subsequent fine-tuning process effectively acts as the "backdoor attack", establishing a strong correlation between the secret prompt and safety generations. Consequently, safe responses are ensured once service providers prepend this secret prompt ahead of any user input during inference. Our comprehensive experiments demonstrate that through the Backdoor Enhanced Safety Alignment with adding as few as 11 prefixed safety examples, the maliciously fine-tuned LLMs will achieve similar safety performance as the original aligned models without harming the benign performance. Furthermore, we also present the effectiveness of our method in a more practical setting where the fine-tuning data consists of both FJAttack examples and the fine-tuning task data.

Enhancing the security of edge-AI runtime environments: a fine-tuning method based on large language models

Fine-Tuning and Deploying Large Language Models Over Edges: Issues and Approaches

Enhancing TinyML-Based Container Escape Detectors With Systemcall Semantic Association in UAVs Networks

Large Language Models can be Guided to Evade AI-Generated Text Detection

Multilingual Jailbreak Challenges in Large Language Models

An Exploratory Study on Fine-Tuning Large Language Models for Secure Code Generation

An Empirical Analysis and Resource Footprint Study of Deploying Large Language Models on Edge Devices

Jailbreak Antidote: Runtime Safety-Utility Balance via Sparse Representation Adjustment in Large Language Models

CoreGuard: Safeguarding Foundational Capabilities of LLMs Against Model Stealing in Edge Deployment

Prefix Guidance: A Steering Wheel for Large Language Models to Defend Against Jailbreak Attacks

Mitigating Fine-tuning based Jailbreak Attack with Backdoor Enhanced Safety Alignment

A Container Escape Detection Method Based on a Dependency Graph

Diversity Helps Jailbreak Large Language Models

Edge Intelligence Optimization for Large Language Model Inference with Batching and Quantization

Fine-Tuning, Quantization, and LLMs: Navigating Unintended Outcomes

Cloud-Edge Collaborative Large Model Services: Challenges and Solutions

Multi-Model Running Latency Optimization in an Edge Computing Paradigm

Towards Secure Tuning: Mitigating Security Risks Arising from Benign Instruction Fine-Tuning

SafeAligner: Safety Alignment against Jailbreak Attacks via Response Disparity Guidance

Improved Techniques for Optimization-Based Jailbreaking on Large Language Models

PathSeeker: Exploring LLM Security Vulnerabilities with a Reinforcement Learning-Based Jailbreak Approach