Abstract:The discovery of "jailbreaks" to bypass safety filters of Large Language Models (LLMs) and harmful responses have encouraged the community to implement safety measures. One major safety measure is to proactively test the LLMs with jailbreaks prior to the release. Therefore, such testing will require a method that can generate jailbreaks massively and efficiently. In this paper, we follow a novel yet intuitive strategy to generate jailbreaks in the style of the human generation. We propose a role-playing system that assigns four different roles to the user LLMs to collaborate on new jailbreaks. Furthermore, we collect existing jailbreaks and split them into different independent characteristics using clustering frequency and semantic patterns sentence by sentence. We organize these characteristics into a knowledge graph, making them more accessible and easier to retrieve. Our system of different roles will leverage this knowledge graph to generate new jailbreaks, which have proved effective in inducing LLMs to generate unethical or guideline-violating responses. In addition, we also pioneer a setting in our system that will automatically follow the government-issued guidelines to generate jailbreaks to test whether LLMs follow the guidelines accordingly. We refer to our system as GUARD (Guideline Upholding through Adaptive Role-play Diagnostics). We have empirically validated the effectiveness of GUARD on three cutting-edge open-sourced LLMs (Vicuna-13B, LongChat-7B, and Llama-2-7B), as well as a widely-utilized commercial LLM (ChatGPT). Moreover, our work extends to the realm of vision language models (MiniGPT-v2 and Gemini Vision Pro), showcasing GUARD's versatility and contributing valuable insights for the development of safer, more reliable LLM-based applications across diverse modalities.

SmartGSN: a generative AI-powered online tool for the management of assurance cases

A Methodology for Automating Assurance Case Generation

Automating Semantic Analysis of System Assurance Cases using Goal-directed ASP

GPT-4 and Safety Case Generation: An Exploratory Analysis

Automatic Instantiation of Assurance Cases from Patterns Using Large Language Models

AEGIS: Online Adaptive AI Content Safety Moderation with Ensemble of LLM Experts

N-Version Assessment and Enhancement of Generative AI

Automated Model-Based Assurance Case Management Using Constrained Natural Language

Automatic Support of the Generation and Maintenance of Assurance Cases.

Ergo, SMIRK is safe: a safety case for a machine learning component in a pedestrian automatic emergency brake system

ACCESS: Assurance Case Centric Engineering of Safety-critical Systems

Morescient GAI for Software Engineering (Extended Version)

Integration of Formal Proof into Unified Assurance Cases with Isabelle/SACM

Concept-Guided LLM Agents for Human-AI Safety Codesign

Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems

Sociotechnical Safety Evaluation of Generative AI Systems

GUARD: Role-playing to Generate Natural-language Jailbreakings to Test Guideline Adherence of Large Language Models

I came, I saw, I certified: some perspectives on the safety assurance of cyber-physical systems

CFSafety: Comprehensive Fine-grained Safety Assessment for LLMs

A Safe Harbor for AI Evaluation and Red Teaming