ALERT: A Comprehensive Benchmark for Assessing Large Language Models' Safety through Red Teaming

Simone Tedeschi,Felix Friedrich,Patrick Schramowski,Kristian Kersting,Roberto Navigli,Huu Nguyen,Bo Li

2024-06-24

Abstract:When building Large Language Models (LLMs), it is paramount to bear safety in mind and protect them with guardrails. Indeed, LLMs should never generate content promoting or normalizing harmful, illegal, or unethical behavior that may contribute to harm to individuals or society. This principle applies to both normal and adversarial use. In response, we introduce ALERT, a large-scale benchmark to assess safety based on a novel fine-grained risk taxonomy. It is designed to evaluate the safety of LLMs through red teaming methodologies and consists of more than 45k instructions categorized using our novel taxonomy. By subjecting LLMs to adversarial testing scenarios, ALERT aims to identify vulnerabilities, inform improvements, and enhance the overall safety of the language models. Furthermore, the fine-grained taxonomy enables researchers to perform an in-depth evaluation that also helps one to assess the alignment with various policies. In our experiments, we extensively evaluate 10 popular open- and closed-source LLMs and demonstrate that many of them still struggle to attain reasonable levels of safety.

Computation and Language,Computers and Society,Machine Learning

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve

The paper aims to address the security issues of large language models (LLMs). Specifically, it proposes a comprehensive benchmarking framework named ALERT to evaluate the security of LLMs when subjected to Red Teaming tests. Red Teaming is a method of simulating adversarial attacks to identify potential vulnerabilities in the model, thereby guiding improvements and enhancing the overall security of the model.

### Main Contributions

1. **New Security Risk Taxonomy**: The paper designs a new security risk taxonomy, including 6 macro categories and 32 micro categories, providing a detailed theoretical foundation for conducting Red Teaming tests and developing policy-compliant models.
2. **ALERT Benchmarking**: The paper introduces a novel benchmark comprising over 45,000 Red Teaming prompts and an automated method to evaluate the security of LLMs, forming the ALERT framework.
3. **Extensive Experimental Evaluation**: The paper conducts extensive evaluations on 10 open-source and closed-source LLMs, revealing their weaknesses and strengths across different security risk dimensions.
4. **Construction of DPO Dataset**: The paper constructs a large-scale DPO (Data Point Optimization) triplet dataset by generating responses, to facilitate further research in security fine-tuning.

### Why This Problem Needs to Be Addressed

As large language models are increasingly applied in daily life, ensuring their security and ethical compliance becomes critically important. However, existing research typically focuses on specific aspects of security, such as toxicity or bias, lacking a comprehensive evaluation of all subcategories. Therefore, the introduction of the ALERT benchmark aims to fill this gap by providing a fine-grained risk taxonomy and large-scale Red Teaming tests to comprehensively evaluate and enhance the security of LLMs.