Abstract:Powered by remarkable advancements in Large Language Models (LLMs), Multimodal Large Language Models (MLLMs) demonstrate impressive capabilities in manifold tasks. However, the practical application scenarios of MLLMs are intricate, exposing them to potential malicious instructions and thereby posing safety risks. While current benchmarks do incorporate certain safety considerations, they often lack comprehensive coverage and fail to exhibit the necessary rigor and robustness. For instance, the common practice of employing GPT-4V as both the evaluator and a model to be evaluated lacks credibility, as it tends to exhibit a bias toward its own responses. In this paper, we present MLLMGuard, a multidimensional safety evaluation suite for MLLMs, including a bilingual image-text evaluation dataset, inference utilities, and a lightweight evaluator. MLLMGuard's assessment comprehensively covers two languages (English and Chinese) and five important safety dimensions (Privacy, Bias, Toxicity, Truthfulness, and Legality), each with corresponding rich subtasks. Focusing on these dimensions, our evaluation dataset is primarily sourced from platforms such as social media, and it integrates text-based and image-based red teaming techniques with meticulous annotation by human experts. This can prevent inaccurate evaluation caused by data leakage when using open-source datasets and ensures the quality and challenging nature of our benchmark. Additionally, a fully automated lightweight evaluator termed GuardRank is developed, which achieves significantly higher evaluation accuracy than GPT-4. Our evaluation results across 13 advanced models indicate that MLLMs still have a substantial journey ahead before they can be considered safe and responsible.

Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models

Query-Relevant Images Jailbreak Large Multi-Modal Models

Adversarial Attacks on Large Language Models in Medicine

MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Models

Heuristic-Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models

MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance

Can LLMs be Fooled? Investigating Vulnerabilities in LLMs

Safety of Multimodal Large Language Models on Images and Texts

Jailbreaking and Mitigation of Vulnerabilities in Large Language Models

JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attacks

Safety of Multimodal Large Language Models on Images and Text.

Jailbreak Large Vision-Language Models Through Multi-Modal Linkage

Immune: Improving Safety Against Jailbreaks in Multi-modal LLMs via Inference-Time Alignment

Seeing is Deceiving: Exploitation of Visual Pathways in Multi-Modal Language Models

Exposing Vulnerabilities in Clinical LLMs Through Data Poisoning Attacks: Case Study in Breast Cancer

Exploring Visual Vulnerabilities via Multi-Loss Adversarial Search for Jailbreaking Vision-Language Models

$\textit{MMJ-Bench}$: A Comprehensive Study on Jailbreak Attacks and Defenses for Multimodal Large Language Models

Modular Learning Component Attacks: Today's Reality, Tomorrow's Challenge

MLLMGuard: A Multi-dimensional Safety Evaluation Suite for Multimodal Large Language Models

Unbridled Icarus: A Survey of the Potential Perils of Image Inputs in Multimodal Large Language Model Security

Model-Editing-Based Jailbreak against Safety-aligned Large Language Models