Abstract:Large Language Models have seen rapid progress in capability in recent years; this progress has been accelerating and their capabilities, measured by various benchmarks, are beginning to approach those of humans. There is a strong demand to use such models in a wide variety of applications but, due to unresolved vulnerabilities and limitations, great care needs to be used before applying them to intelligence and safety-critical applications. This paper reviews recent literature related to LLM assessment and vulnerabilities to synthesize the current research landscape and to help understand what advances are most critical to enable use of of these technologies in intelligence and safety-critical applications. The vulnerabilities are broken down into ten high-level categories and overlaid onto a high-level life cycle of an LLM. Some general categories of mitigations are reviewed.

What problem does this paper attempt to address?

The paper primarily explores multimodal knowledge extraction and analysis in intelligent and security-critical applications using Large Language Models (LLMs). Specifically, the paper aims to address the following core issues: 1. **Evaluation and Vulnerabilities**: Although the capabilities of current LLMs have significantly improved, there are various unresolved vulnerabilities and limitations when deploying them in intelligent and security-critical applications. The paper reviews recent research literature on LLMs' evaluation and vulnerabilities to comprehensively understand the current state of the research field and determine which advancements are crucial for enabling these technologies to be used in intelligent and security-critical applications. 2. **Vulnerability Classification**: The paper categorizes the vulnerabilities of LLMs into ten high-level categories and maps them to different stages of the LLMs' lifecycle. These categories include, but are not limited to, alignment, reliability, security and privacy, fairness, social norms, cybersecurity-related issues, misuse, robustness, interpretability, and supply chain, among others. 3. **Mitigation Strategies**: The paper also discusses general categories of mitigation measures, such as uncertainty quantification methods, alignment strategies, and process and governance structures, to reduce or eliminate these vulnerabilities. 4. **State of Research**: Despite many issues being raised, there are relatively few solutions to these problems, indicating that the research community is still in an exploratory phase. The paper highlights some emerging methods that are rapidly developing and anticipates that this field will continue to change quickly. 5. **Future Directions**: Finally, the paper emphasizes that while the capabilities of current LLMs have significantly improved, the fundamental limitations make it very difficult to completely eliminate all potential risks. Therefore, the paper calls for further research work to understand and mitigate these challenges. In summary, the paper's goal is to guide future research and development by identifying and analyzing the main vulnerabilities of LLMs and their impact on intelligent and security-critical applications.

LLMs for Multi-Modal Knowledge Extraction and Analysis in Intelligence/Safety-Critical Applications

Exploring Advanced Methodologies in Security Evaluation for LLMs

Can LLMs be Fooled? Investigating Vulnerabilities in LLMs

Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilities

Emerging Security Challenges of Large Language Models

Exploring Vulnerabilities and Threats in Large Language Models: Safeguarding Against Exploitation and Misuse

LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarks

Large Language Model Safety: A Holistic Survey

A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly

Large Language Models for Cyber Security: A Systematic Literature Review

Threat Modelling and Risk Analysis for Large Language Model (LLM)-Powered Applications

Securing Large Language Models: Threats, Vulnerabilities and Responsible Practices

Current state of LLM Risks and AI Guardrails

LLMs for Cyber Security: New Opportunities

The Ethics of Interaction: Mitigating Security Threats in LLMs

Jailbreaking and Mitigation of Vulnerabilities in Large Language Models

Risk Assessment of Large Language Models Beyond Apocalyptic Visions

Large Language Models in Cybersecurity: State-of-the-Art

Guardrails for trust, safety, and ethical development and deployment of Large Language Models (LLM)