Abstract:The rapid advancement of Large Language Models (LLMs) has opened up new opportunities for leveraging artificial intelligence in various domains, including cybersecurity. As the volume and sophistication of cyber threats continue to grow, there is an increasing need for intelligent systems that can automatically detect vulnerabilities, analyze malware, and respond to attacks. In this survey, we conduct a comprehensive review of the literature on the application of LLMs in cybersecurity (LLM4Security). By comprehensively collecting over 30K relevant papers and systematically analyzing 127 papers from top security and software engineering venues, we aim to provide a holistic view of how LLMs are being used to solve diverse problems across the cybersecurity domain. Through our analysis, we identify several key findings. First, we observe that LLMs are being applied to a wide range of cybersecurity tasks, including vulnerability detection, malware analysis, network intrusion detection, and phishing detection. Second, we find that the datasets used for training and evaluating LLMs in these tasks are often limited in size and diversity, highlighting the need for more comprehensive and representative datasets. Third, we identify several promising techniques for adapting LLMs to specific cybersecurity domains, such as fine-tuning, transfer learning, and domain-specific pre-training. Finally, we discuss the main challenges and opportunities for future research in LLM4Security, including the need for more interpretable and explainable models, the importance of addressing data privacy and security concerns, and the potential for leveraging LLMs for proactive defense and threat hunting. Overall, our survey provides a comprehensive overview of the current state-of-the-art in LLM4Security and identifies several promising directions for future research.

Toward Intelligent and Secure Cloud: Large Language Model Empowered Proactive Defense

EI-MTD: Moving Target Defense for Edge Intelligence Against Adversarial Attacks

Recent Advances in Attack and Defense Approaches of Large Language Models

The Best Defense is a Good Offense: Countering LLM-Powered Cyberattacks

Large Language Models in Cybersecurity: State-of-the-Art

Large language models in 6G security: challenges and opportunities

AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacks

CoreGuard: Safeguarding Foundational Capabilities of LLMs Against Model Stealing in Edge Deployment

Generative AI and Large Language Models for Cyber Security: All Insights You Need

A Comprehensive Overview of Large Language Models (LLMs) for Cyber Defences: Opportunities and Directions

Defending Large Language Models Against Attacks With Residual Stream Activation Analysis

Prefix Guidance: A Steering Wheel for Large Language Models to Defend Against Jailbreak Attacks

Privacy in Large Language Models: Attacks, Defenses and Future Directions

A Comprehensive Survey of Attack Techniques, Implementation, and Mitigation Strategies in Large Language Models

Guide for Defense (G4D): Dynamic Guidance for Robust and Balanced Defense in Large Language Models

Attacking and Defending Machine Learning Applications of Public Cloud

Large Language Models for Cyber Security: A Systematic Literature Review

DrLLM: Prompt-Enhanced Distributed Denial-of-Service Resistance Method with Large Language Models

Robustness Evaluation of Cloud-Deployed Large Language Models Against Chinese Adversarial Text Attacks

ShieldGPT: an LLM-based Framework for DDoS Mitigation