Abstract:The rapid advancement of Large Language Models (LLMs) has opened up new opportunities for leveraging artificial intelligence in various domains, including cybersecurity. As the volume and sophistication of cyber threats continue to grow, there is an increasing need for intelligent systems that can automatically detect vulnerabilities, analyze malware, and respond to attacks. In this survey, we conduct a comprehensive review of the literature on the application of LLMs in cybersecurity (LLM4Security). By comprehensively collecting over 30K relevant papers and systematically analyzing 127 papers from top security and software engineering venues, we aim to provide a holistic view of how LLMs are being used to solve diverse problems across the cybersecurity domain. Through our analysis, we identify several key findings. First, we observe that LLMs are being applied to a wide range of cybersecurity tasks, including vulnerability detection, malware analysis, network intrusion detection, and phishing detection. Second, we find that the datasets used for training and evaluating LLMs in these tasks are often limited in size and diversity, highlighting the need for more comprehensive and representative datasets. Third, we identify several promising techniques for adapting LLMs to specific cybersecurity domains, such as fine-tuning, transfer learning, and domain-specific pre-training. Finally, we discuss the main challenges and opportunities for future research in LLM4Security, including the need for more interpretable and explainable models, the importance of addressing data privacy and security concerns, and the potential for leveraging LLMs for proactive defense and threat hunting. Overall, our survey provides a comprehensive overview of the current state-of-the-art in LLM4Security and identifies several promising directions for future research.

A Domain-Adaptive Large Language Model with Refinement Framework for IoT Cybersecurity

Large Language Models for Cyber Security: A Systematic Literature Review

Large Language Models in Cybersecurity: State-of-the-Art

IoT-LLM: Enhancing Real-World IoT Task Reasoning with Large Language Models

An Adaptive End-to-End IoT Security Framework Using Explainable AI and LLMs

Recent Advances in Attack and Defense Approaches of Large Language Models

Exploring Advanced Methodologies in Security Evaluation for LLMs

SECURE: Benchmarking Large Language Models for Cybersecurity

SEvenLLM: Benchmarking, Eliciting, and Enhancing Abilities of Large Language Models in Cyber Threat Intelligence

AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacks

Large Language Model Supply Chain: Open Problems From the Security Perspective

Unique Security and Privacy Threats of Large Language Model: A Comprehensive Survey

CS-Eval: A Comprehensive Large Language Model Benchmark for CyberSecurity

DrLLM: Prompt-Enhanced Distributed Denial-of-Service Resistance Method with Large Language Models

Fortifying Ethical Boundaries in AI: Advanced Strategies for Enhancing Security in Large Language Models

A Survey of Large Language Models in Cybersecurity

A Superalignment Framework in Autonomous Driving with Large Language Models

When IoT Meet LLMs: Applications and Challenges

Beyond Detection: Leveraging Large Language Models for Cyber Attack Prediction in IoT Networks

CyberSecEval 2: A Wide-Ranging Cybersecurity Evaluation Suite for Large Language Models