Abstract:While automated vulnerability detection techniques have made promising progress in detecting security vulnerabilities, their scalability and applicability remain challenging. The remarkable performance of Large Language Models (LLMs), such as GPT-4 and CodeLlama, on code-related tasks has prompted recent works to explore if LLMs can be used to detect vulnerabilities. In this paper, we perform a more comprehensive study by concurrently examining a higher number of datasets, languages and LLMs, and qualitatively evaluating performance across prompts and vulnerability classes while addressing the shortcomings of existing tools. Concretely, we evaluate the effectiveness of 16 pre-trained LLMs on 5,000 code samples from five diverse security datasets. These balanced datasets encompass both synthetic and real-world projects in Java and C/C++ and cover 25 distinct vulnerability classes. Overall, LLMs across all scales and families show modest effectiveness in detecting vulnerabilities, obtaining an average accuracy of 62.8% and F1 score of 0.71 across datasets. They are significantly better at detecting vulnerabilities only requiring intra-procedural analysis, such as OS Command Injection and NULL Pointer Dereference. Moreover, they report higher accuracies on these vulnerabilities than popular static analysis tools, such as CodeQL. We find that advanced prompting strategies that involve step-by-step analysis significantly improve performance of LLMs on real-world datasets in terms of F1 score (by upto 0.18 on average). Interestingly, we observe that LLMs show promising abilities at performing parts of the analysis correctly, such as identifying vulnerability-related specifications and leveraging natural language information to understand code behavior (e.g., to check if code is sanitized). We expect our insights to guide future work on LLM-augmented vulnerability detection systems.

Outside the Comfort Zone: Analysing LLM Capabilities in Software Vulnerability Detection

Harnessing Large Language Models for Software Vulnerability Detection: A Comprehensive Benchmarking Study

How Far Have We Gone in Vulnerability Detection Using Large Language Models

VulDetectBench: Evaluating the Deep Capability of Vulnerability Detection with Large Language Models

Understanding the Effectiveness of Large Language Models in Detecting Security Vulnerabilities

Multitask-based Evaluation of Open-Source LLM on Software Vulnerability

VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patching

Harnessing the Power of LLMs in Source Code Vulnerability Detection

Towards Effectively Detecting and Explaining Vulnerabilities Using Large Language Models

LLbezpeky: Leveraging Large Language Models for Vulnerability Detection

Software Vulnerability and Functionality Assessment using LLMs

A Comprehensive Study of the Capabilities of Large Language Models for Vulnerability Detection

Investigating Large Language Models for Code Vulnerability Detection: An Experimental Study

An Empirical Study of Automated Vulnerability Localization with Large Language Models

Comparison of Static Application Security Testing Tools and Large Language Models for Repo-level Vulnerability Detection

Vulnerability Detection with Code Language Models: How Far Are We?

Automated software vulnerability detection with machine learning

Assessing the Effectiveness of LLMs in Android Application Vulnerability Analysis

Large Language Models for Secure Code Assessment: A Multi-Language Empirical Study

Large Language Model for Vulnerability Detection and Repair: Literature Review and the Road Ahead