Abstract:Vulnerabilities publicly disclosed in the National Vulnerability Database (NVD) are assigned with CVE (Common Vulnerabilities and Exposures) IDs and associated with specific software versions. Many organizations, including IT companies and government, heavily rely on the disclosed vulnerabilities in NVD to mitigate their security risks. Once a software is claimed as vulnerable by NVD, these organizations would examine the presence of the vulnerable versions of the software and assess the impact on themselves. However, the version information about vulnerable software in NVD is not always reliable. Nguyen et al. find that the version information of many CVE vulnerabilities is spurious and propose an approach based on the original SZZ algorithm (i.e., an approach to identify bug-introducing commits) to assess the software versions affected by CVE vulnerabilities. However, SZZ algorithms are designed for common bugs, while vulnerabilities and bugs are different. Many bugs are introduced by a recent bug-fixing commit, but vulnerabilities are usually introduced in their initial versions. Thus, the current SZZ algorithms often fail to identify the inducing commits for vulnerabilities. Therefore, in this study, we propose an approach based on an improved SZZ algorithm to refine software versions affected by CVE vulnerabilities. Our proposed SZZ algorithm leverages the line mapping algorithms to identify the earliest commit that modified the vulnerable lines, and then considers these commits to be the vulnerability-inducing commits, as opposed to the previous SZZ algorithms that assume the commits that last modified the buggy lines as the inducing commits. To evaluate our proposed approach, we manually annotate the true inducing commits and verify the vulnerable versions for 172 CVE vulnerabilities with fixing commits from two publicly available datasets with five C/C++ and 41 Java projects, respectively. We find that 99 out of 172 vulnerabilities whose version information is spurious. The experiment results show that our proposed approach can identify more vulnerabilities with the true inducing commits and correct vulnerable versions than the previous SZZ algorithms. Our approach outperforms the previous SZZ algorithms in terms of F1-score for identifying vulnerability-inducing commits on both C/C++ and Java projects (0.736 and 0.630, respectively). For refining vulnerable versions, our approach also achieves the best performance on the two datasets in terms of F1-score (0.928 and 0.952).

Is Bug Severity in Line with Bug Fixing Change Complexity?

An Empirical Study of Bugs in Build Process

Experience report: How do bug characteristics differ across severity classes: A multi-platform study

Bug Priority Change: An Empirical Study on Apache Projects

Towards characterizing bug fixes through dependency-level changes in Apache Java open source projects

Why is My Code Change Abandoned?

Analysis of Software Bug Reports Severity Feature

An Empirical Study of Bug Report Field Reassignment.

Revisiting Linus's Law: Benefits and Challenges of Open Source Software Peer Review.

How Does Bug-Handling Effort Differ Among Different Programming Languages?

Towards an Understanding of Change Types in Bug Fixing Code.

V-SZZ: Automatic Identification of Version Ranges Affected by CVE Vulnerabilities

An Empirical Study of Bug Fixing Rate.

How Does Bug-Handling Eort Dier Among Dierent Programming Languages?

An Empirical Investigation of Correlation between Code Complexity and Bugs

An Empirical Study on Bug Severity Estimation using Source Code Metrics and Static Analysis

An Empirical Analysis of Software Changes on Statement Entity in Java Open Source Projects

Exploring and Exploiting the Correlations Between Bug-Inducing and Bug-Fixing Commits

A Study of Bug Resolution Characteristics in Popular Programming Languages

Examining the Effects of Developer Familiarity on Bug Fixing

Stage-oriented Analysis on Factors Impacting Bug Fixing Time