Abstract:Vulnerabilities publicly disclosed in the National Vulnerability Database (NVD) are assigned with CVE (Common Vulnerabilities and Exposures) IDs and associated with specific software versions. Many organizations, including IT companies and government, heavily rely on the disclosed vulnerabilities in NVD to mitigate their security risks. Once a software is claimed as vulnerable by NVD, these organizations would examine the presence of the vulnerable versions of the software and assess the impact on themselves. However, the version information about vulnerable software in NVD is not always reliable. Nguyen et al. find that the version information of many CVE vulnerabilities is spurious and propose an approach based on the original SZZ algorithm (i.e., an approach to identify bug-introducing commits) to assess the software versions affected by CVE vulnerabilities. However, SZZ algorithms are designed for common bugs, while vulnerabilities and bugs are different. Many bugs are introduced by a recent bug-fixing commit, but vulnerabilities are usually introduced in their initial versions. Thus, the current SZZ algorithms often fail to identify the inducing commits for vulnerabilities. Therefore, in this study, we propose an approach based on an improved SZZ algorithm to refine software versions affected by CVE vulnerabilities. Our proposed SZZ algorithm leverages the line mapping algorithms to identify the earliest commit that modified the vulnerable lines, and then considers these commits to be the vulnerability-inducing commits, as opposed to the previous SZZ algorithms that assume the commits that last modified the buggy lines as the inducing commits. To evaluate our proposed approach, we manually annotate the true inducing commits and verify the vulnerable versions for 172 CVE vulnerabilities with fixing commits from two publicly available datasets with five C/C++ and 41 Java projects, respectively. We find that 99 out of 172 vulnerabilities whose version information is spurious. The experiment results show that our proposed approach can identify more vulnerabilities with the true inducing commits and correct vulnerable versions than the previous SZZ algorithms. Our approach outperforms the previous SZZ algorithms in terms of F1-score for identifying vulnerability-inducing commits on both C/C++ and Java projects (0.736 and 0.630, respectively). For refining vulnerable versions, our approach also achieves the best performance on the two datasets in terms of F1-score (0.928 and 0.952).

Impact of Consecutive Changes on Later File Versions

Why is My Code Change Abandoned?

Initial and Eventual Software Quality Relating to Continuous Integration in GitHub

V-SZZ: Automatic Identification of Version Ranges Affected by CVE Vulnerabilities

An Empirical Study of Bugs in Build Process

Broken Windows: Exploring the Applicability of a Controversial Theory on Code Quality

Understanding Evolutionary Coupling by Fine-Grained Co-Change Relationship Analysis

Which Process Metrics Are Significantly Important to Change of Defects in Evolving Projects: an Empirical Study.

Evaluating Software Contribution Quality: Time-to-Modification Theory

An Empirical Study of the Impact of Code Smell on File Changes

What really changes when developers intend to improve their source code: a commit-level study of static metric value and static analysis warning changes

Watch out for This Commit! A Study of Influential Software Changes

An empirical study of software change: origin, acceptance rate, and functionality vs. quality attributes

Quality and productivity outcomes relating to continuous integration in GitHub

U Owns the Code That Changes and How Marginal Owners Resolve Issues Slower in Low-Quality Source Code

Identifying change patterns in software history

Understanding Code Change with Micro-Changes

Scalable Isolation of Failure-Inducing Changes Via Version Comparison.

Towards an Understanding of Change Types in Bug Fixing Code.

The Co-Evolution of Test Maintenance and Code Maintenance through the lens of Fine-Grained Semantic Changes

A longitudinal study on the temporal validity of software samples