Abstract:With the increasing number of software projects, within-project defect prediction (WPDP) has already been unable to meet the demand, and cross-project defect prediction (CPDP) is playing an increasingly significant role in the area of software engineering. The classic CPDP methods mainly concentrated on applying metric features to predict defects. However, these approaches failed to consider the rich semantic information, which usually contains the relationship between software defects and context. Since traditional methods are unable to exploit this characteristic, their performance is often unsatisfactory. In this paper, a transfer long short-term memory (TLSTM) network model is first proposed. Transfer semantic features are extracted by adding a transfer learning algorithm to the long short-term memory (LSTM) network. Then, the traditional metric features and semantic features are combined for CPDP. First, the abstract syntax trees (AST) are generated based on the source codes. Second, the AST node contents are converted into integer vectors as inputs to the TLSTM model. Then, the semantic features of the program can be extracted by TLSTM. On the other hand, transferable metric features are extracted by transfer component analysis (TCA). Finally, the semantic features and metric features are combined and input into the logical regression (LR) classifier for training. The presented TLSTM model performs better on the f-measure indicator than other machine and deep learning models, according to the outcomes of several open-source projects of the PROMISE repository. The TLSTM model built with a single feature achieves 0.7% and 2.1% improvement on Log4j-1.2 and Xalan-2.7, respectively. When using combined features to train the prediction model, we call this model a transfer long short-term memory for defect prediction (DPTLSTM). DPTLSTM achieves a 2.9% and 5% improvement on Synapse-1.2 and Xerces-1.4.4, respectively. Both prove the superiority of the proposed model on the CPDP task. This is because LSTM capture long-term dependencies in sequence data and extract features that contain source code structure and context information. It can be concluded that: (1) the TLSTM model has the advantage of preserving information, which can better retain the semantic features related to software defects; (2) compared with the CPDP model trained with traditional metric features, the performance of the model can validly enhance by combining semantic features and metric features.

Software Defect Prediction via Transformer

Statement-Level Software Defect Prediction Based on Improved R-Transformer.

Cross-Project Defect Prediction Using Transfer Learning with Long Short-Term Memory Networks

Deep Semantic Feature Learning with Embedded Static Metrics for Software Defect Prediction

A Static Detection Method for Code Defects Based on Transformer

Fine-Grained Software Defect Prediction Based on the Method-Call Sequence

Use of Deep Learning Model with Attention Mechanism for Software Fault Prediction

Software Defect Prediction via Attention-Based Recurrent Neural Network

Software defect prediction employing BiLSTM and BERT-based semantic feature

Deep Learning for Just-In-Time Defect Prediction

SDP-MTF: A Composite Transfer Learning and Feature Fusion for Cross-Project Software Defect Prediction

Software Defect Prediction Based on Deep Representation Learning of Source Code From Contextual Syntax and Semantic Graph

An Approach to Semantic and Structural Features Learning for Software Defect Prediction

Software visualization and deep transfer learning for effective software defect prediction

Deep Semantic Feature Learning for Software Defect Prediction

Combined Classifier for Cross-Project Defect Prediction: an Extended Empirical Study.

Deep Learning-Based Software Defect Prediction via Semantic Key Features of Source Code—Systematic Survey

A Software Defect Prediction Method Based on Program Semantic Feature Mining

Defect-aware transformer network for intelligent visual surface defect detection

Predicting Line-Level Defects by Capturing Code Contexts with Hierarchical Transformers

Line-Level Defect Prediction by Capturing Code Contexts with Graph Convolutional Networks