Abstract:With the increasing number of software projects, within-project defect prediction (WPDP) has already been unable to meet the demand, and cross-project defect prediction (CPDP) is playing an increasingly significant role in the area of software engineering. The classic CPDP methods mainly concentrated on applying metric features to predict defects. However, these approaches failed to consider the rich semantic information, which usually contains the relationship between software defects and context. Since traditional methods are unable to exploit this characteristic, their performance is often unsatisfactory. In this paper, a transfer long short-term memory (TLSTM) network model is first proposed. Transfer semantic features are extracted by adding a transfer learning algorithm to the long short-term memory (LSTM) network. Then, the traditional metric features and semantic features are combined for CPDP. First, the abstract syntax trees (AST) are generated based on the source codes. Second, the AST node contents are converted into integer vectors as inputs to the TLSTM model. Then, the semantic features of the program can be extracted by TLSTM. On the other hand, transferable metric features are extracted by transfer component analysis (TCA). Finally, the semantic features and metric features are combined and input into the logical regression (LR) classifier for training. The presented TLSTM model performs better on the f-measure indicator than other machine and deep learning models, according to the outcomes of several open-source projects of the PROMISE repository. The TLSTM model built with a single feature achieves 0.7% and 2.1% improvement on Log4j-1.2 and Xalan-2.7, respectively. When using combined features to train the prediction model, we call this model a transfer long short-term memory for defect prediction (DPTLSTM). DPTLSTM achieves a 2.9% and 5% improvement on Synapse-1.2 and Xerces-1.4.4, respectively. Both prove the superiority of the proposed model on the CPDP task. This is because LSTM capture long-term dependencies in sequence data and extract features that contain source code structure and context information. It can be concluded that: (1) the TLSTM model has the advantage of preserving information, which can better retain the semantic features related to software defects; (2) compared with the CPDP model trained with traditional metric features, the performance of the model can validly enhance by combining semantic features and metric features.

Seml: A Semantic LSTM Model for Software Defect Prediction

Unifying Defect Prediction, Categorization, and Repair by Multi-Task Deep Learning

Deep Semantic Feature Learning for Software Defect Prediction

Software defect prediction employing BiLSTM and BERT-based semantic feature

Semantic and traditional feature fusion for software defect prediction using hybrid deep learning model

An Approach to Semantic and Structural Features Learning for Software Defect Prediction

Deep Semantic Feature Learning with Embedded Static Metrics for Software Defect Prediction

Semantic Feature Learning via Dual Sequences for Defect Prediction

Software Defect Prediction Based on Deep Representation Learning of Source Code From Contextual Syntax and Semantic Graph

A Software Defect Prediction Method Based on Program Semantic Feature Mining

Deep Learning-Based Software Defect Prediction via Semantic Key Features of Source Code—Systematic Survey

A Cross-Project Defect Prediction Model Based on Deep Learning With Self-Attention

Defect Prediction With Semantics and Context Features of Codes Based on Graph Representation Learning

Use of Deep Learning Model with Attention Mechanism for Software Fault Prediction

Deep Learning for Software Defect Prediction: An LSTM-based Approach

A novel defect prediction method based on semantic feature enhancement

Software Defect Prediction and Localization with Attention-Based Models and Ensemble Learning

Cross-Project Defect Prediction Using Transfer Learning with Long Short-Term Memory Networks

Learning Semantic Features for Software Defect Prediction by Code Comments Embedding

A Survey on Software Defect Prediction Using Deep Learning

Software visualization and deep transfer learning for effective software defect prediction