Abstract:Due to the complexity of software systems, defects are inevitable. Understanding the types of defects could help developers to adopt measures in current and future software releases. In practice, developers often categorize defects into various types. One common categorization is based on fault triggers of defects. Fault trigger is a set of conditions which activate a defect (i.e., Fault) and propagate the defect into a failure. In general, there are two types of defect based fault triggering conditions, Bohrbug and Mandelbug. Bohrbug refers to a bug which can be easily isolated, and its activation and error propagation is simple. Mandelbug refers to a bug whose activation and/or error propagation is complex (e.g., A time lag between the fault activation and the failure occurrence). With these category labels, developers can better perform post-mortem analysis to identify common characteristic of the defects, and design specific fault-tolerance mechanisms. However, in most software systems, these category labels are often unavailable. To address this problem, in this paper, we propose a text mining solution which categorize defects into fault trigger categories by analyzing the natural-language description of bug reports. A previous study shows that Mandelbug is more complex and needs more time to be fixed. Thus, to better identify Mandelbugs, we propose a novel Fuzzy Set based Feature Selection algorithm named USES, which selects the features (i.e., Terms) which have high ability to distinguish Mandelbugs from Bohrbugs. USES first caches a set of terms based on their fuzzy affinity scores to Bohrbug or Mandelbug. Next, it iterates many times, and in each iteration, it selects a subset of terms, and builds a classifier on these terms. USES selects the classifier and the terms which could achieve the best performance on a training data. We evaluate our solution on 4 datasets including Linux, Mysql, Apache HTTPD, and AXIS containing a total of 809 bug reports. We show that USES with naive Bayes multinomial achieves the best performance, it achieves Mandelbug F-measure scores of 0.298 - 0.615. We also compare USES with other baseline approaches. The results show that USES on average improves Mandelbug F-measure scores of the best performing baseline by 12.3%.

A Field Study on the Elicitation and Classification of Defects for Defect Models

Unifying Defect Prediction, Categorization, and Repair by Multi-Task Deep Learning

Automatic Defect Categorization Based on Fault Triggering Conditions

Just-In-Time Defect Identification and Localization: A Two-Phase Framework.

Automatic Early Defects Detection in Use Case Documents

Perceptions, Expectations, and Challenges in Defect Prediction.

Low-Voltage Electrical Product Quality Problem-Solving Based on Improved Deep Structured Semantic Model.

Challenges of software process and product quality improvement: catalyzing defect root-cause investigation by process enactment data analysis

Back to the Future! Studying Data Cleanness in Defects4J and its Impact on Fault Localization

A Representation Learning-Based Approach to Enhancing Manufacturing Quality for Low-Voltage Electrical Products

Defect Identification, Categorization, and Repair: Better Together

The When–Who–How analysis of defects for improving the quality control process

Two sides of the same coin: A study on developers' perception of defects

An Evalutation of Programming Language Models' performance on Software Defect Detection

Scenario-based Failure Analysis of Product Systems and their Environment

Understanding machine learning software defect predictions

Towards an Understanding of Intra-Defect Associations: Implications for Defect Prediction

The Probabilistic Bounds on the Feasibility of the Defect Prediction Models in Real-World Testing Environments

Model-based Fault Classification for Automotive Software

A Machine Learning Framework For Data-Driven Defect Detection In Multistage Manufacturing Systems

Using Models To Assess Impact Of Defective Software