Abstract:Recent years have seen great advances in software engineering and programming languages. Unfortunately, software is still far from bug-free, even for those deployed. Static analysis is a good approach to eliminating numerous bugs, but its conservative nature of analysis unavoidably constrains its capacity. Dynamic analysis, on the other hand, utilizes program runtime execution data, which complements static approaches. This thesis describes three dynamic techniques that leverage program runtime data to improve software quality.First, we present a statistical debugging algorithm, called S OBER, which automatically localizes software faults without any prior knowledge of the program semantics. This statistical debugging alleviates the high cost associated with manual debugging. Featuring a similar rationale to hypothesis testing, SOBER quantifies the fault relevance of each predicate in a principled way. We systematically evaluate S OBER under the same setting as previous studies, and compare S OBER with other seven algorithms. The result clearly demonstrates the advantages of SOBER over existing approaches.Second, we discuss automated program failure triage, which is a closely related problem with automated debugging. Recent software systems usually feature an automated failure reporting component, with which a huge number of failures are collected from software end-users. In order to effectively leverage the valuable program failure data, the collected failures need to be first triaged, i.e., to locate the most severe failures, and to assign them to appropriate developers. Lying in the center of failure triage is failure indexing, which tries to group failures due to the fault together. In this thesis, we propose a statistical debugging-based approach to program failure triage, called R-PROXIMITY, which better indexes failures and facilitates failure assignment than existing approaches. Finally, we describe a program dynamic slicing-based approach to failure indexing, which complements R-PROXIMITY. R-PROXIMITY is a quality failure indexing tool, but its effectiveness relies on a sufficient number of correct executions, which may or may not be available in practice. The proposed dynamic slicing-based approach does not require any correct executions, and hence perfectly complements R-PROXIMITY . All the three techniques are subject to three mid-sized programs grep, gzip, and flex, and the result validates their advancement of the state of the art.

Improved Delta Debugging Based on Combinatorial Testing.

Improving MC/DC and Fault Detection Strength Using Combinatorial Testing.

An Algorithm for Fault Diagnosis Based on Combinatorial Design Approach for Testing

A Software Failure Debugging Method Based on Combinatorial Design Approach for Testing

A Comprehensive Method of Fault Detection and Isolation Based on Testability Modeling Data

Delta Debugging Microservice Systems with Parallel Optimization.

WDD: Weighted Delta Debugging

A Software Debugging Method Based on Pairwise Testing

Isolating and Understanding Program Errors Using Probabilistic Dispute Model

Statistical Debugging: A Hypothesis Testing-Based Approach

Locating Faulty Code Using Failure-Causing Input Combinations in Combinatorial Testing

The Research of Statistical Testing Fault Detection Method Based on Embedded Software

Adaptive Interaction Fault Location Based on Combinatorial Testing

Statistical debugging and automated program failure triage

Software fault diagnosis method based on combinatorial testing

An Interleaving Approach to Combinatorial Testing and Failure-Inducing Interaction Identification

C2D2: Extracting Critical Changes for Real-World Bugs with Dependency-Sensitive Delta Debugging

Isolating Failure-Inducing Combinations in Combinatorial Testing Using Test Augmentation and Classification

Delta Debugging Microservice Systems

A learning algorithm for optimizing continuous integration development and testing practice

A Study of Modified Testing-Based Fault Localization Method