Abstract:Software has become ubiquitous in our daily lives, and with its increasing functionality and complexity comes a frequently tedious and prolonged debugging process. Of the three activities in program debugging (failure detection, fault localization, and bug fixing), the focus of this paper is on the first, failure detection, under the condition that there is no test oracle that can be used to automatically determine the success or failure of all the executions. More precisely, the outputs for many executions have to be verified manually, or the expected outputs are not even available. We want to determine whether there is a solution to help programmers predict the execution results. How good are these predicted results when they are used to help programmers find the locations of bugs? A framework is proposed to reduce the effort on output verification using a strategy based on the Hamming distance or K-Means clustering to predict results of test executions. Such data and the statement coverage of each test case are used to compute the suspiciousness of each statement according to a fault localization technique and produce a ranking for examination to locate bugs. Case studies using 22 programs and seven fault localization techniques were conducted to evaluate the fault localization effectiveness of the proposed framework on 1203 faulty versions, some of which have a single bug and others with multiple bugs. A discussion on factors that may affect the accuracy of execution result prediction and the resulting fault localization effectiveness is also presented. Our data suggests that, in general, with respect to fault localization techniques using execution results verified against the expected outputs, those using predicted execution results can be even more effective than (by examining a smaller number of statements to locate the first faulty statement) or as good as the former (the verified).

Can This Fault Be Detected by Automated Test Generation: A Preliminary Study

Can This Fault Be Detected: A Study on Fault Detection Via Automated Test Generation

Effective code coverage in compositional systematic dynamic testing

Fault Localization and Test Oracle Generation Based on the Mutual Pattern of Discrete Path Variables

Improving Defect Detection Ability of Derived Test Cases Based on Mutated UML Activity Diagrams

Evolutionary generation of test data for path coverage with faults detection.

A Survey of Automated Software Fault Localization Approach

Evolutionary generation of test data for multiple paths coverage with faults detection

Locating Faulty Code Using Failure-Causing Input Combinations in Combinatorial Testing

Guided test generation for coverage criteria

Test-Data Generation Guided by Static Defect Detection

An Empirical Study on Automated Test Generation Tools for Java: Effectiveness and Challenges

Effective Fault Localization Using Code Coverage

Effective Software Fault Localization Using Predicted Execution Results.

Can automated test case generation cope with extract method validation?

AutoUnit:Automatic Test Generation Based on Active Learning and Prediction Guidance

Fault Localization-Guided Test Data Generation Approach for Novice Programs

Scalable Path Search for Automated Test Case Generation

Test Analysis: Searching for Faults in Tests (N)

An Approach of Regression Test Case Generation Based on Variable Impact Analysis and Data Mutation

AN AUTOMATIC GENERATION TOOL FOR UNIT TEST CASE BASED ON DYNAMIC SYMBOLIC EXECUTION