Abstract:This paper introduces a novel theoretical model, Delta4Ms, that mitigates a previously unaddressed issue in mutation‐based fault localization (MBFL) known as 'mutant bias'. By integrating the principles of signal theory, we have devised Delta4Ms to adjust for the influence of mutant bias in MBFL, thereby substantially enhancing fault localization accuracy. Fault localization is a complex, costly and time‐consuming task in software debugging. Numerous automated techniques have been developed to expedite this process. Mutation‐based fault localization (MBFL) is one of the most widely studied techniques which uses mutation analysis to generate mutants for revealing potential faults in the program. However, our theoretical analysis exposes an inherent conflict between the fundamental assumption and the essential meaning of existing MBFL suspiciousness. This conflict is caused by mutant bias. Intuitively, the suspiciousness can be corrected by eliminating the mutant bias for more accurately measuring the faulty probability of the corresponding mutant statement. In this paper, we introduce Delta4Ms, a fault localization approach designed to eliminate mutant bias. Delta4Ms integrates the principles of signal theory, modelling the actual suspiciousness and mutant bias as the desired and false signal components, respectively. Based on theoretical derivation, the average suspiciousness of mutants serves as an estimate of mutant bias. Delta4Ms effectively mitigates mutant bias, extracting the desired signal and yielding corrected suspiciousness for fault localization. To precisely estimate mutant bias, higher order mutants (HOMs) are incorporated. We conduct an extensive experimental evaluation of Delta4Ms on 320 real‐fault programs from Codeflaws. The results indicate that our model significantly outperforms existing SBFL and MBFL techniques, showing a considerable improvement in fault localization effectiveness. We further assessed the robustness of Delta4Ms by examining different HOM ratios and HOM generation strategies. Moreover, Delta4Ms achieves a substantial reduction in mutation execution cost and minimal accuracy loss through the implementation of test case reduction. Finally, we perform preliminary experiments on 15 real‐fault programs from the Defects4J benchmark to assess the generalization of the model's fault localization effectiveness.

To Detect Abnormal Program Behaviours via Mutation Deduction

Improving Defect Detection Ability of Derived Test Cases Based on Mutated UML Activity Diagrams

A New Mutation Analysis Method for Testing Java Exception Handling

Heuristics for Strongly Killing Mutants in Software Mutation Testing

Mutation Testing: Principal, Optimization and Application

Dynamic Mutant Subsumption Analysis using LittleDarwin

Mutation Testing in Evolving Systems: Studying the relevance of mutants to code evolution

Predictive Mutation Testing

Test generation via Dynamic Symbolic Execution for mutation testing

Towards Mutation Analysis for Use Cases

Spotting Code Mutation for Predictive Mutation Testing

MMT: Mutation Testing of Java Bytecode with Model Transformation -- An Illustrative Demonstration

Delta4Ms: Improving mutation‐based fault localization by eliminating mutant bias

Mutation Analysis with Execution Taints

HMER: A Hybrid Mutation Execution Reduction approach for Mutation-based Fault Localization

Binary Mutation Testing Through Dynamic Translation

SN4KE: Practical Mutation Testing at Binary Level

Towards Effective Metamorphic Testing by Algorithm Stability for Linear Classification Programs

What Are We Really Testing in Mutation Testing for Machine Learning? A Critical Reflection

Positive and Negative Testing with Mutation-Driven Model Checking

An Exploratory Study on Using Large Language Models for Mutation Testing