Abstract:Spectral fault localization (SFL) is an automatic fault-localization technique, which uses risk evaluation formula to rank the risk of fault existence in each program entity after collecting the testing information dynamically. To provide insight into SFL techniques, the evaluation method is an important research topic. In this paper, we present a uniformly systematic investigation framework to evaluate and compare SFL techniques with fixed formulas considering both single-fault and multiple-fault scenarios. Particularly, we design a generic vector table model called VTM as a novel measurement model to thoroughly understand various SFL techniques. By defining different types of faulty statements and investigating suspiciousness factors' mathematical expression of statements on the basis of VTM, the effectiveness of different SFL techniques could be systematically analyzed and compared. Under the VTM-based evaluation framework, the latest formula D* and the optimal formula O considered before as examples are explored: (1) under a single-fault scenario, O has a better performance than D*, and O is the best SFL technique at present; (2) O shows stable performance and the performance of D* fluctuates in a range under double-fault scenarios: O outperforms D* in three cases, and the performance of O is between the worst performance and the best performance of D* in the other three cases that are less likely to happen; and (3) sample programs are presented to explain such observations. The VTM-based method overcomes the limitations of existing empirical and systematic approaches, which enables a systematic evaluation for SFL techniques with fixed formulas under both single-fault and multiple-fault cases.

Application Of Multivalued Test Sequencing To Fault Diagnosis

On a Multivalued Test Sequencing Problem

Design of Test Points Selection and Test Sequencing Problem of Multivalued Fault Dictionary

Multi-Label Relevant Vector Machine Based Simultaneous Fault Diagnosis

A General Enhancement Method for Test Strategy Generation for the Sequential Fault Diagnosis of Complex Systems

Optimal method for fault diagnosis strategy with multi-value attribute system

An Novel Testing Sequence Optimization Method under Dynamic Environments

Methods of Sequential Test Optimization in Dynamic Environment

Integrated testability modeling method of complex systems for fault feature selection and diagnosis strategy optimization

A Vector Table Model-Based Systematic Analysis of Spectral Fault Localization Techniques.

Test Sequencing Strategy with Imperfect Test

A Novel Test Optimizing Algorithm for Sequential Fault Diagnosis.

A POMDP-Based Optimization Method for Sequential Diagnostic Strategy with Unreliable Tests.

Generation of Test Strategy for Sequential Fault Diagnosis Based on Genetic Algorithms

Test Sequence Generation and Optimization Method Based on Cooperative Vehicle Infrastructure System Simulation

A Stochastic Combinatorial Optimization Model for Test Sequence Optimization.

Adaptive Design of Experiments for Fault Injection Testing of Highly Automated Vehicles

Fault Diagnosis for UIO Test Sequence

A Novel Fault Diagnosis System for Transmission Line System Based on Sequence of Events

A Novel Bottom-Up/Top-Down Hybrid Strategy-Based Fast Sequential Fault Diagnosis Method

A NEW DATA MINING APPROACH FOR FAULT DIAGNOSIS OF HV TRANSMISSION LINE SYSTEM BASED ON SEQUENCE OF EVENTS Part Two Simulation and Fault-tolerance Performance Analysis