Testing-based interactive fault localization.

Dan Hao

DOI: https://doi.org/10.1145/1134285.1134462

2006-01-01

Abstract:No abstract available.

What problem does this paper attempt to address?

Towards Interactive Fault Localization Using Test Information

Dan Hao,Lu Zhang,Hong Mei,Jiasu Sun

DOI: https://doi.org/10.1109/apsec.2006.59

2006-01-01

Abstract:Finding the location of a fault is a central task of debugging. Typically, a developer employs an interactive process for fault localization. To accelerate this task, several approaches have been proposed to automate fault localization. In practice, testing-based fault localization (TBFL), which uses test information to locate faults, has become a research focus. However, experimental results reported in the literature showed that current automation of fault localization can only serve as a means to confirming the search space and prioritizing search sequences, not a substitute of the interactive fault localization process. In this paper, we propose an approach based on test information to support the entire interactive fault localization process. During this process, the information gathered from previous interaction steps can be used to provide the ranking of suspicious statements for the current interaction step. As a feasibility study of our approach, we performed an experiment on applying our approach together with some other TBFL approaches on the Siemens programs, which have been used in the literature. Our experimental results show the effectiveness of our approach.
A Dynamic Fault Localization Technique with Noise Reduction for Java Programs

Jian Xu,W. K. Chan,Zhenyu Zhang,T. H. Tse,Shanping Li

DOI: https://doi.org/10.1109/qsic.2011.32

2011-01-01

Abstract:Existing fault localization techniques combine various program features and similarity coefficients with the aim of precisely assessing the similarities among the dynamic spectra of these program features to predict the locations of faults. Many such techniques estimate the probability of a particular program feature causing the observed failures. They ignore the noise introduced by the other features on the same set of executions that may lead to the observed failures. In this paper, we propose both the use of chains of key basic blocks as program features and an innovative similarity coefficient that has noise reduction effect. We have implemented our proposal in a technique known as MKBC. We have empirically evaluated MKBC using three real-life medium-sized programs with real faults. The results show that MKBC outperforms Tarantula, Jaccard, SBI, and Ochiai significantly.
A General Noise-Reduction Framework for Fault Localization of Java Programs.

Jian Xu,Zhenyu Zhang,W. K. Chan,T. H. Tse,Shanping Li

DOI: https://doi.org/10.1016/j.infsof.2012.08.006

IF: 3.9

2012-01-01

Information and Software Technology

Abstract:Context: Existing fault-localization techniques combine various program features and similarity coefficients with the aim of precisely assessing the similarities among the dynamic spectra of these program features to predict the locations of faults. Many such techniques estimate the probability of a particular program feature causing the observed failures. They often ignore the noise introduced by other features on the same set of executions that may lead to the observed failures. It is unclear to what extent such noise can be alleviated. Objective: This paper aims to develop a framework that reduces the noise in fault-failure correlation measurements. Method: We develop a fault-localization framework that uses chains of key basic blocks as program features and a noise-reduction methodology to improve on the similarity coefficients of fault-localization techniques. We evaluate our framework on five base techniques using five real-life median-scaled programs in different application domains. We also conduct a case study on subjects with multiple faults. Results: The experimental result shows that the synthesized techniques are more effective than their base techniques by almost 10%. Moreover, their runtime overhead factors to collect the required feature values are practical. The case study also shows that the synthesized techniques work well on subjects with multiple faults. Conclusion: We conclude that the proposed framework has a significant and positive effect on improving the effectiveness of the corresponding base techniques.
A Platform for Remote Analysis and Pseudo Dynamic Testing of SDOF Structures

GUO Yu-rong,ZHANG Guo-wei,XIAO Yan,LIU Yi-jiang,ZHANG Jie

DOI: https://doi.org/10.3321/j.issn:1000-2472.2006.02.005

2006-01-01

Abstract:Based on the concept of networked structural laboratories,a platform for remote cooperative/interactive analysis and hybrid dynamic testing of SDOF structures was developed.It was composed of four parts,named control center,physical tester,virtual tester,and remote observer.The platform was capable of transferring control and feedback data among geographically distributed control centers,testers and observers connected by the Internet with a parallel communication protocol.Based on the platform,cooperative pseudo dynamic tests of CFT column under different levels of earthquake excitation were successfully carried out.The platform validates the theory of geographically distributed cooperative hybrid testing and can be updated for complex sub-structure pseudo dynamic testing.It enables the shared use of testing resources by integrating single structural laboratories into a powerful and networked laboratory with advanced capability.
Online Hybrid Test by Internet Linkage of Distributed Test-Analysis Domains by Peng Pan, Motohide Tada and Masayoshi Nakashima,Earthquake Engineering and Structural Dynamics 2005;34:1407–1425

Yurong Guo,Qing Hu,Yan Xiao

DOI: https://doi.org/10.1002/eqe.592

IF: 4.06

2006-01-01

Earthquake Engineering & Structural Dynamics

Abstract:Earthquake Engineering & Structural DynamicsVolume 35, Issue 12 p. 1581-1583 Discussion of Paper Online hybrid test by Internet linkage of distributed test-analysis domains by Peng Pan, Motohide Tada and Masayoshi Nakashima, Earthquake Engineering and Structural Dynamics 2005; 34:1407–1425 Yurong Guo, Corresponding Author Yurong Guo [email protected] Center for Integrated Protection Research of Engineering Structures (CIPRES), Hunan University, China University of Southern California, Los Angeles, CA 90089-2531, U.S.A.CIPRES, School of Civil Engineering, Hunan University, Changsha, Hunan 410082, ChinaSearch for more papers by this authorQing Hu, Qing Hu [email protected] Center for Integrated Protection Research of Engineering Structures (CIPRES), Hunan University, China FutureNet Technologies Corp., Monrovia, CA, U.S.A.Search for more papers by this authorYan Xiao, Yan Xiao [email protected] Center for Integrated Protection Research of Engineering Structures (CIPRES), Hunan University, China University of Southern California, Los Angeles, CA 90089-2531, U.S.A.Search for more papers by this author Yurong Guo, Corresponding Author Yurong Guo [email protected] Center for Integrated Protection Research of Engineering Structures (CIPRES), Hunan University, China University of Southern California, Los Angeles, CA 90089-2531, U.S.A.CIPRES, School of Civil Engineering, Hunan University, Changsha, Hunan 410082, ChinaSearch for more papers by this authorQing Hu, Qing Hu [email protected] Center for Integrated Protection Research of Engineering Structures (CIPRES), Hunan University, China FutureNet Technologies Corp., Monrovia, CA, U.S.A.Search for more papers by this authorYan Xiao, Yan Xiao [email protected] Center for Integrated Protection Research of Engineering Structures (CIPRES), Hunan University, China University of Southern California, Los Angeles, CA 90089-2531, U.S.A.Search for more papers by this author First published: 30 August 2006 https://doi.org/10.1002/eqe.592Citations: 1AboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL No abstract is available for this article. REFERENCES 1 Xiao Y, Hu Q, Guo YR, Zhu PS, Yi WJ. Network platform for remote structural testing and shared use of laboratories. Progress in Natural Sciences 2005; 15(12): 1135– 1142. Citing Literature Volume35, Issue12October 2006Pages 1581-1583 ReferencesRelatedInformation
A Combinatorial Testing-Based Approach to Fault Localization

Laleh Sh Ghandehari,Yu Lei,Raghu Kacker,Richard Kuhn,Tao Xie,David Kung

DOI: https://doi.org/10.1109/tse.2018.2865935

IF: 7.4

2020-01-01

IEEE Transactions on Software Engineering

Abstract:Combinatorial testing has been shown to be a very effective strategy for software testing. After a failure is detected, the next task is to identify one or more faulty statements in the source code that have caused the failure. In this paper, we present a fault localization approach, called BEN, which produces a ranking of statements in terms of their likelihood of being faulty by leveraging the result of combinatorial testing. BEN consists of two major phases. In the first phase, BEN identifies a combination that is very likely to be failure-inducing. A combination is failure-inducing if it causes any test in which it appears to fail. In the second phase, BEN takes as input a failure-inducing combination identified in the first phase and produces a ranking of statements in terms of their likelihood to be faulty. We conducted an experiment in which our approach was applied to the Siemens suite and four real-world programs, flex, grep, gzip and sed, from Software Infrastructure Repository (SIR). The experimental results show that our approach can effectively and efficiently localize the faulty statements in these programs.
A similarity-aware approach to testing based fault localization.

Dan Hao,Ying Pan,Lu Zhang,Wei Zhao,Hong Mei,Jiasu Sun

DOI: https://doi.org/10.1145/1101908.1101953

2005-01-01

Abstract:ABSTRACTDebugging is a time-consuming task in software development and maintenance. To accelerate this task, several approaches have been proposed to automate fault localization. In particular, testing based fault localization (TBFL), which utilizes the testing information to localize the faults, seem to be very promising. However, the similarity between test cases in the test suite has been ignored in the research on TBFL. In this paper, we investigate this similarity issue and propose a novel approach named similarity-aware fault localization (SAFL), which can calculate the suspicion probability of each statement with little impact by the similarity issue. To address and deal with the similarity between test cases, SAFL applies the theory of fuzzy sets to remove the uneven distribution of the test cases. We also performed an experimental study for two real-world programs at different size levels to evaluate SAFL together with another two approaches to TBFL. Experimental results show that SAFL is more effective than the other two approaches when the test suites contain injected redundancy, and SAFL can achieve a competitive result with normal test suites. SAFL can also be more effective than applying test suite reduction to current approaches to TBFL.
Theoretical Analysis and Empirical Study on the Impact of Coincidental Correct Test Cases in Multiple Fault Localization

Yonghao Wu,Yong Liu,Weibo Wang,Zheng Li,Xiang Chen,Paul Doyle

DOI: https://doi.org/10.1109/tr.2022.3165126

IF: 5.883

2022-06-04

IEEE Transactions on Reliability

Abstract:To improve the efficiency of the fault localization process, different automatic fault localization approaches have been proposed. Among these approaches, the spectrum-based fault localization (SBFL) approach has been widely used and studied due to its lightweight and high effectiveness. However, while the existence of coincidental correct (CC) test cases can influence the usefulness of SBFL in single-fault programs, their influence on multiple fault programs has not been thoroughly investigated. Therefore, in this article, we conduct a theoretical analysis and an empirical study to investigate the effect of CC test cases on multiple fault localization. The theoretical analysis is based on a suspiciousness calculation formula of SBFL, which divides CC test cases into three categories (specific, irrelevant, and unspecific) according to their association with a specific faulty statement. Following this analysis, we conduct an empirical study on two well-known open-source repositories (SIR and Defects4J), and the experimental results verify the correctness of our theoretical analysis. Specifically, reducing the number of specific CC test cases for a faulty statement can improve or maintain fault localization accuracy, while eliminating irrelevant CC test cases can have a negative effect. Finally, we design a CC test case identification solution based on the isolation-based multiple fault localization approach and demonstrate its effectiveness via a simulation experiment.

engineering, electrical & electronic,computer science, software engineering, hardware & architecture
Novel Fault Localization Approach Based on Lagrangian Relaxation and Subgradient Method

郑秋华,姚敏,钱沄涛

DOI: https://doi.org/10.3321/j.issn:1000-6788.2008.11.024

2008-01-01

Systems Engineering - Theory & Practice

Abstract:On the basic of comparison of current non-deterministic fault localization methods,a novel approach based on lagrangian relaxation and subgradient method is proposed.By considering false faults,we present an improved bipartite graph fault propagation model.Then the localization problem is transformed into a problem of 0-1 program,and lagrangian relaxation and subgradient method are adopted to solve this 0-1 program problem.Comprised with other method,this algorithm has not only the ability to detect spurious alarms,but also can decrease the diagnosis time.Simulation results show that this algorithm gets a high accuracy and a less diagnosis time.
A Study of Modified Testing-Based Fault Localization Method

Yu-Min Chung,Chin-Yu Huang,Yu-Chi Huang

DOI: https://doi.org/10.1109/PRDC.2008.34

2008-01-01

Abstract:In software development and maintenance, locating faults is generally a complex and time-consuming process. In order to effectively identify the locations of program faults, several approaches have been proposed. Similarity-aware fault localization (SAFL) is a testing-based fault localization method that utilizes testing information to calculate the suspicion probability of each statement. Dicing is also another method that we have used. In this paper, our proposed method focuses on predicates and their influence, instead of on statements in traditional SAFL. In our method, fuzzy theory, matrix calculating, and some probability are used. Our method detects the importance of each predicate and then provides more test data for programmers to analyze the fault locations. Furthermore, programmers will also gain some important information about the program in order to maintain their program accordingly. In order to speed up the efficiency, we also simplified the program. We performed an experimental study for several programs, together with another two testing-based fault localization (TBFL) approaches. These three methods were discussed in terms of different criteria such as line of code and suspicious code coverage. The experimental results show that the proposed method from our study can decrease the number of codes which have more probability of suspicion than real bugs.
Fault Localization Based on Multi-Level Similarity of Execution Traces

Xinping Wang,Qing Gu,Xin Zhang,Xiang Chen,Daoxu Chen

DOI: https://doi.org/10.1109/apsec.2009.45

2009-01-01

Abstract:Since automated fault localization can improve the efficiency of both the testing and debugging process, it is an important technique for the development of reliable software. This paper proposes a novel fault localization approach based on multi-level similarity of execution traces, which is suitable for object-oriented software. It selects useful test cases at class level and computes code suspiciousness at block level. We develop a tool that implements the approach, and conduct empirical studies to evaluate its effectiveness. The experimental results show that our approach has the potential to be effective in localizing faults for object-oriented software.
An Adaptive Algorithm of Locating Fault Interactions Based Combinatorial Testing

ZHOU Wu-Jie,ZHANG De-Ping,XU Bao-Wen

DOI: https://doi.org/10.3724/sp.j.1016.2011.01509

2011-01-01

Abstract:In the paper,we study the model to locate fault interactions proposed by Martinez C et al, improve the conclusion of constructing error locating array based on the higher strength covering arrays.We propose an adaptive algorithm of locating the faulty interactions whose strength is at most t in the software under test with known safe values.The algorithm solves one of the open problems proposed by Martinez C et al.We analyze the performance of the algorithm that our algorithm performs a number of tests that is polynomial in log k and d,where k is the number of parameters in the system and d is an upper bound on the number of the faulty interactions whose strength is at most t.
New Random Testing-based Fault Localization Approach

WANG Zhen-zhen,XU Bao-wen,ZHOU Yu-ming,CHEN Lin

DOI: https://doi.org/10.3969/j.issn.1002-137X.2013.01.002

2013-01-01

Computer Science

Abstract:Fixing faults in software are an essential task in software development,and many approaches have been pre-sented to automate fault localization.Among them,testing-based approaches are most promising.These approaches use the information of test cases to localize the faults,and they are called collectively as TBFL approach.But these TBFL approaches have ignored the similarity of the test cases,which may harm the effectiveness of these approaches.In fact it is impossible to completely avoid redundancy.Therefore this paper presented a new TBFL approach named random TBFL approach from a new view.The basic idea is that:the program is viewed as a random variable,and before testing,a prior distribution about the error probability of statements of the program is given,then some adjustments to the error probability of statements are made based on the execution information of the test suite,and the re-adjusted probability is called posterior probability,finally this posterior probability is used to localize the faults.This paper integrated the traditional TBFL approaches into the random framework,and compared and analyzed them on several instances.The analysis demonstrates that the random TBFL approach can correctly locate the faults,and redundancy has little influence on the effectiveness of the random TBFL approach.
An Empirical Study of Fault Localization Families and Their Combinations

Daming Zou,Jingjing Liang,Yingfei Xiong,Michael D. Ernst,Lu Zhang

DOI: https://doi.org/10.48550/arXiv.1803.09939

2019-01-07

Abstract:The performance of fault localization techniques is critical to their adoption in practice. This paper reports on an empirical study of a wide range of fault localization techniques on real-world faults. Different from previous studies, this paper (1) considers a wide range of techniques from different families, (2) combines different techniques, and (3) considers the execution time of different techniques. Our results reveal that a combined technique significantly outperforms any individual technique (200% increase in faults localized in Top 1), suggesting that combination may be a desirable way to apply fault localization techniques and that future techniques should also be evaluated in the combined setting. Our implementation is publicly available for evaluating and combining fault localization techniques.

Software Engineering
Wielding Statistical Fault Localization Statistically

Yunqian Zhang,Lin Chen,Bo Jiang,Zhenyu Zhang

DOI: https://doi.org/10.1109/issrew.2012.51

2012-01-01

Abstract:Program debugging is a laborious but necessary phase of software development. It generally consists of fault localization, bug fix, and regression testing. Statistical software fault localization automates the manual and error-prone first task. It predicts fault locations by analyzing dynamic program spectrum captured in program runs. Previous studies mostly focused on how to provide reliable input data to such a technique and how to process the data accurately, but inadequately studied how to wield the output result of such a technique. In this work, we raise the assumption of symmetric distribution on the effectiveness of such a technique in locating faults, based on empirical results. We use maximum likelihood estimate and linear programming to develop a tuning method to enhance the result of a statistical fault localization technique. Experiments with two representative such techniques on two realistic UNIX utility programs validate our assumption and show our method effective.
Searching for Multi-Fault Programs in Defects4J

Gabin An,Juyeon Yoon,Shin Yoo

DOI: https://doi.org/10.48550/arXiv.2108.04455

2021-08-10

Software Engineering

Abstract:Defects4J has enabled numerous software testing and debugging research work since its introduction. A large part of its contribution, and the resulting popularity, lies in the clear separation and distillation of the root cause of each individual test failure based on careful manual analysis, which in turn allowed researchers to easily study individual faults in isolation. However, in a realistic debugging scenario, multiple faults can coexist and affect test results collectively. Study of automated debugging techniques for these situations, such as failure clustering or fault localisation for multiple faults, would significantly benefit from a reliable benchmark of multiple, coexisting faults. We search for versions of Defects4J subjects that contain multiple faults, by iteratively transplanting fault-revealing test cases across Defects4J versions. Out of 326 studied versions of Defects4J subjects, we report that over 95% (311 versions) actually contain from two to 24 faults. We hope that the extended, multi-fault Defects4J can provide a platform for future research of testing and debugging techniques for multi-fault programs.
On similarity-awareness in testing-based fault localization

Dan Hao,Lu Zhang,Ying Pan,Hong Mei,Jiasu Sun

DOI: https://doi.org/10.1007/s10515-008-0025-9

IF: 1.677

2008-01-01

Automated Software Engineering

Abstract:In the process of software development and maintenance, software debugging is an inevitable and time-consuming task. To accelerate software debugging, various approaches have been proposed to automate fault localization. Among them, testing-based fault-localization approaches are most promising, which use the execution information of many test cases to localize the faults. However, these existing testing-based fault-localization approaches ignore the similarity between test cases, which may harm the effectiveness of these approaches according to our previous research. Therefore, in this paper we propose a similarity-aware fault-localization approach, which takes each test case as a fuzzy set to deal with the similarity between test cases and calculates statements’ suspicions based on the probability theory. To investigate whether SAFL can address the similarity issue effectively, we manually injected redundant test cases in a test suite and performed an experimental study on the original test suite and the test suite with redundancy, respectively. The experimental results demonstrate that in our experiments SAFL is an effective fault-localization approach, whether there is manually injected redundancy in the test suite. To compare SAFL with most existing testing-based fault-localization approaches, we performed another experimental study on Siemens program suite, which is extensively used in the evaluation of many other testing-based fault-localization approaches. This experimental study confirms the effectiveness of SAFL. Based on the two experimental studies, it seems that in our experiments SAFL cannot only deal with test suites containing much redundancy effectively but also perform effectively for test suites without much redundancy.
A LambdaMart-Based High-Accuracy Approach for Software Automatic Fault Localization

Yunhao Xiao,Xi Xiao,Fang Tian,Guangwu Hu

DOI: https://doi.org/10.1007/978-3-030-86130-8_20

2021-01-01

Abstract:Software debugging or fault localization is a very significant task in software development and maintenance, which directly determines the quality of software. Traditional methods of fault localization rely on manual investigation, which takes too much time in large-scale software development. To mitigate this problem, many automatic fault localization techniques have been proposed which can effectively lighten the burden of programmers. However, the quality of these techniques is not enough to meet the practical requirements. In order to improve the accuracy of fault localization, we propose LBFL, a LambdaMart-based high-accuracy approach for software automatic fault localization, which can integrate software's diversified features and achieve very high accuracy. To realize that, LBFL first extracts the static and dynamic features and normalizes them. Then these features are gathered on LambdaMart algorithm for training. Finally, LBFL sorts the code statements according to the model and generates a list which can help developers to locate faults. Exhaustive experiments indicate that LBFL can locate 76 faults in Top-1, which has at least 217% improvements over nine single techniques and has 55% improvements over ABFL approach on the Defects4J dataset.
Fault Localization with Partially Reliable Test Results Using Dempster-Shafer Theory

Xinrui Guo,Xiaoyu Song,William N. N. Hung,Ming Gu,Jiaguang Sun

DOI: https://doi.org/10.1109/TASE.2014.36

2014-01-01

Abstract:Fault localization is a critical procedure in software development process. Previous studies based their research on the precondition that test results are conveniently acquired and 100% correct, which does not happen in the real world. In this article, we propose the concept of gamma-reliable test-suite to demonstrate the potential unreliability of test results. By modeling this unreliability using Dempster-Shafer theory, we managed to pin down the faults under the new situation. Experiments were conducted on both 100%-reliable and partial-reliable Siemens Test Suite and compared against several known spectrum-based localization algorithms, namely Naish1, Naish2, Binary, Wong1 and Russel&Rao. The results proved the prior performance of our approach. We conclude that fault localization problem is more precisely modeled by Dempster-Shafer theory than common statistical theory.
Review of Dynamic Fault Localization Approaches Based on Program Spectrum

Xiang CHEN,Xiao-Lin JU,Wan-Zhi WEN,Qing GU

DOI: https://doi.org/10.13328/j.cnki.jos.004708

2015-01-01

Abstract:Program spectrum based dynamic fault localization is an active research topic in the domain of software automatic debugging. It aims to localize pontential faults in a faulty program based on a specific model which is constructed on execution behaviors and results of test cases. This survey offers a systematic overview of existing research achievements of the domestic and foreign researchers in recent years. First, some preliminary knowledge and basic assumptions are presented. Next, a research framework is proposed and important influencing factors which can affect the effectiveness of fault localization are identified. These factors include program spectrum construction, test suite maintenance and composition, number of faults, test case oracle, user feedback, and fault removal cost. In addition, the evaluation metrics and subject objects used in previous empirical studies are analyzed. Furthermore, classical applications of fault localization in some specific application domains are summarized. Finally a perspective of the future work in this research area is discussed.

Testing-based interactive fault localization.

Towards Interactive Fault Localization Using Test Information

A Dynamic Fault Localization Technique with Noise Reduction for Java Programs

A General Noise-Reduction Framework for Fault Localization of Java Programs.

A Platform for Remote Analysis and Pseudo Dynamic Testing of SDOF Structures

Online Hybrid Test by Internet Linkage of Distributed Test-Analysis Domains by Peng Pan, Motohide Tada and Masayoshi Nakashima,Earthquake Engineering and Structural Dynamics 2005;34:1407–1425

A Combinatorial Testing-Based Approach to Fault Localization

A similarity-aware approach to testing based fault localization.

Theoretical Analysis and Empirical Study on the Impact of Coincidental Correct Test Cases in Multiple Fault Localization

Novel Fault Localization Approach Based on Lagrangian Relaxation and Subgradient Method

A Study of Modified Testing-Based Fault Localization Method

Fault Localization Based on Multi-Level Similarity of Execution Traces

An Adaptive Algorithm of Locating Fault Interactions Based Combinatorial Testing

New Random Testing-based Fault Localization Approach

An Empirical Study of Fault Localization Families and Their Combinations

Wielding Statistical Fault Localization Statistically

Searching for Multi-Fault Programs in Defects4J

On similarity-awareness in testing-based fault localization

A LambdaMart-Based High-Accuracy Approach for Software Automatic Fault Localization

Fault Localization with Partially Reliable Test Results Using Dempster-Shafer Theory

Review of Dynamic Fault Localization Approaches Based on Program Spectrum