Abstract:We propose a fault localization‐oriented test data generation approach multi‐objective optimization‐based fault localization‐oriented test case generation (MFTCG), which utilizes the multi‐objective optimization‐based algorithm to generate test data. To evaluate the effectiveness of our approach, we collect a novice program data set for faulty localization from programming website AtCoder, which contains 8911 faulty programs and 14,392 faults. The experimental results show that in most cases, test cases generated by our approach can achieve the best fault localization performance compared with the test cases generated by other approaches. Summary Online judgment (OJ) systems are capable of evaluating program results by automatically executing test cases, significantly improving the efficiency of traditional guidance approaches. Moreover, existing studies attempt to assist novices through automated fault localization techniques to provide feedback to novices, which can help them quickly find the location of faulty statements. Among them, spectrum‐based fault localization (SBFL) techniques have been widely used for their lightweight and efficiency, which only requires coverage information and test results of test cases to conduct fault localization. However, manually constructing high‐quality test cases for a large number of OJ questions is tough work to complete. To solve this problem, we propose the novice program‐oriented Multi‐Objective Optimization‐Based Fault Localization‐Oriented Test Case Generation (MFTCG) for automatically generating test inputs. Specifically, we use multi‐objective optimization algorithms to evolve the test case in terms of both fault localization and faulty code detection capability. We conduct experiments with 8911 programs from the well‐known public OJ platform AtCoder. The results show that our proposed approach MFTCG can achieve the best fault localization performance compared with existing automated test case generation approaches in most cases and can achieve the similar faulty code detection capability compared to manually designed test cases.

A Test Restoration Method based on Genetic Algorithm for effective fault localization in multiple-fault programs

A General Noise-Reduction Framework for Fault Localization of Java Programs.

Multiple fault localization based on ant colony algorithm via genetic operation

Fault Localization and Test Oracle Generation Based on the Mutual Pattern of Discrete Path Variables

Theoretical Analysis and Empirical Study on the Impact of Coincidental Correct Test Cases in Multiple Fault Localization

Locating Faulty Code Using Failure-Causing Input Combinations in Combinatorial Testing

Search-Based Efficient Automated Program Repair Using Mutation and Fault Localization.

Using Fine-Grained Test Cases for Improving Novice Program Fault Localization.

New Random Testing-based Fault Localization Approach

A Fault Localization Framework to Alleviate the Impact of Execution Similarity

Test case selection using multi-criteria optimization for effective fault localization

A Combinatorial Testing-Based Approach to Fault Localization

A Study of Modified Testing-Based Fault Localization Method

Multi‐objective optimization‐based and fault localization‐oriented test case generation for novice programs

Improving Spectrum-Based Fault Localization Using Quality Assessment and Optimization of a Test Suite

Effective Fault Localization Approach Using Feedback.

A fault localization method based on model combination

A Test Suite Reduction Approach to Improving the Effectiveness of Fault Localization

A Survey of Automated Software Fault Localization Approach

Effective Software Fault Localization Using Predicted Execution Results.

Restore: Retrospective Fault Localization Enhancing Automated Program Repair