Abstract:We propose a fault localization‐oriented test data generation approach multi‐objective optimization‐based fault localization‐oriented test case generation (MFTCG), which utilizes the multi‐objective optimization‐based algorithm to generate test data. To evaluate the effectiveness of our approach, we collect a novice program data set for faulty localization from programming website AtCoder, which contains 8911 faulty programs and 14,392 faults. The experimental results show that in most cases, test cases generated by our approach can achieve the best fault localization performance compared with the test cases generated by other approaches. Summary Online judgment (OJ) systems are capable of evaluating program results by automatically executing test cases, significantly improving the efficiency of traditional guidance approaches. Moreover, existing studies attempt to assist novices through automated fault localization techniques to provide feedback to novices, which can help them quickly find the location of faulty statements. Among them, spectrum‐based fault localization (SBFL) techniques have been widely used for their lightweight and efficiency, which only requires coverage information and test results of test cases to conduct fault localization. However, manually constructing high‐quality test cases for a large number of OJ questions is tough work to complete. To solve this problem, we propose the novice program‐oriented Multi‐Objective Optimization‐Based Fault Localization‐Oriented Test Case Generation (MFTCG) for automatically generating test inputs. Specifically, we use multi‐objective optimization algorithms to evolve the test case in terms of both fault localization and faulty code detection capability. We conduct experiments with 8911 programs from the well‐known public OJ platform AtCoder. The results show that our proposed approach MFTCG can achieve the best fault localization performance compared with existing automated test case generation approaches in most cases and can achieve the similar faulty code detection capability compared to manually designed test cases.

Fault Localization and Test Oracle Generation Based on the Mutual Pattern of Discrete Path Variables

A Dynamic Fault Localization Technique with Noise Reduction for Java Programs

Test Oracle Prediction for Mutation Based Fault Localization

Locating Faulty Code Using Failure-Causing Input Combinations in Combinatorial Testing

First, Debug the Test Oracle

Spectrum-Based Fault Localization: Testing Oracles Are No Longer Mandatory

Fault Localization Based on Multi-Level Similarity of Execution Traces

A Test Restoration Method based on Genetic Algorithm for effective fault localization in multiple-fault programs

Evolutionary generation of test data for multiple paths coverage with faults detection

Evolutionary generation of test data for path coverage with faults detection.

An Approach of Regression Test Case Generation Based on Variable Impact Analysis and Data Mutation

Automatic Fault Localization Approach Combining Test Case Reduction and Joint Dependency Probabilistic Model

Multi‐objective optimization‐based and fault localization‐oriented test case generation for novice programs

Can This Fault Be Detected: A Study on Fault Detection Via Automated Test Generation

Path-directed Source Test Case Generation and Prioritization in Metamorphic Testing.

Effective Software Fault Localization Using Predicted Execution Results.

Locating Fault-Inducing Patterns from Structural Inputs

Code Coverage-Based Failure Proximity Without Test Oracles.

A General Enhancement Method for Test Strategy Generation for the Sequential Fault Diagnosis of Complex Systems

Diversity Maximization Speedup for Localizing Faults in Single-Fault and Multi-Fault Programs

A Path-Oriented Tool Supporting for Testing