Abstract:To assure high quality of database applications, testing database applications remains the most popularly used approach. In testing database applications, tests consist of both program inputs and database states. Assessing the adequacy of tests allows targeted generation of new tests for improving their adequacy (e.g., fault-detection capabilities). Comparing to code coverage criteria, mutation testing has been a stronger criterion for assessing the adequacy of tests. Mutation testing would produce a set of mutants (each being the software under test systematically seeded with a small fault) and then measure how high percentage of these mutants are killed (i.e., detected) by the tests under assessment. However, existing test-generation approaches for database applications do not provide sufficient support for killing mutants in database applications (in either program code or its embedded or resulted SQL queries). To address such issues, in this paper, we propose an approach called MutaGen that conducts test generation for mutation testing on database applications. In our approach, we first apply an existing approach that correlates various constraints within a database application through constructing synthesized database interactions and transforming the constraints from SQL queries into normal program code. Based on the transformed code, we generate program-code mutants and SQL-query mutants, and then derive and incorporate query-mutant-killing constraints into the transformed code. Then, we generate tests to satisfy query-mutant-killing constraints. Evaluation results show that MutaGen can effectively kill mutants in database applications, and MutaGen outperforms existing test-generation approaches for database applications in terms of strong mutant killing.

Functional Testbench Qualification by Mutation Analysis

Accelerating RTL Quality Assessment Method Based on CAD Tools

Mutation-analysis Driven Functional Verification of a Soft Microprocessor.

Functional Verification of EPA Chip

Improving Defect Detection Ability of Derived Test Cases Based on Mutated UML Activity Diagrams

Mutation-based diagnostic test generation for hardware design error diagnosis

Mutation Testing: Principal, Optimization and Application

IP-XACT Based System Level Mutation Testing.

Automatic Test Generation for Mutation Testing on Database Applications.

Mutation-Based Simulation Test Data Generation for Testing Complex Real-Time Software

SN4KE: Practical Mutation Testing at Binary Level

Positive and Negative Testing with Mutation-Driven Model Checking

Test Case Generation using Mutation Operators and Fault Classification

Towards Mutation Analysis for Use Cases

Efficient Mutation-Analysis Coverage For Constrained Random Verification

Knowledge-Augmented Mutation-Based Bug Localization for Hardware Design Code

Which Quantum Circuit Mutants Shall Be Used? An Empirical Evaluation of Quantum Circuit Mutations

LLM-Guided Formal Verification Coupled with Mutation Testing

Does mutation testing improve testing practices?

Applying Interface-Contract Mutation in Regression Testing of Component-Based Software

A Verification Methodology for Reusable Test Cases and Coverage Based on System Verilog