Abstract:Data-flow testing (DFT) aims to detect potential data interaction anomalies by focusing on the points at which variables receive values and the points at which these values are used. Such test objectives are referred as \emph{def-use pairs}. However, the complexity of DFT still overwhelms the testers in practice. To tackle this problem, we introduce a hybrid testing framework for data-flow based test generation: (1) The core of our framework is symbolic execution (SE), enhanced by a novel guided path exploration strategy to improve testing performance; and (2) we systematically cast DFT as reachability checking in software model checking (SMC) to complement SE, yielding practical DFT that combines the two techniques' strengths. We implemented our framework for C programs on top of the state-of-the-art symbolic execution engine KLEE and instantiated with three different software model checkers. Our evaluation on the 28,354 def-use pairs collected from 33 open-source and industrial program subjects shows (1) our SE-based approach can improve DFT performance by 15$\sim$48% in terms of testing time, compared with existing search strategies; and (2) our combined approach can further reduce testing time by 20.1$\sim$93.6%, and improve data-flow coverage by 27.8$\sim$45.2% by eliminating infeasible test objectives. Compared with the SMC-based approach alone, our combined approach can also reduce testing time by 19.9$\sim$23.8%, and improve data-flow coverage by 7$\sim$10%. This combined approach also enables the cross-checking of each component for reliable and robust testing results. We have made our testing framework and benchmarks publicly available to facilitate future research.

Path-oriented Test Data Generation Driven by Component Linear Fitting Functions

Improved Method to Generate Path-Wise Test Data

Automated Test Data Generation Based on Program Execution

Data Automatic Generation Approach for Path Test

Effective code coverage in compositional systematic dynamic testing

An Approach to Generate Software Test Data for a Specific Path Automatically with Genetic Algorithm

Towards Optimal Concolic Testing

Search-based Multi-Paths Test Data Generation for Structure-Oriented Testing

Automatic Test Data Generation for Multiple Paths and Its Applications

Search-Based Software Test Data Generation for Path Coverage Based on a Feedback-Directed Mechanism

Towards Efficient Data-flow Test Data Generation

Case Generation by Constraints Combinatorial Testing

An Evolutionary Generation Method of Test Data for Multiple Paths Based on Coverage Balance

A Path-Oriented Tool Supporting for Testing

Automatic Test Data Generation Based on Usage Model and Genetic Algorithm

Atcase: An Automatic Generation Tool of Test Case for Numerical Program Based on Polynomial Constraint Solving

Improve the Effectiveness of Test Case Generation on EFSM via Automatic Path Feasibility Analysis

An Empirical Study on Constraint Optimization Techniques for Test Generation

Hybrid Test Data Generation

Generating Boundary Values from OCL Constraints Using Constraints Rewriting and Search Algorithms

Automated test data generation for aspect-oriented programs