Abstract:Optimal software testing is concerned with how to test software such that the underlying testing goal is achieved in an optimal manner. Our previous work shows that the optimal testing problem for software reliability growth can be treated as closed-loop or feedback control problem, where the software under test serves as a controlled object and the software testing strategy serves as the corresponding controller. More specifically, the software under test is modeled as controlled Markov chains (CMCs) and the control theory of Markov chains is used to synthesize the required optimal testing strategy. In this paper, we show that software reliability assessment can be treated as a feedback control problem and the CMC approach is also applicable to dealing with the optimal testing problem for software reliability assessment. In this problem, the code of the software under test is frozen and the software testing process is optimized in the sense that the variance of the software reliability estimator is minimized. An adaptive software testing strategy is proposed that uses the testing data collected on-line to estimate the required parameters and selects next test cases. Simulation results show that the proposed adaptive software testing strategy can really work in the sense that the resulting variance of the software reliability estimate is much smaller than that resulting from the random testing strategies. The work presented in this paper is a contribution to the new area of software cybernetics that explores the interplay between software and control.

A Markov Decision Approach to Optimize Testing Profile in Software Testing

Cross-Entropy Method Based on Markov Decision Process for Optimal Software Testing

A Learning Strategy for Software Testing Optimization Based on Dynamic Programming

Enhancing Performance of Random Testing Through Markov Chain Monte Carlo Methods

Optimizing design method of operational profile in statistical testing

Optimal and Adaptive Testing with Cost Constraints.

Approach For Test Profile Optimization In Dynamic Random Testing

Optimal Software Testing in the Setting of Controlled Markov Chains

A New Way of Test Software for Optimal Software Reliability Estimation

Acceleration Testing Method of Safety-critical Software with Testing Resource Constraint

Optimal software testing and adaptive software testing in the context of software cybernetics

Functional Test-Cost Reduction Based on Fault Tree Analysis and Binary Optimization

Test Optimization for Noninfectious Chronic Disease Based on Markov Decision Process

Optimal testing resource allocation, and sensitivity analysis in software development

A Methodology for Test Suite Optimization Based on Testing Requirement

Optimal and Adaptive Testing for Software Reliability Assessment

Optimal Selection and Release Problem in Software Testing Process: A Continuous Time Stochastic Control Approach

Study of a software cost model based on testing level

An Improved Approach to Adaptive Testing

An Optimal Release Policy for Software Testing Process

Functional Test-Cost Reduction Based on Optimization Modeling and Congestion Control