Abstract:Software reliability testing is concerned with the quantitative relationship between software testing and software reliability. Our previous work develops a mathematically rigorous modeling framework for software reliability testing. However the modeling framework is confined to the case of perfect debugging, where detected defects are removed without introducing new defects. In this paper the modeling framework is extended to the case of imperfect debugging and two models are proposed. In the first model it is assumed that debugging is imperfect and may make the number of remaining defects reduce by one, remain intact, or increase by one. In the second model it is assumed that when the number of remaining defects reaches the upper bound, the probability that the number of remaining defects is increased by one by debugging is zero. The expected behaviors of the cumulative number of observed failures and the number of remaining defects in the first model show that the software testing process may induce a linear or nonlinear dynamic system, depending on the relationship between the probability of debugging introducing a new defect and that of debugging removing a detected defect. The second-order behaviors of the first model also show that in the case of imperfect debugging, although there may be unbiased estimator for the initial number of defects remaining in the software under test, the cumulative number of observed failures and the current number of remaining defects are not sufficient for precisely estimating the initial number of remaining defects. This is because the variance of the unbiased estimator approaches a non-zero constant as the software testing process proceeds. This may be treated as an intrinsic principle of uncertainty for software testing. The expected behaviors of the cumulative number of observed failures and the number of remaining defects in the second model show that the software testing process may induce a nonlinear dynamic system. However theoretical analysis and simulation results show that, if defects are more often removed from than introduced into the software under test, the expected behaviors of the two models tend to coincide with each other as the upper bound of the number of remaining defects approaches infinity.

A Mathematical Modeling Framework for Software Reliability Testing

Mathematical Modeling of Software Reliability Testing with Imperfect Debugging

Towards a Conceptual Framework of Software Run Reliability Modeling

Software Reliability Modeling and Cost Estimation Incorporating Testing-Effort and Efficiency

Analysis of Software Reliability Modeling Considering Testing Compression Factor and Failure-to-Fault Relationship.

A novel framework for the reliability modelling of repairable multistate complex mechanical systems considering propagation relationships.

On Several Issues in Software Reliability Testing

Quantitative Software Reliability Modeling from Testing to Operation

A General Modeling and Analysis Framework for Software Fault Detection and Correction Process

Quantitative effects of software testing on reliability improvement in the presence of imperfect debugging

Software Testing Processes As a Linear Dynamic System.

Testing Model Based on Software Reliability Engineering

Incorporating fault dependency and debugging delay in software reliability analysis

Performance Analysis of Software Reliability Growth Models with Testing-Effort and Change-Point

Modeling the Software Failure Correlations When Test Automation Is Adopted during the Software Development

Reliability Specification for Component-Based Software.

A New Model for Software Reliability

Software Reliability Modeling with Removed Errors and Compounded-Decreased-Rate

Software Reliability Modeling withWeibull-type Testing-Effort and Multiple Change-Points

Software Reliability Test Based on Markov Usage Model

An integration of fault detection and correction processes in software reliability analysis