Abstract:Software reliability testing is concerned with the quantitative relationship between software testing and software reliability. Our previous work develops a mathematically rigorous modeling framework for software reliability testing. However the modeling framework is confined to the case of perfect debugging, where detected defects are removed without introducing new defects. In this paper the modeling framework is extended to the case of imperfect debugging and two models are proposed. In the first model it is assumed that debugging is imperfect and may make the number of remaining defects reduce by one, remain intact, or increase by one. In the second model it is assumed that when the number of remaining defects reaches the upper bound, the probability that the number of remaining defects is increased by one by debugging is zero. The expected behaviors of the cumulative number of observed failures and the number of remaining defects in the first model show that the software testing process may induce a linear or nonlinear dynamic system, depending on the relationship between the probability of debugging introducing a new defect and that of debugging removing a detected defect. The second-order behaviors of the first model also show that in the case of imperfect debugging, although there may be unbiased estimator for the initial number of defects remaining in the software under test, the cumulative number of observed failures and the current number of remaining defects are not sufficient for precisely estimating the initial number of remaining defects. This is because the variance of the unbiased estimator approaches a non-zero constant as the software testing process proceeds. This may be treated as an intrinsic principle of uncertainty for software testing. The expected behaviors of the cumulative number of observed failures and the number of remaining defects in the second model show that the software testing process may induce a nonlinear dynamic system. However theoretical analysis and simulation results show that, if defects are more often removed from than introduced into the software under test, the expected behaviors of the two models tend to coincide with each other as the upper bound of the number of remaining defects approaches infinity.

The Formal Description of Software Correctness Based on the Environment

Software partial correctness verification based on XYZ/SE

Formal Methods for Specifying and Analyzing Complex Software Systems

Towards correctness proof for hybrid Simulink block diagrams

Mathematical Modeling of Software Reliability Testing with Imperfect Debugging

Environment Model based Requirements Consistency Verification: An Example

A formal verification method: model checking

Quantifying Software Correctness by Combining Architecture Modeling and Formal Program Analysis

Novel Dynamic Trusted Evaluation Model of Software Behavior

Game-based Monitors for a Scenario-Based Specification in Open Environments

Formalizing the environment view of process equivalence

Simulator Semantics for System Level Formal Verification

The role of model checking in software engineering

Software Monitoring Through Formal Specification Animation

Model Checking of Dynamic Software Architecture Based on Linear Temporal Logic

Formal Specification-Based Inspection for Verification of Programs.

Formally expressing the semantics of observer-based fault detection software

Complexity of Software Trustworthiness and Its Dynamical Statistical Analysis Methods.

A Rigorous Method for Inspection of Model-Based Formal Specifications.

Source-oriented Software Model Checking and Its Implementation

Stability of Software Trustworthiness Measurements Models