Abstract:Model-based testing (MBT) is a method that supports the design and execution of test cases by models that specify the intended behaviors of a system under test. While systematic literature reviews on MBT in general exist, the state of the art on modeling and testing performance requirements has seen much less attention. Therefore, we conducted a systematic mapping study on model-based performance testing. Then, we studied natural language software requirements specifications in order to understand which and how performance requirements are typically specified. Since none of the identified MBT techniques supported a major benefit of modeling, namely identifying faults in requirements specifications, we developed the Performance Requirements verificatiOn and Test EnvironmentS generaTion approach (PRO-TEST). Finally, we evaluated PRO-TEST on 149 requirements specifications. We found and analyzed 57 primary studies from the systematic mapping study and extracted 50 performance requirements models. However, those models don't achieve the goals of MBT, which are validating requirements, ensuring their testability, and generating the minimum required test cases. We analyzed 77 Software Requirements Specification (SRS) documents, extracted 149 performance requirements from those SRS, and illustrate that with PRO-TEST we can model performance requirements, find issues in those requirements and detect missing ones. We detected three not-quantifiable requirements, 43 not-quantified requirements, and 180 underspecified parameters in the 149 modeled performance requirements. Furthermore, we generated 96 test environments from those models. By modeling performance requirements with PRO-TEST, we can identify issues in the requirements related to their ambiguity, measurability, and completeness. Additionally, it allows to generate parameters for test environments.

Procedures modeling for testing and model checking needs

Should We Learn Probabilistic Models for Model Checking? A New Approach and An Empirical Study.

Formal Verification Technique for Grid Service Chain Model and Its Application

Abstraction-based model checking programs

A Fault Propagation Modeling and Analysis Method Based on Model Checking

A Novel Test Process Modeling Method for Automatic Test

Modeling and Model Checking by Modular Approach

Verification of Lean-Kanban Processes with Probabilistic Model Checking

A Fully Parallel Approach of Model Checking Via Probe Machine

An approach for performance requirements verification and test environments generation

A Modeling Method for Process Systems and Studies on the Dynamical Behavior

Software process validation based on model checking

A formal verification method: model checking

Planning as Model Checking Tasks

Model Checking Approach to Automated Planning

Using model checking to generate test cases for class testing

Secure Information Flow by Model Checking Pushdown System

A Contract-Checking Test Method for CTCS Hardware-in-the-Loop Simulation System

Model verification for system design of complex mechatronic products

A Novel Approach of CTL Model Checking Based on Probe Machine.

Combining Model Learning and Model Checking to Analyze Java Libraries