Abstract:Background: End-user satisfaction is not only dependent on the correct functioning of the software systems but is also heavily dependent on how well those functions are performed. Therefore, performance testing plays a critical role in making sure that the system responsively performs the indented functionality. Load test generation is a crucial activity in performance testing. Existing approaches for load test generation require expertise in performance modeling, or they are dependent on the system model or the source code. Aim: This thesis aims to propose and evaluate a model-free learning-based approach for load test generation, which doesn't require access to the system models or source code. Method: In this thesis, we treated the problem of optimal load test generation as a reinforcement learning (RL) problem. We proposed two RL-based approaches using q-learning and deep q-network for load test generation. In addition, we demonstrated the applicability of our tester agents on a real-world software system. Finally, we conducted an experiment to compare the efficiency of our proposed approaches to a random load test generation approach and a baseline approach. Results: Results from the experiment show that the RL-based approaches learned to generate effective workloads with smaller sizes and in fewer steps. The proposed approaches led to higher efficiency than the random and baseline approaches. Conclusion: Based on our findings, we conclude that RL-based agents can be used for load test generation, and they act more efficiently than the random and baseline approaches.

Model Based Load Testing of Web Applications

LTF: A Model-Based Load Testing Framework for Web Applications

Load Modeling for Wide Area Power System

Workload Characterization of E-Commerce Site by Modeling Customer Behavior

A new generalized load model of power systems and its applications

Wide Area Electric Load Modeling Based on Smart Meter

Establishment and application of load characteristic database

Automated Model-Based Performance Testing for PaaS Cloud Services

Dynamic Load-Balance Model for Web Services

An Experience-Based Approach for Test Execution Effort Estimation

A Model and Implementation of Function Test Automation for Web Applications

Modeling Users' Visiting Behaviors for Web Load Testing by Continuous Time Markov Chain

Web Load Test Method Based on Log Analysis

Testing Web Applications Focusing on Their Specialties.

A framework for Web applications testing

Applying users' actions obtaining methods into Web performance testing

Reinforcement Learning Assisted Load Test Generation for E-Commerce Applications

Environmental Modeling for Automated Cloud Application Testing

A Model-Based Framework for Cloud API Testing

Research of Load Testing and Result Based on Loadrunner

A Survey of Web Testing