Abstract:A novel metric, Usage Patter Coverage, is introduced to measure how effectively a test suite captures the principle behaviours observed in user traces. The metric is the used to fine‐tune and benchmark clustering pipelines, selecting user traces to be converted into test cases. Clustering is increasingly being used to select the appropriate test suites. In this paper, we apply this approach to regression testing. Regression testing is the practice of verifying the robustness and reliability of software by retesting after changes have been made. Creating and maintaining functional regression tests is a laborious and costly activity. To be effective, these tests must represent the actual user journeys of the application. In addition, an optimal number of test cases is critical for the rapid execution of the regression test suite to stay within the time and computational resource budget as it is re‐run at each major iteration of the software development. Therefore, the selection and maintenance of functional regression tests based on the analysis of application logs has gained popularity in recent years. This paper presents a novel approach to improve regression testing by automating the creation of test suites using user traces fed into clustering pipelines. Our methodology introduces a new metric based on pattern mining to quantify the statistical coverage of prevalent user paths. This metric helps to determine the optimal number of clusters within a clustering pipeline, thus addressing the challenge of suboptimal test suite sizes. Additionally, we introduce two criteria, to systematically evaluate and rank clustering pipelines. Experimentation involving 33 variations of clustering pipelines across four datasets demonstrates the potential effectiveness of our automated approach compared with manually crafted test suites. (All the experiments and data on Scanner, Spree and Booked Scheduler are available at https://github.com/frederictamagnan/STVR2024.) Then, we analyse the semantics of the clusters based on their principal composing patterns.

Improving Cluster Selection Techniques Of Regression Testing By Slice Filtering

Using Program Slicing To Improve The Efficiency And Effectiveness Of Cluster Test Selection

An Improved Regression Test Selection Technique by Clustering Execution Profiles

ANALYZE OF FUNCTIONAL REGRESSION TEST TOOLS

An Empirical Study on Cluster Test Selection Approaches

Using Semi-supervised Clustering to Improve Regression Test Selection Techniques

Application of fuzzy expert system in test case selection for system regression test

A Novel Fuzzy Classification to Enhance Software Regression Testing

Using Weighted Attributes to Improve Cluster Test Selection

Software testing sizing in incremental development: A case study

An Improved Test Selection Optimization Model Based on Fault Ambiguity Group Isolation and Chaotic Discrete PSO.

Regression Testing for Web Applications Based on Slicing

A Dynamic Test Cluster Sampling Strategy by Leveraging Execution Spectra Information

Role of Test Case Prioritization based on Regression Testing using Clustering

Cost-sensitive Regression Learning on Small Dataset Through Intra-Cluster Product Favoured Feature Selection

Time-Constrained Test Selection For Regression Testing

A novel approach to regression test selection for J2EE applications

Test Suite Reduction via Evolutionary Clustering

Generation of Regression Tests From Logs With Clustering Guided by Usage Patterns

Towards Regression Test Selection for AspectJ Programs

On the Effectiveness of Feature Selection Techniques in the Context of ML-Based Regression Test Prioritization