Abstract:The level and quality of automation dramatically affects software testing activities, determines costs and effectiveness of the testing process, and largely impacts on the quality of the final product. While costs and benefits of automating many testing activities in industrial practice (including managing the quality process, executing large test suites, and managing regression test suites) are well understood and documented, the benefits and obstacles of automatically generating system test suites in industrial practice are not well reported yet, despite the recent progresses of automated test case generation tools. Proprietary tools for automatically generating test cases are becoming common practice in large software organisations, and commercial tools are becoming available for some application domains and testing levels. However, generating system test cases in small and medium-size software companies is still largely a manual, inefficient and ad-hoc activity. This paper reports our experience in introducing techniques for automatically generating system test suites in a medium-size company. We describe the technical and organisational obstacles that we faced when introducing automatic test case generation in the development process of the company, and present the solutions that we successfully experienced in that context. In particular, the paper discusses the problems of automating the generation of test cases by referring to a customised ERP application that the medium-size company developed for a third party multinational company, and presents ABT2.0, the test case generator that we developed by tailoring ABT, a research state-of-the-art GUI test generator, to their industrial environment. This paper presents the new features of ABT2.0, and discusses how these new features address the issues that we faced.

Combining Dynamic Symbolic Execution, Machine Learning and Search-Based Testing to Automatically Generate Test Cases for Classes

Combining symbolic execution and search-based testing for programs with complex heap inputs

State of the art: Dynamic symbolic execution for automated test generation

An Empirical Comparison of Automated Generation and Classification Techniques for Object-Oriented Unit Testing

Software testing with code-based test generators: data and lessons learned from a case study with an industrial software component

Method-Sequence Exploration for Automated Unit Testing of Object-Oriented Programs

Method for Generating Test Cases in Software Integration Testing

Automated Coverage-Driven Test Data Generation Using Dynamic Symbolic Execution

Automated Test Case Generation Using UML Class & Sequence Diagram

MODA: automated test generation for database applications via mock objects.

On Introducing Automatic Test Case Generation in Practice: A Success Story and Lessons Learned

An Orchestrated Survey of Methodologies for Automated Software Test Case Generation.

JDart-Based Test Cases Generation and Optimization

Hybrid Test Data Generation

Feedback-Directed Test Case Generation Based on UML Activity Diagrams

Learning How to Search: Generating Effective Test Cases Through Adaptive Fitness Function Selection

A System for Automated Unit Test Generation Using Large Language Models and Assessment of Generated Test Suites

Automatic identification of common and special object-oriented unit tests.

Synthesizing Method Sequences for High-Coverage Testing

Generation of Test Cases Based on Symbolic Execution and LTL Formula Rewriting

Improving Generation of Object-Oriented Test Suites by Avoiding Redundant Tests