Abstract:Unit testing, a common step in software development, presents a challenge. When produced manually, unit test suites are often insufficient to identify defects. The main alternative is to use one of a variety of automatic unit-test generation tools: these are able to produce and execute a large number of test inputs that extensively exercise the unit under test. However, without a priori specifications, programmers need to manually verify the outputs of these test executions, which is generally impractical. To reduce this cost, unit-test selection techniques may be used to help select a subset of automatically generated test inputs. Then programmers can verify their outputs, equip them with test oracles, and put them into the existing test suite. In this paper, we present the operational violation approach for unit-test generation and selection, a black-box approach without requiring a priori specifications. The approach dynamically generates operational abstractions from executions of the existing unit test suite. These operational abstractions guide test generation tools to generate tests to violate them. The approach selects those generated tests violating operational abstractions for inspection. These selected tests exercise some new behavior that has not been exercised by the existing tests. We implemented this approach by integrating the use of Daikon (a dynamic invariant detection tool) and Parasoft Jtest (a commercial Java unit testing tool), and conducted several experiments to assess the approach.

Adaptive Fault Detection for Testing Tenant Applications in Multi-tenancy SaaS Systems

Test Algebra for Combinatorial Testing

Towards a Scalable and Robust Multi-Tenancy SaaS

Design and Application of a Response-Driven Adaptive Test System

Adaptive Combinatorial Testing

Modeling and Analysis of Availability for SaaS Multi-tenant Architecture.

Adaptive Interaction Fault Location Based on Combinatorial Testing

A Case Study of Adaptive Combinatorial Testing

SLA-Aware Tenant Placement and Dynamic Resource Provision in SaaS

Modeling and Analysis of Availability in Multi-Tenant SaaS.

A Parallel Implementation Strategy of Adaptive Testing

Software Architecture Driven Configurability of Multi-Tenant SaaS Application

A cloud-based TaaS infrastructure with tools for SaaS validation, performance and scalability evaluation

Comparative Analysis of Genetic Algorithm and XML Filtering Technique for Multi-Tenant SaaS Configuration Management

Performing unit testing based on testing as a service (TaaS) approach

Testing As a Service over Cloud

Adaptive Random Test Case Generation for Combinatorial Testing

Tool-assisted Unit-Test Generation and Selection Based on Operational Abstractions

Isolating Failure-Inducing Combinations in Combinatorial Testing Using Test Augmentation and Classification

Restricted Natural Language and Model-based Adaptive Test Generation for Autonomous Driving

[email protected]: the virtual test lab on the cloud