Abstract:Object-oriented programming consists of several different levels of abstraction, namely, the algorithmic level, class level, cluster level, and system level. The testing of object-oriented software at the algorithmic and system levels is similar to conventional program testing. Testing at the class and cluster levels poses new challenges. Since methods and objects may interact with one another with unforeseen combinations and invocations, they are much more complex to simulate and test than the hierarchy of functional calls in conventional programs. In this paper, we propose a methodology for object-oriented software testing at the class and cluster levels. In class-level testing, it is essential to determine whether objects produced from the execution of implemented systems would preserve the properties defined by the specification, such as behavioral equivalence and nonequivalence. Our class-level testing methodology addresses both of these aspects. For the testing of behavioral equivalence, we propose to select fundamental pairs of equivalent ground terms as test cases using a black-box technique based on algebraic specifications, and then determine by means of a white-box technique whether the objects resulting from executing such test cases are observationally equivalent. To address the testing of behavioral nonequivalence, we have identified and analyzed several nontrivial problems in the current literature. We propose to classify term equivalence into four types, thereby setting up new concepts and deriving important properties. Based on these results, we propose an approach to deal with the problems in the generation of nonequivalent ground terms as test cases. Relatively little research has contributed to cluster-level testing. In this paper, we also discuss black-box testing at the cluster level. We illustrate the feasibility of using contract, a formal specification language for the behavioral dependencies and interactions among cooperating objects of different classes in a given cluster. We propose an approach to test the interactions among different classes using every individual message-passing rule in the given Contract specification. We also present an approach to examine the interactions among composite message-passing sequences. We have developed four testing tools to support our methodology.

Coyote C++: An Industrial-Strength Fully Automated Unit Testing Tool

Taming the Beast: Fully Automated Unit Testing with Coyote C++

Automated test data generation and stubbing method for C/C++ embedded projects

Coyote: An XML-Based Framework for Web Services Testing

OCAT: object capture-based automated testing.

An industrial case study in compiler testing (tool demo)

Codecomb:Automated Test Case Generation and Defect Detecting for Embedded Software Based on Symbolic Execution

Research and Design of A C++ Unit Testing Supporting Tool

Effective Test Case Generation via Concolic Execution

COCO: Testing Code Generation Systems via Concretized Instructions

COMPI: Concolic Testing for MPI Applications

SmartUnit: Empirical Evaluations for Automated Unit Testing of Embedded Software in Industry

Asit: an Interface-oriented Distributed Automated Test System

TACCLE

MAESTRO: Automated test generation framework for high test coverage and reduced human effort in automotive industry

Test Generation for Embedded Executables Via Concolic Execution in a Real Environment

CooTest: An Automated Testing Approach for V2X Communication Systems

Generating Pairwise Covering Arrays for Highly Configurable Software Systems.

Precise Identification Of Problems For Structural Test Generation

CoCoTest: Collaborative Crowdsourced Testing for Android Applications