Abstract:MPI is widely used as the bedrock of HPC applications, but there are no effective systematic software testing techniques for MPI programs. In this paper we develop COMPI, the first practical concolic testing tool for MPI applications. COMPI tackles two major challenges. First, it provides an automated testing tool for MPI programs - it performs concolic execution on a single process and records branch coverage across all. Infusing MPI semantics such as MPI rank and MPI_COMM_WORLD into COMPI enables it to automatically direct testing with various processes' executions as well as automatically determine the total number of processes used in the testing. Second, COMPI employs three techniques to effectively control the cost of testing as too high a cost may prevent its adoption. By capping input values, COMPI is made practical as too large an input can make the testing extremely slow and sometimes even fail as memory needed could exceed the computing platform's memory limit. With two-way instrumentation, we reduce the unnecessary memory and I/O overhead of COMPI and the target program. With constraint set reduction, COMPI keeps significantly fewer constraints by removing redundant ones in the presence of loops so as to avoid redundant tests against these branches. Our evaluation of COMPI uncovered four new bugs in a complex application and achieved 69-86% branch coverage which far exceeds the 1.8-38% coverage achieved via random testing.

Towards Concolic Testing for Hybrid Systems

Towards Optimal Concolic Testing

Engineering Seminar ( WiSe 2020 / 21 ) Search Strategies in Concolic Testing Description

Combining Model Checking and Testing with an Application to Reliability Prediction and Distribution

Testing concolic execution through consistency checks

On Modeling and Optimal Control of a Class of Hybrid Systems

Evaluating Initial Inputs for Concolic Testing

Test Generation for Embedded Executables Via Concolic Execution in a Real Environment

Concolic Testing in Logic Programming

Modeling, Simulation and Automatic Verification of Hybrid Systems under Matlab Environment

A Benchmark Suite for Hybrid Systems Reachability Analysis.

Formal Verification of Hybrid Systems and Its Application on Chemical Process Control

BATON: Symphony of Random Testing and Concolic Testing Through Machine Learning and Taint Analysis

Current Challenges in the Verification of Hybrid Systems

A Hybrid Approach to Detecting Security Defects in Programs

Concolic Testing of Quantum Programs

Safety verification of linear hybrid system by transition system analysis

Abstraction-driven Concolic Testing

Concolic Metamorphic Debugging

COMPI: Concolic Testing for MPI Applications

Collaborative Verification-Driven Engineering of Hybrid Systems