Abstract:A program can be viewed as a syntactic structure P (syntactic skeleton) parameterized by a collection of identifiers V (variable names). This paper introduces the skeletal program enumeration (SPE) problem: Given a syntactic skeleton P and a set of variables V , enumerate a set of programs P exhibiting all possible variable usage patterns within P. It proposes an effective realization of SPE for systematic, rigorous compiler testing by leveraging three important observations: (1) Programs with different variable usage patterns exhibit diverse control- and data-dependence, and help exploit different compiler optimizations; (2) most real compiler bugs were revealed by small tests (i.e., small-sized P) — this “small-scope” observation opens up SPE for practical compiler validation; and (3) SPE is exhaustive w.r.t. a given syntactic skeleton and variable set, offering a level of guarantee absent from all existing compiler testing techniques. The key challenge of SPE is how to eliminate the enormous amount of equivalent programs w.r.t. α-conversion. Our main technical contribution is a novel algorithm for computing the canonical (and smallest) set of all non-α-equivalent programs. To demonstrate its practical utility, we have applied the SPE technique to test C/C++ compilers using syntactic skeletons derived from their own regression test-suites. Our evaluation results are extremely encouraging. In less than six months, our approach has led to 217 confirmed GCC/Clang bug reports, 119 of which have already been fixed, and the majority are long latent despite extensive prior testing efforts. Our SPE algorithm also provides six orders of magnitude reduction. Moreover, in three weeks, our technique has found 29 CompCert crashing bugs and 42 bugs in two Scala optimizing compilers. These results demonstrate our SPE technique’s generality and further illustrate its effectiveness.

Procedure Extraction to Improve Scalability of Software Model Checking

Formal Verification Technique for Grid Service Chain Model and Its Application

More anti-chain based refinement checking

Procedures modeling for testing and model checking needs

Scalable Verification Framework for C Program

Abstraction-based model checking programs

When Regression Verification Meets CEGAR.

Verifying Programs Using Abstraction and Theorem Proving.

Towards Efficient Large-Scale Interprocedural Program Static Analysis on Distributed Data-Parallel Computation

Applying Analytical Derivative and Sparse Matrix Techniques to Large-Scale Process Optimization Problems

A Fully Parallel Approach of Model Checking Via Probe Machine

Automatic abstraction for C program

PAGED: A Benchmark for Procedural Graphs Extraction from Documents

Multi-Core Programming in Land Plan Spatial Data Quality Checking: A Case Study on Multilayer Relationship Checking

Crosscutting invariant and an efficient checking algorithm using program slicing

Efficient Software Product-Line Model Checking Using Induction and a SAT Solver

Heuristic-Guided Abstraction Refinement

Automating Reusable-Procedure Discovery Through Developer's Action Analysis

Deductive Verification of Programs with Underspecified Semantics by Model Extraction

Skeletal program enumeration for rigorous compiler testing

Efficient Synthesis of Method Call Sequences for Test Generation and Bounded Verification.