Abstract:Sketching is a synthesis approach that allows users to provide high-level insights into a synthesis problem and let synthesis tools complete low-level details. Users write sketches—partial programs that have "holes" and provide test assertions as the correctness criteria. The sketching techniques fill the holes with code fragments such that the complete program satisfies all test assertions. Traditional techniques translate the sketching problem to propositional satisfiability formulas and leverage SAT solvers to generate programs with the desired functionality. While effective for a range of small well-defined domains, such translation-based approaches have a key limitation when applying to real applications: They require either translating all relevant libraries that are invoked directly or indirectly by the given sketch or creating models of those libraries, which requires much manual effort. This paper introduces execution-driven sketching, a novel approach for synthesizing Java programs with on-demand candidate generation. The key novelty of our work is to leverage runtime behavior to prune a large amount of search space. EdSketch explores the actual program behaviors in the presence of libraries and sketches small parts of real-world applications, which may use complex constructs of modern languages, such as reflection, native calls and File I/O. We further leverage a set of pruning strategies based on Java syntax to expedite the synthesis process. EdSketch embodies our approach in two forms: a stateful search based on the Java PathFinder model checker; and a stateless search based on re-execution inspired by the VeriSoft model checker. Experimental results show that EdSketch can complete some sketches that contain complex constructs in the presence of libraries, recursive procedures and advanced features like reflection. Without translating to SAT, EdSketch 's performance compares well with the SAT-based Sketch system for a range of small but complex data structure subjects.

EdSketch: execution-driven sketching for Java

Research and Implementation of the Sketching Design System

Program sketching

SketchGuide: Reconfiguring Sketch-based Measurement on Programmable Switches

Synthesizing Queries via Interactive Sketching

Schematic Program Proofs with Abstract Execution

SketchEdit: Editing Freehand Sketches at the Stroke-Level

Reconciling Enumerative and Symbolic Search in Syntax-Guided Synthesis

Program Synthesis from Visual Specification

State of the art: Dynamic symbolic execution for automated test generation

Counterexample-Driven Synthesis for Probabilistic Program Sketches

Efficient Synthesis of Symbolic Distributed Protocols by Sketching

SketchMaker: Sketch Extraction and Reuse for Interactive Scene Sketch Composition

SkCoder: A Sketch-based Approach for Automatic Code Generation

Android Testing Via Synthetic Symbolic Execution.

EDA-Driven Preprocessing for SAT Solving

SketchRef: A Benchmark Dataset and Evaluation Metrics for Automated Sketch Synthesis

Solver-Based Sketching of Alloy Models Using Test Valuations

Sketchforme: Composing Sketched Scenes from Text Descriptions for Interactive Applications

Expressing and Exploiting Subgoal Structure in Classical Planning Using Sketches

Distinctive Action Sketch