Abstract:Automatic test generation plays a critical role in software quality assurance. While the recent advances in Search-Based Software Testing (SBST) and Large Language Models (LLMs) have shown promise in generating useful tests, these techniques still struggle to cover certain branches. Reaching these hard-to-cover branches usually requires constructing complex objects and resolving intricate inter-procedural dependencies in branch conditions, which poses significant challenges for existing test generation techniques. In this work, we propose TELPA, a novel technique aimed at addressing these challenges. Its key insight lies in extracting real usage scenarios of the target method under test to learn how to construct complex objects and extracting methods entailing inter-procedural dependencies with hard-to-cover branches to learn the semantics of branch constraints. To enhance efficiency and effectiveness, TELPA identifies a set of ineffective tests as counter-examples for LLMs and employs a feedback-based process to iteratively refine these counter-examples. Then, TELPA integrates program analysis results and counter-examples into the prompt, guiding LLMs to gain deeper understandings of the semantics of the target method and generate diverse tests that can reach the hard-to-cover branches. Our experimental results on 27 open-source Python projects demonstrate that TELPA significantly outperforms the state-of-the-art SBST and LLM-based techniques, achieving an average improvement of 31.39% and 22.22% in terms of branch coverage.

Detecting Infeasible Branches Based on Code Patterns

Automatic Test Data Generation Algorithm on Branch Coverage

Effective code coverage in compositional systematic dynamic testing

A Search Strategy Guided by Uncovered Branches for Concolic Testing

Automated Test Data Generation Based on Program Execution

PreInfer: Automatic Inference of Preconditions via Symbolic Analysis

How Effective is Branch-Based Combinatorial Testing? an Exploratory Study

A Constraint-Pattern Based Method for Reachability Determination

Precise Identification Of Problems For Structural Test Generation

PERDICE: Towards Discovering Software Inefficiencies Leading to Cache Misses and Branch Mispredictions

Enhancing LLM-based Test Generation for Hard-to-Cover Branches via Program Analysis

Feature-based software design pattern detection

A regression test case generation method guided with branch probability

Detecting Integer Bugs Based on Static and Dynamic Program Analysis

An Algorithm for Calculating the Branch Routes of an Assembly Program in Software Coverage Testing

Interactive Data Dependence Analysis Based on Range Tests

Function inlining algorithm for program analysis

Synthesizing Method Sequences for High-Coverage Testing

Identifying use cases in source code

Automatically Analyzing Inductive Properties for Recursive Data Structures

Detecting suspicious branch statements through recording and analyzing execution logs of apps using reflection