Abstract:Based on our experience of collaborating with industry, we observed that test case generation usually relies on test case specifications (TCSs), commonly written in natural language, specifying test cases of a System Under Test at a high level of abstraction. In practice, TCSs are commonly used by test engineers as reference documents to perform these activities: 1) Manually executing test cases in TCSs; 2) Manually coding test cases in a test scripting language for automated test case execution. In the latter case, the gap between TCSs and executable test cases has to be filled by test engineers, requiring a significant amount of coding effort and domain knowledge. Motivated by the above observations from the industry, we first propose, in this paper, a TCS language, named as Restricted Test Case Modeling (RTCM), which is based on natural language and composed of an easy-to-use template, a set of restriction rules and keywords. Second, we propose a test case generation tool (aToucan4Test), which takes TCSs in RTCM as input and generates either manual test cases or automatically executable test cases, based on various coverage criteria defined on RTCM. To assess the applicability of RTCM, we manually modeled two industrial case studies and examined 30 automatically generated TCSs. To evaluate aToucan4Test, we modeled three subsystems of a Video Conferencing System developed by Cisco Systems, Norway and automatically generated executable test cases. These test cases were successfully executed on two commercial software versions. In the paper, we also discuss our experience of applying RTCM and aToucan4Test in an industrial context and compare our approach with other model-based testing methodologies.

Automated Test Case Generation from Input Specification in Natural Language

A Systematic Approach to Automatically Derive Test Cases from Use Cases Specified in Restricted Natural Languages.

Automatic identification of common and special object-oriented unit tests.

Intergenerational Test Generation for Natural Language Processing Applications

Software Test Case Generation Using Natural Language Processing (NLP): A Systematic Literature Review

Leveraging Conditional Statement to Generate Acceptance Tests Automatically Via Traceable Sequence Generation

CodeGen-Test: An Automatic Code Generation Model Integrating Program Test Information

An Automate Test Case Generation Approach: Using Match Technique.

Test case information extraction from requirements specifications using NLP-based unified boilerplate approach

Automatic Grammar-Based Test Generation.

Test Case Generation for Web Services Based on OWL-S Documents

RTCM: a Natural Language Based, Automated, and Practical Test Case Generation Framework

Using Large Language Models for Student-Code Guided Test Case Generation in Computer Science Education

Automated User Story Generation with Test Case Specification Using Large Language Model

NLPLego: Assembling Test Generation for Natural Language Processing Applications

Automated Test Oracle Generation via Denotational Semantics

Ontology-Based Test Case Generation for Testing Web Services

Towards Code Generation from BDD Test Case Specifications: A Vision

A Dynamic Stochastic Model for Automatic Grammar-Based Test Generation

Using model checking to generate test cases for class testing

Automatically Identifying Special and Common Unit Tests Based on Inferred Statistical Algebraic Abstractions