Abstract:RESTful APIs (or REST APIs for short) represent a mainstream approach to design and develop web APIs using the REpresentational State Transfer architectural style. Black‐box testing, which assumes only the access to the system under test with a specific interface, is the only viable option when white‐box testing is impracticable. This is the case for REST APIs: their source code is usually not (or just partially) available, or a white‐box analysis across many dynamically allocated distributed components (typical of a micro‐services architecture) is computationally challenging. This paper presents RestTestGen, a novel black‐box approach to automatically generate test cases for REST APIs, based on their interface definition (an OpenAPI specification). Input values and requests are generated for each operation of the API under test with the twofold objective of testing nominal execution scenarios and error scenarios. Two distinct oracles are deployed to detect when test cases reveal implementation defects. While this approach is mainly targeting the research community, it is also of interest to developers because, as a black‐box approach, it is universally applicable across different programming languages, or in the case external (compiled only) libraries are used in a REST API. The validation of our approach has been performed on more than 100 of real‐world REST APIs, highlighting the effectiveness of the approach in revealing actual faults in already deployed services. The source code of REST APIs is usually not (or just partially) available, or difficult to analyse because spread across many dynamically allocated distributed components (typical in micro‐services architectures), or due to external (compiled only) libraries or frameworks. RestTestGen is a novel black‐box approach to automatically generate test cases for REST APIs, based on their interface definition (an OpenAPI specification). Input values and requests are generated for each operation of the API under test with the twofold objective of testing nominal execution scenarios and error scenarios. RestTestGen has been successfully applied to test more than 100 of real‐world REST APIs, highlighting the effectiveness of the approach in revealing actual faults in already deployed services.

Automated Test-Case Generation for REST APIs Using Model Inference Search Heuristic

MUT: Human-in-the-Loop Unit Test Migration

RESTful API Automated Test Case Generation

Building an open-source system test generation tool: lessons learned and empirical analyses with EvoMaster

DeepREST: Automated Test Case Generation for REST APIs Exploiting Deep Reinforcement Learning

MR-Scout : Automated Synthesis of Metamorphic Relations from Existing Test Cases

MR-Scout: Automated Synthesis of Metamorphic Relations from Existing Test Cases

Technology adoption performance evaluation applied to testing industrial REST APIs

Combining Dynamic Symbolic Execution, Machine Learning and Search-Based Testing to Automatically Generate Test Cases for Classes

Automatic Unit Test Generation for Deep Learning Frameworks based on API Knowledge

Uncovering Unknown System Behaviors in Uncertain Networks with Model and Search-based Testing

Learning How to Search: Generating Effective Test Cases Through Adaptive Fitness Function Selection

An Automated Test Generation Technique for Software Quality Assurance

Automated black‐box testing of nominal and error scenarios in RESTful APIs

Automatic Web Testing using Curiosity-Driven Reinforcement Learning

Automated Test Generation for REST APIs: No Time to Rest Yet

Automated Test Generation for Medical RulesWeb Services: A Case Study at the Cancer Registry of Norway

Automated Test Generation for Medical Rules Web Services: A Case Study at the Cancer Registry of Norway

A Large-Scale Evaluation of Automated Unit Test Generation Using EvoSuite

A Multi-Agent Approach for REST API Testing with Semantic Graphs and LLM-Driven Inputs

Api test automation of search functionality with artificial intelligence