Abstract:The importance of mobile application (app) quality insurance is increasing with the rapid development of the mobile Internet. Automated test generation approaches, as a dominant direction of app quality insurance, follow specific models or strategies, targeting at optimizing the code coverage. Such approaches lead to a huge gap between testing execution and app business logic. Test scripts developed by human testers consider business logic by focusing on testing scenarios. Due to the GUI-intensive feature of mobile apps, human testers always understand app GUI to organize test scripts for scenarios. This inspires us to utilize domain knowledge from app GUI understanding for scenario-based test generation. In this paper, we propose a novel approach, ScenTest, for scenario-based mobile app testing with event knowledge graph (EKG) via GUI image understanding. ScenTest tries to start automated testing by imitating human practices and integrating domain knowledge into scenario-based mobile app testing, realizing fully automated testing on target testing scenarios for the first time. ScenTest extracts four kinds of entities and five kinds of corresponding relationships from crowdsourced test reports, where the test events and app GUI information are presented, and constructs the EKGs for specific scenarios. Then, ScenTest conducts test generation for specific scenarios on different apps with the guidance of EKG with the combination consideration of app current state and testing context. We conduct an evaluation on ScenTest on different aspects. The results show that the test generation of ScenTest on the basis of EKG is effective, and ScenTest can reveal 80+ distinct real-world bugs in specific scenarios compared with representative baselines.

Scenario-based test case generation for state-based embedded systems

Test Case Generation for Embedded Software Using Interface Automata and Symbolic Execution

Method to Automatic Testcase Generation toward Safety Critical Scenarios of Cyber-physical Systems

Method of Automatic Test Case Generation for Safety-Critical Scenarios in Train Control Systems

Practical, Automated Scenario-based Mobile App Testing

Test Sequence Generation for Distributed Software System.

PTSG: a test generation tool based on extended finite state machine

A Test Scenario Automatic Generation Strategy for Intelligent Driving Systems

Test Scenario Generation for Context-Oriented Programs

A Test Case Design Method Based on Path Depth Coverage

A new SOTIF scenario hierarchy and its critical test case generation based on potential risk assessment.

Automated Test Case Generation for Embedded Software Using Extended Interface Automata

Test Case Generation for Train Communication Devices Based on Interface Automata

Test scenario generation method for autonomous vehicles based on combinatorial testing and Bayesian network

Regression Test Generation Approach Based on Tree-Structured Analysis

Test Scenario Generation and Optimization Technology for Intelligent Driving Systems

Scenario-Based Functional Regression Testing

EFSM-Based Test Case Generation: Sequence, Data, and Oracle

A New Approach of Automated Test Case Generation on Extended Finite State Machine