Abstract:Due to the importance of Android app quality assurance, many Android UI testing tools have been developed by researchers over the years. However, recent studies show that these tools typically achieve low code coverage on popular industrial apps. In fact, given a reasonable amount of run time, most state-of-the-art tools cannot even outperform a simple tool, Monkey, on popular industrial apps with large codebases and sophisticated functionalities. Our motivating study finds that these tools perform two types of operations, UI Hierarchy Capturing (capturing information about the contents on the screen) and UI Event Execution (executing UI events, such as clicks), often inefficiently using UIAutomator, a component of the Android framework. In total, these two types of operations use on average 70% of the given test time. Based on this finding, to improve the effectiveness of Android testing tools, we propose TOLLER, a tool consisting of infrastructure enhancements to the Android operating system. TOLLER injects itself into the same virtual machine as the app under test, giving TOLLER direct access to the app’s runtime memory. TOLLER is thus able to directly (1) access UI data structures, and thus capture contents on the screen without the overhead of invoking the Android framework services or remote procedure calls (RPCs), and (2) invoke UI event handlers without needing to execute the UI events. Compared with the often-used UIAutomator, TOLLER reduces average time usage of UI Hierarchy Capturing and UI Event Execution operations by up to 97% and 95%, respectively. We integrate TOLLER with existing state-of-the-art/practice Android UI testing tools and achieve the range of 11.8% to 70.1% relative code coverage improvement on average. We also find that TOLLER-enhanced tools are able to trigger 1.4x to 3.6x distinct crashes compared with their original versions without TOLLER enhancement. These improvements are so substantial that they also change the relative competitiveness of the tools under empirical comparison. Our findings highlight the practicality of TOLLER as well as raising the community awareness of infrastructure support’s significance beyond the community’s existing heavy focus on algorithms.

OAT: an Optimized Android Testing Framework Based on Reinforcement Learning

A reinforcement learning-based approach to testing GUI of moblie applications

Deeply Reinforcing Android GUI Testing with Deep Reinforcement Learning.

Deep Reinforcement Learning for Black-Box Testing of Android Apps

Iterative Android Automated Testing

Reinforcement Learning Based Curiosity-Driven Testing of Android Applications

OCAT: object capture-based automated testing.

Leveraging Android Automated Testing to Assist Crowdsourced Testing

Guided, stochastic model-based GUI testing of Android apps

An Infrastructure Approach to Improving Effectiveness of Android UI Testing Tools

Hawkeye: Change-targeted Testing for Android Apps based on Deep Reinforcement Learning

Practical GUI Testing of Android Applications Via Model Abstraction and Refinement

AimDroid: Activity-Insulated Multi-level Automated Testing for Android Applications

Reinforcement Learning-Driven Test Generation for Android GUI Applications using Formal Specifications

ReTestDroid: Towards Safer Regression Test Selection for Android Application.

RobOT: Robustness-Oriented Testing for Deep Learning Systems

Learning-Replay Based Automated Robotic Testing for Mobile App

Auto-RT: Automatic Jailbreak Strategy Exploration for Red-Teaming Large Language Models

Effective, Platform-Independent GUI Testing via Image Embedding and Reinforcement Learning

DroidGamer: Android Game Testing with Operable Widget Recognition by Deep Learning*

A Context-Aware Approach for Dynamic GUI Testing of Android Applications.