Abstract:International Journal of Software Engineering and Knowledge Engineering, Ahead of Print. Continuous automated testing throughout each cycle can ensure the security of the continuous integration (CI) development lifecycle. Test case prioritization (TCP) is a critical factor in optimizing automated testing, which prioritizes potentially failed test cases and improves the efficiency of automated testing. In CI automated testing, the TCP is a continuous decision-making process that can be solved with reinforcement learning (RL). RL-based CITCP can continuously generate a TCP strategy for each CI development lifecycle, with the reward mechanism as the core. The reward mechanism consists of the reward function and the reward strategy. However, there are new challenges to RL-based CITCP in real-industry CI testing. With high-frequency iteration, the reward function is often calculated with a fixed length of historical information, ignoring the spatial characteristics of the current cycle. Therefore, the dynamic time window (DTW)-based reward function is proposed to perform the reward calculation, which adaptively adjusts the recent historical information range based on the integration cycle. Moreover, with low-failure testing, the reward strategy usually only rewards failure test cases, which creates a sparse reward problem in RL. To address this issue, the similarity-based reward strategy is proposed, which increases the reward objects of some passed test cases, similar to the failure test cases. The DTW-based reward function and the similarity-based reward strategy together constitute the proposed adaptive reward mechanism in RL-based CITCP. To validate the effectiveness of the adaptive reward mechanism, experimental verification is carried out on 13 industrial data sets. The experimental results show that the adaptive reward mechanism can improve the TCP effect, where the average NAPFD is maximally improved by 7.29%, the average Recall is maximally improved by 6.04% and the average TTF is improved by 6.81 positions with a maximum of 63.77.

DRIFT: Deep Reinforcement Learning for Functional Software Testing

DRIFT: Deep Reinforcement Learning for Intelligent Floating Platforms Trajectories

A Comparison of Reinforcement Learning Frameworks for Software Testing Tasks

Augmenting Automated Game Testing with Deep Reinforcement Learning

BDD-Based Framework with RL Integration: An approach for videogames automated testing

Deep Reinforcement Learning for Black-Box Testing of Android Apps

UniRLTest: Universal Platform-Independent Testing with Reinforcement Learning Via Image Understanding

Deeply Reinforcing Android GUI Testing with Deep Reinforcement Learning.

FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance

Using Reinforcement Learning for Load Testing of Video Games

Coverage-guided fuzzing for deep reinforcement learning systems

DeepQTest: Testing Autonomous Driving Systems with Reinforcement Learning and Real-world Weather Data

RLTF: Reinforcement Learning from Unit Test Feedback

Comprehensive Training and Evaluation on Deep Reinforcement Learning for Automated Driving in Various Simulated Driving Maneuvers

Security Development Lifecycle-Based Adaptive Reward Mechanism for Reinforcement Learning in Continuous Integration Testing Optimization

FIRE: A Failure-Adaptive Reinforcement Learning Framework for Edge Computing Migrations

Reinforcement Learning for Online Testing of Autonomous Driving Systems: a Replication and Extension Study

TRAINIFY: A CEGAR-Driven Training and Verification Framework for Safe Deep Reinforcement Learning

Reference-Free Formula Drift with Reinforcement Learning: From Driving Data to Tire Energy-Inspired, Real-World Policies

Reinforcement Learning for Safety Testing: Lessons from A Mobile Robot Case Study

Drift to Remember