Abstract:International Journal of Software Engineering and Knowledge Engineering, Ahead of Print. Continuous automated testing throughout each cycle can ensure the security of the continuous integration (CI) development lifecycle. Test case prioritization (TCP) is a critical factor in optimizing automated testing, which prioritizes potentially failed test cases and improves the efficiency of automated testing. In CI automated testing, the TCP is a continuous decision-making process that can be solved with reinforcement learning (RL). RL-based CITCP can continuously generate a TCP strategy for each CI development lifecycle, with the reward mechanism as the core. The reward mechanism consists of the reward function and the reward strategy. However, there are new challenges to RL-based CITCP in real-industry CI testing. With high-frequency iteration, the reward function is often calculated with a fixed length of historical information, ignoring the spatial characteristics of the current cycle. Therefore, the dynamic time window (DTW)-based reward function is proposed to perform the reward calculation, which adaptively adjusts the recent historical information range based on the integration cycle. Moreover, with low-failure testing, the reward strategy usually only rewards failure test cases, which creates a sparse reward problem in RL. To address this issue, the similarity-based reward strategy is proposed, which increases the reward objects of some passed test cases, similar to the failure test cases. The DTW-based reward function and the similarity-based reward strategy together constitute the proposed adaptive reward mechanism in RL-based CITCP. To validate the effectiveness of the adaptive reward mechanism, experimental verification is carried out on 13 industrial data sets. The experimental results show that the adaptive reward mechanism can improve the TCP effect, where the average NAPFD is maximally improved by 7.29%, the average Recall is maximally improved by 6.04% and the average TTF is improved by 6.81 positions with a maximum of 63.77.

A Self-attention Agent of Reinforcement Learning in Continuous Integration Testing.

Historical Information Stability Based Reward for Reinforcement Learning in Continuous Integration Testing

A Time Window based Reinforcement Learning Reward for Test Case Prioritization in Continuous Integration

Focus on New Test Cases in Continuous Integration Testing Based on Reinforcement Learning

Reinforcement Learning for Test Case Prioritization

A systematic study of reward for reinforcement learning based continuous integration testing

Dynamic Time Window Based Reward for Reinforcement Learning in Continuous Integration Testing.

Adaptive Reward Computation in Reinforcement Learning-Based Continuous Integration Testing

A Generative Adversarial Imitation Learning Method for Continuous Integration Testing

Weighted Reward for Reinforcement Learning based Test Case Prioritization in Continuous Integration Testing

Security Development Lifecycle-Based Adaptive Reward Mechanism for Reinforcement Learning in Continuous Integration Testing Optimization

Sparse Reward for Reinforcement Learning‐based Continuous Integration Testing

Automated Feature Selection: A Reinforcement Learning Perspective

Self-attention-based multi-agent continuous control method in cooperative environments

Multi-Agent Reinforcement Learning-Based Autonomous Intersection Management Protocol with Attention Mechanism

Revisiting Machine Learning based Test Case Prioritization for Continuous Integration

Automating Feature Subspace Exploration via Multi-Agent Reinforcement Learning

Learning to Discover Task-Relevant Features for Interpretable Reinforcement Learning

Towards Brain-inspired System: Deep Recurrent Reinforcement Learning for Simulated Self-driving Agent

Learning for Test Prioritization: an Industrial Case Study

DeepOrder: Deep Learning for Test Case Prioritization in Continuous Integration Testing