Abstract:Software project scheduling is the problem of allocating employees to tasks in a software project. Due to the large scale of current software projects, many studies have investigated the use of optimization algorithms to find good software project schedules. However, despite the importance of human factors to the success of software projects, existing work has considered only a limited number of human properties when formulating software project scheduling as an optimization problem. Moreover, the changing environments of software companies mean that software project scheduling is a dynamic optimization problem. However, there is a lack of effective dynamic scheduling approaches to solve this problem. This work proposes a more realistic mathematical model for the dynamic software project scheduling problem. This model considers that skill proficiency can improve over time and, different from previous work, it considers that such improvement is affected by the employees’ properties of motivation and learning ability, and by the skill difficulty. It also defines the objective of employees’ satisfaction with the allocation. It is considered together with the objectives of project duration, cost, robustness and stability under a variety of practical constraints. To adapt schedules to the dynamically changing software project environments, a multi-objective two-archive memetic algorithm based on Q-learning (MOTAMAQ) is proposed to solve the problem in a proactive-rescheduling way. Different from previous work, MOTAMAQ learns the most appropriate global and local search methods to be used for different software project environment states by using Q-learning. Extensive experiments on 18 dynamic benchmark instances and 3 instances derived from real-world software projects were performed. A comparison with seven other meta-heuristic algorithms shows that the strategies used by our novel approach are very effective in improving its convergence performance in dynamic environments, while maintaining a good distribution and spread of solutions. The Q-learning-based learning mechanism can choose appropriate search operators for the different scheduling environments. We also show how different trade-offs among the five objectives can provide software managers with a deeper insight into various compromises among many objectives, and enabling them to make informed decisions.

Multi-Step Q Learning Algorithm for Task Scheduling in Collaborative Design

Knowledge Update in a Knowledge-Based Dynamic Scheduling Decision System

A Self-adaptive Knowledge Based Dynamic Scheduling Decision Mechanism

Distributed Scheduling Algorithm for Multiple Task Flows Based on Q-learning

Application of Improved Q Learning Algorithm to Job Shop Problem

Double-Learning-Strategy-Based Evolutionary Algorithm for Scheduling Multiobjective Distributed Assembly Permutation Flowshops with Setup Time

Q-Learning Based Optimisation Framework for Real-Time Mixed-Task Scheduling

An Adaptive Multi-Objective Multi-Task Scheduling Method by Hierarchical Deep Reinforcement Learning

A Multi-step Q Reinforcement Learning Algorithm

A Q-learning-based memetic algorithm for multi-objective dynamic software project scheduling

Multi-Agent Reinforcement Learning for Extended Flexible Job Shop Scheduling

Dynamic parallel machine scheduling with mean weighted tardiness objective by Q-Learning

An Interoperable Adaptive Scheduling Strategy for Knowledgeable Manufacturing Based on SMGWQ-learning

Scheduling Multiobjective Dynamic Surgery Problems via $Q$-Learning-Based Meta-Heuristics

Qsmix: Q-learning-based task scheduling approach for mixed-critical applications on heterogeneous multi-cores

Multi-Objective Q-Learning-Based Brain Storm Optimization for Integrated Distributed Flow Shop and Distribution Scheduling Problems

A Hybrid Method of Qualitative and Quantitative Analysis for Task Scheduling

Energy-efficient Multi-objective Distributed Assembly Permutation Flowshop Scheduling by Q-learning Based Meta-heuristics

Multi-Objective Flexible Flow Shop Production Scheduling Problem Based on the Double Deep Q-Network Algorithm

Dynamic flexible scheduling with transportation constraints by multi-agent reinforcement learning

Multi-Objective Workflow Scheduling With Deep-Q-Network-Based Multi-Agent Reinforcement Learning.