Abstract:Actual manufacturing process scheduling in enterprise alliances are multi-task scheduling problems involving dynamic factors, and the competition and conflict for manufacturing resources also exist between multi-tasks. How to perform adaptive multi-objective scheduling of multi-tasks based on the real-time state of the manufacturing environment becomes critical. Therefore, this paper constructs an adaptive multi-task multi-objective scheduling considering resource competition and conflict among tasks (AMMS-RCCT) model based on the enterprise alliance value net, and adopts a hybrid strategy of “parallel+serial” to resolve conflicts while reducing the waiting time of tasks. With the objective of optimizing the total manufacturing time and total manufacturing cost, an adaptive multi-objective deep Q network (AMDQN) is proposed to solve the AMMS-RCCT model. AMDQN is based on a two-hierarchy deep reinforcement learning architecture containing a front controller deep Q network (C-DQN) and a back actuator deep Q network (A-DQN), which performs hierarchical decision-making on optimization objectives and scheduling rules to achieve compromise between multiple objectives while reducing the complexity for optimal selection scheduling rules. For the two optimization objectives of time and cost, two reward algorithms are proposed by introducing two metrics, the estimated tardiness rate and the estimated overspend rate, which guide the A-DQN to learn and adjust the scheduling rules according to the state changes. Besides, nine composite scheduling rules are designed to adapt to the dynamic manufacturing environment from multiple dimensions such as task urgency and completion rate as well as manufacturing resource utilization and cost. Finally, AMDQN is experimentally compared with the proposed nine composite scheduling rules, scheduling rules in existing research, and other scheduling methods based on reinforcement learning in simulated manufacturing environments with different numbers of tasks, subtasks, and manufacturing cells. The experimental results verify the effectiveness and superiority of AMDQN for multi-objective adaptive scheduling in multi-task scheduling problems.

Adaptive Multi-Core Real- Time Scheduling Based on Reinforcement Learning

Allocation and Scheduling of Strictly Periodic Tasks in Multi-core Real-Time Systems

Scheduling Non-Preemptive Tasks with Strict Periods in Multi-Core Real-Time Systems

DRL-based Task Scheduling and Shared Resource Allocation for Multi-Core Real-Time Systems

Reinforcement Learning for Adaptive Resource Scheduling in Complex System Environments

A Temporal Dependency Aware Approach for Scheduling Real-Time Tasks on Multi-Core Platforms.

Schedulability Analysis of Non-Preemptive Strictly Periodic Tasks in Multi-Core Real-Time Systems

Developing Real-Time Scheduling Policy by Deep Reinforcement Learning

An Adaptive Multi-Objective Multi-Task Scheduling Method by Hierarchical Deep Reinforcement Learning

A Resource-efficient Task Scheduling System using Reinforcement Learning : Invited Paper

A Deep Reinforcement Learning Scheduling Algorithm for Heterogeneous Tasks on Heterogeneous Multi-Core Processors

Online Scheduling for Multi-Core Shared Reconfigurable Fabric

On-demand Real-Time Scheduling Strategy for CNC System Based on Embedded Multi-Core Processor

A Shared Cache-Aware Hybrid Real-Time Scheduling on Multicore Platform with Hierarchical Cache

Multi-Task Multi-Agent Reinforcement Learning for Real-Time Scheduling of a Dual-Resource Flexible Job Shop with Robots

A Scheduling Algorithm Based on Reinforcement Learning for Heterogeneous Environments.

Deep learning task scheduling method based on reinforcement learning

Efficient Tasks Scheduling in Multicore Systems Integrated with Hardware Accelerators

Building Real-Time Parallel Task Systems on Multi-Cores: A Hierarchical Scheduling Approach.

A Heuristic Task Periods Selection Algorithm for Real-Time Control Systems on a Multi-Core Processor

An Optimized RM Algorithm by Task Affinity on Multi-Core Processor