Abstract:Time-triggered (TT) communication has long been studied in various industrial domains. The most challenging task of TT communication is to find a feasible schedule table. Network changes are inevitable due to the topology dynamics, varying data transmission requirements, etc. Once changes occur, the schedule table needs to be re-calculated in a timely manner. Solver-based methods and heuristic-based methods were proposed to solve this problem. However, solver-based methods employ integer linear programming (ILP) or satisfiability modulo theories (SMT) which have high computational complexity. On the other hand, heuristic-based methods are fast, but they need to be handcrafted based on the application characteristics. Thus, these methods are not general enough to work in complex scenarios especially in large networks.In this paper we propose DRLS – Deep Reinforcement Learning based TT Scheduling method. DRLS first trains an application or network specific scheduling agent offline. Then, the agent can be used for online scheduling of TT flows. However, off-the-shelf reinforcement learning techniques cannot handle the TT scheduling problem with typical complexity and scale. DRLS provides novel solutions to this challenge, including three key innovations: new representations for TT network adapted to various topologies, proper deep neural network (DNN) structures to capture network characteristics, and scalable reinforcement learning (RL) models to handle online TT scheduling. Comprehensive experiments have been conducted to compare the performance of DRLS and other methods (heuristics-based methods such as HLS, LS, HLD + LD, LS + LD, and ILP-based method). The results show that DRLS can not only adapt to specific network topologies, but also have better performance: runs much faster than ILP solver-based methods, and schedules about 23.9% more flows than traditional handcrafted heuristic-based methods.

A DRL Based Real-time Computing Load Scheduling Method.

Deep reinforcement learning task scheduling method based on server real-time performance

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

Deep Reinforcement Learning-Based Workload Scheduling for Edge Computing

Deep reinforcement learning-based resource scheduling for energy optimization and load balancing in SDN-driven edge computing

A DRL-based online real-time task scheduling method with ISSA strategy

DeepLRA: An Efficient Long Running Application Scheduling Framework with Deep Reinforcement Learning in the Cloud.

Multi-agent Deep Reinforcement Learning for Dynamic Reconfigurable Shop Scheduling Considering Batch Processing and Worker Cooperation

A3C-DO: A Regional Resource Scheduling Framework Based on Deep Reinforcement Learning in Edge Scenario

Deep Reinforcement Learning-based scheduling for optimizing system load and response time in edge and fog computing environments

Scheduling of decentralized robot services in cloud manufacturing with deep reinforcement learning

A New Approach for Resource Scheduling with Deep Reinforcement Learning

DRLS: A Deep Reinforcement Learning Based Scheduler for Time-Triggered Ethernet

Real-time production scheduling using a deep reinforcement learning-based multi-agent approach

Online simulation task scheduling in cloud manufacturing with cross attention and deep reinforcement learning

DRL-Scheduling: an Intelligent QoS-Aware Job Scheduling Framework for Applications in Clouds

Deep Reinforcement Learning for Scheduling in an Edge Computing-Based Industrial Internet of Things

Deep reinforcement learning for dynamic distributed job shop scheduling problem with transfers

Solving task scheduling problems in cloud manufacturing via attention mechanism and deep reinforcement learning

Adaptive DRL-Based Task Scheduling for Energy-Efficient Cloud Computing

Deep Reinforcement Learning-Based Task Scheduling in IoT Edge Computing