Abstract:In this paper, we~present a novel scheduling solution for a class of System-on-Chip (SoC) systems where heterogeneous chip resources (DSP, FPGA, GPU, etc.) must be efficiently scheduled for continuously arriving hierarchical jobs with their tasks represented by a directed acyclic graph. Traditionally, heuristic algorithms have been widely used for many resource scheduling domains, and Heterogeneous Earliest Finish Time (HEFT) has been a dominating state-of-the-art technique across a broad range of heterogeneous resource scheduling domains over many years. Despite their long-standing popularity, HEFT-like algorithms are known to be vulnerable to a small amount of noise added to the environment. Our Deep Reinforcement Learning (DRL)-based SoC Scheduler (DeepSoCS), capable of learning the "best" task ordering under dynamic environment changes, overcomes the brittleness of rule-based schedulers such as HEFT with significantly higher performance across different types of jobs. We~describe a DeepSoCS design process using a real-time heterogeneous SoC scheduling emulator, discuss major challenges, and present two novel neural network design features that lead to outperforming HEFT: (i) hierarchical job- and task-graph embedding; and (ii) efficient use of real-time task information in the state space. Furthermore, we~introduce effective techniques to address two fundamental challenges present in our environment: delayed consequences and joint actions. Through an extensive simulation study, we~show that our DeepSoCS exhibits the significantly higher performance of job execution time than that of HEFT with a higher level of robustness under realistic noise conditions. We~conclude with a discussion of the potential improvements for our DeepSoCS neural scheduler.

DRL-based Task Scheduling and Shared Resource Allocation for Multi-Core Real-Time Systems

Allocation and Scheduling of Strictly Periodic Tasks in Multi-core Real-Time Systems

Adaptive Multi-Core Real- Time Scheduling Based on Reinforcement Learning

H2O-Cloud: A Resource and Quality of Service-Aware Task Scheduling Framework for Warehouse-Scale Data Centers -- A Hierarchical Hybrid DRL (Deep Reinforcement Learning) based Approach

Research and Design of Shared Resources Competition Solution among Hardware-Software Tasks Based on Unified Scheduling

Holistic Resource Allocation Under Federated Scheduling for Parallel Real-time Tasks

Multicore real-time task allocation algorithms with shared resource constraints

DeepSoCS: A Neural Scheduler for Heterogeneous System-on-Chip (SoC) Resource Scheduling

Research on Parallel Real-Time Scheduling Algorithm of Hybrid Parameter Tasks on Multi-Core Platform

Resource-Aware Scheduling for Dependable Multicore Real-Time Systems: Utilization Bound and Partitioning Algorithm.

A DRL-based online real-time task scheduling method with ISSA strategy

Real-Time Partitioned Scheduling: Exploiting The Inter-Resource Affinity For Task Allocation On Multiprocessors

Online Task Scheduling for Fog Computing with Multi-Resource Fairness

Efficient Tasks Scheduling in Multicore Systems Integrated with Hardware Accelerators

Real-Time Scheduling and Analysis of Parallel Tasks on Heterogeneous Multi-Cores

Real-time Task Scheduling for FPGA-based Multicore Systems with Communication Delay

An Independent Task Scheduling Algorithm in Heterogeneous Multi-core Processor Environment

Blocking-Aware Partitioned Real-Time Scheduling for Uniform Heterogeneous Multicore Platforms

Multiprocessor Real-Time Systems with Shared Resources: Utilization Bound and Mapping.

Energy-Efficient Scheduling of Real-Time Tasks on Heterogeneous Multicores Using Task Splitting

A Deep Reinforcement Learning Scheduling Algorithm for Heterogeneous Tasks on Heterogeneous Multi-Core Processors