Abstract:Modern embedded systems execute applications, which interact with the operating system and hardware differently depending on the type of workload. These cross-layer interactions result in wide variations of the chip-wide thermal profile. In this article, a reinforcement learning-based runtime manager is proposed that guarantees application-specific performance requirements and controls the POSIX thread allocation and voltage/frequency scaling for energy-efficient thermal management. This controls three thermal aspects: peak temperature, average temperature, and thermal cycling. Contrary to existing learning-based runtime approaches that optimize energy and temperature individually, the proposed runtime manager is the first approach to combine the two objectives, simultaneously addressing all three thermal aspects. However, determining thread allocation and core frequencies to optimize energy and temperature is an NP-hard problem. This leads to exponential growth in the learning table (significant memory overhead) and a corresponding increase in the exploration time to learn the most appropriate thread allocation and core frequency for a particular application workload. To confine the learning space and to minimize the learning cost, the proposed runtime manager is implemented in a two-stage hierarchy: a heuristic-based thread allocation at a longer time interval to improve thermal cycling, followed by a learning-based hardware frequency selection at a much finer interval to improve average temperature, peak temperature, and energy consumption. This enables finer control on temperature in an energy-efficient manner while simultaneously addressing scalability, which is a crucial aspect for multi-/many-core embedded systems. The proposed hierarchical runtime manager is implemented for Linux running on nVidia’s Tegra SoC, featuring four ARM Cortex-A15 cores. Experiments conducted with a range of embedded and cpu-intensive applications demonstrate that the proposed runtime manager not only reduces energy consumption by an average 15% with respect to Linux but also improves all the thermal aspects—average temperature by 14°C, peak temperature by 16°C, and thermal cycling by 54%.

Adaptive and Hierarchical Runtime Manager for Energy-Aware Thermal Management of Embedded Systems

An Efficient and Flexible Learning Framework for Dynamic Power and Thermal Co-Management

Multi-core Chip Dynamic Power Management Framework Based on Reinforcement Learning br

Power-Aware Run-Time Scheduler for Mixed-Criticality Systems on Multi-Core Platform

Regulating CPU Temperature With Thermal-Aware Scheduling Using a Reduced Order Learning Thermal Model

Online Adaptive Learning for Runtime Resource Management of Heterogeneous SoCs

Application and Thermal-reliability-aware Reinforcement Learning Based Multi-core Power Management

Thermal-Aware Task Scheduling for Energy Minimization in Heterogeneous Real-Time MPSoC Systems.

Thermal-aware Correlated Two-Level Scheduling of Real-Time Tasks with Reduced Processor Energy on Heterogeneous MPSoCs

Temperature-aware Dynamic Optimization of Embedded Systems

Dynamic DNNs and Runtime Management for Efficient Inference on Mobile/Embedded Devices

Online Power Management for Multi-Cores: A Reinforcement Learning Based Approach

Performance-Aware Power Management in Embedded Controllers with Multiple-Voltage Processors

Thermal Safety and Real-Time Predictability on Heterogeneous Embedded SoC Platforms

An Evaluation Framework for Dynamic Thermal Management Strategies in 3D MultiProcessor System-on-Chip Co-Design

Learning-Directed Dynamic Voltage and Frequency Scaling Scheme with Adjustable Performance for Single-Core and Multi-Core Embedded and Mobile Systems

An Energy-Aware Runtime Management of Multi-Core Sensory Swarms

Efficient Implementation of Thermal-Aware Scheduler on a Quad-core Processor

Stochastic Thermal-Aware Real-Time Task Scheduling with Considerations of Soft Errors

NPU-Accelerated Imitation Learning for Thermal Optimization of QoS-Constrained Heterogeneous Multi-Cores

An Energy-Aware Online Learning Framework for Resource Management in Heterogeneous Platforms