Abstract:With the increasing application of IoT devices, the memory subsystem, as the performance and energy bottleneck of IoT systems, has received a lot of attention. One of the keys is on-chip memory which can bridge the performance gap between the CPU and main memory. While many off-the-shelf embedded processors utilize the hybrid on-chip memory architecture containing scratchpad memories (SPMs) and caches, most existing literature ignores the collaboration between caches and SPMs. This paper proposes static SPM allocation strategies for the architecture mentioned above in IoT systems, which try to minimize the overall instruction memory subsystem latency and/or energy consumption. We capture the intra- and inter-task cache conflict misses via a fine-grained temporal cache behavior model. Based on this cache conflict information, we propose an integer linear programming (ILP) algorithm to generate an optimal static function level SPM allocation for system performance. Furthermore, to improve the scalability of the proposed allocation scheme for an enormous task set, we offer the interference factor to calculate the interference impact quantitatively. Then, based on the interference factor, we present two approximate knapsack based heuristic algorithms to provide near optimal static allocation schemes at both function- and basic block-level granularities, which favors fast design space exploration. The experiment results demonstrate that the proposed solution achieves a 30.85% improvement in memory performance, and up to 31.39% reduction in energy consumption, compared to the existing SPM allocation scheme at the function level. In addition, the proposed basic block level allocation algorithm shows better performance than our function level allocation algorithm and other basic block level allocation algorithm.

An Efficient Logic Operation Scheduler for Minimizing Memory Footprint of In-Memory SIMD Computation

A Recursive Partition-Based In-Memory SIMD Computation Scheduler for Memory Footprint Minimization

MASIM: An Efficient Multi-Array Scheduler for In-Memory SIMD Computation

High-Quality Iterative Logic Compiler for In-Memory SIMD Computation with Tight Coupling of Synthesis and Scheduling

Optimal Partitioning under Memory Constraints for Minimizing Average Schedule Length

Minimizing Average Schedule Length under Memory Constraints by Optimal Partitioning and Prefetching

Memory Partitioning and Scheduling Co-Optimization in Behavioral Synthesis

Memory fartitioning-based modulo scheduling for high-level synthesis.

An Energy-Efficient Instruction Scheduler Design with Two-Level Shelving and Adaptive Banking

Effective Loop Partitioning and Scheduling under Memory and Register Dual Constraints

Minimizing Access Cost for Multiple Types of Memory Units in Embedded Systems Through Data Allocation and Scheduling

Efficient Task Assignment And Scheduling On Mpsoc With Stt-Ram Based Hybrid Spms Considering Data Allocation

Optimal scheduling to minimize non-volatile memory access time with hardware cache

Design and Realization of an Optimized Memory Access Scheduler

Minimizing Write Operation for Multi-Dimensional DSP Applications Via a Two-Level Partition Technique with Complete Memory Latency Hiding

Optimizing Code Allocation for Hybrid On-Chip Memory in Iot Systems

Memory Access Schedule Minimization for Embedded Systems

Share Memory Aware Scheduler

Scheduling to Optimize Cache Utilization for Non-Volatile Main Memories.

Iterational retiming with partitioning

Iterational retiming with partitioning: Loop scheduling with complete memory latency hiding