Abstract:With the increasing application of IoT devices, the memory subsystem, as the performance and energy bottleneck of IoT systems, has received a lot of attention. One of the keys is on-chip memory which can bridge the performance gap between the CPU and main memory. While many off-the-shelf embedded processors utilize the hybrid on-chip memory architecture containing scratchpad memories (SPMs) and caches, most existing literature ignores the collaboration between caches and SPMs. This paper proposes static SPM allocation strategies for the architecture mentioned above in IoT systems, which try to minimize the overall instruction memory subsystem latency and/or energy consumption. We capture the intra- and inter-task cache conflict misses via a fine-grained temporal cache behavior model. Based on this cache conflict information, we propose an integer linear programming (ILP) algorithm to generate an optimal static function level SPM allocation for system performance. Furthermore, to improve the scalability of the proposed allocation scheme for an enormous task set, we offer the interference factor to calculate the interference impact quantitatively. Then, based on the interference factor, we present two approximate knapsack based heuristic algorithms to provide near optimal static allocation schemes at both function- and basic block-level granularities, which favors fast design space exploration. The experiment results demonstrate that the proposed solution achieves a 30.85% improvement in memory performance, and up to 31.39% reduction in energy consumption, compared to the existing SPM allocation scheme at the function level. In addition, the proposed basic block level allocation algorithm shows better performance than our function level allocation algorithm and other basic block level allocation algorithm.

IPULOC - Exploring Dynamic Program Locality with the Instruction Processing Unit for Filling Memory Gap.

Lookahead Cache with Instruction Processing Unit for Filling Memory Gap

Exploring dynamic program locality with Lookahead Cache for filling memory gap

A General Offloading Approach for Near-DRAM Processing-In-Memory Architectures

BTIP: Branch Triggered Instruction Prefetcher Ensuring Timeliness

Locality Protected Dynamic Cache Allocation Scheme on GPUs

A$^3$PIM: An Automated, Analytic and Accurate Processing-in-Memory Offloader

Locality-protected Cache Allocation Scheme with Low Overhead on GPUs.

LWSDP: Locality-Aware Warp Scheduling and Dynamic Data Prefetching Co-design in the Per-SM Private Cache of GPGPUs

A^3PIM: an Automated, Analytic and Accurate Processing-in-Memory Offloader

IBOM: an Integrated and Balanced On-Chip Memory for High Performance GPGPUs

A Low-Leakage Pipelined Instruction Cache Design

Optimization to Prevent Cache Penalty by Loop Partition and Loop Unrolling

Improved Procedure Placement for Set Associative Caches

Re-Cache: Mitigating Cache Contention by Exploiting Locality Characteristics with Reconfigurable Memory Hierarchy for GPGPUs.

Aap And Aapm: Improved Prefetching Structures Of The L2 Cache

A Pollution Alleviative L2 Cache Replacement Policy for Chip Multiprocessor Architecture

Design of L2 CACHE Replacement Arithmetic for Chip Multiprocessor Architecture

Global Data Access Optimization Via Load/Store Instruction Extension

Management Policies Analysis for Multi-core Shared Caches

Optimizing Code Allocation for Hybrid On-Chip Memory in Iot Systems