Abstract:The computational capability of a coarse-grained reconfigurable array(CGRA)can be significantly restrained due to data and context memory bandwidth bottlenecks.Traditionally,two methods have been used to resolve this problem.One method loads the context into the CGRA at run time.This method occupies very small on-chip memory but induces very large latency,which leads to low computational efficiency.The other method adopts a multi-context structure.This method loads the context into the on-chip context memory at the boot phase.Broadcasting the pointer of a set of contexts changes the hardware configuration on a cycle-by-cycle basis.The size of the context memory induces a large area overhead in multi-context structures,which results in major restrictions on application complexity.This paper proposes a Predictable Context Cache(PCC)architecture to address the above context issues by buffering the context inside a CGRA.In this architecture,context is dynamically transferred into the CGRA.Utilizing a PCC significantly reduces the on-chip context memory and the complexity of the applications running on the CGRA is no longer restricted by the size of the on-chip context memory.Data preloading is the most frequently used approach to hide input data latency and speed up the data transmission process for the data bandwidth issue.Rather than fundamentally reducing the amount of input data,the transferred data and computations are processed in parallel.However,the data preloading method cannot work efficiently because data transmission becomes the critical path as the reconfigurable array scale increases.This paper also presents a Hierarchical Data Memory(HDM)architecture as a solution to the efficiency problem.In this architecture,high internal bandwidth is provided to buffer both reused input data and intermediate data.The HDM architecture relieves the external memory from the data transfer burden so that the performance is significantly improved.As a result of using PCC and HDM,experiments running mainstream video decoding programs achieved performance improvements of 13.57%–19.48%when there was a reasonable memory size.Therefore,1080p@35.7fps for H.264high profile video decoding can be achieved on PCC and HDM architecture when utilizing a 200 MHz working frequency.Further,the size of the on-chip context memory no longer restricted complex applications,which were efficiently executed on the PCC and HDM architecture.

Data Cache Prefetching Via Context Directed Pattern Matching for Coarse-Grained Reconfigurable Arrays

CDPM: Context-Directed Pattern Matching Prefetching to Improve Coarse-Grained Reconfigurable Array Performance.

CRP: Context-directed Replacement Policy to Improve Cache Performance for Coarse-Grained Reconfigurable Arrays

Efficient and Flexible Memory Architecture to Alleviate Data and Context Bandwidth Bottlenecks of Coarse-Grained Reconfigurable Arrays

DEAM：Decoupled, Expressive, Area-Efficient Metadata Cache

Exploring DRAM Cache Prefetching for Pooled Memory

Cost-Effective Memory Architecture to Achieve Flexible Configuration and Efficient Data Transmission for Coarse-Grained Reconfigurable Array (Abstract Only).

CIACP: A Correlation- and Iteration- Aware Cache Partitioning Mechanism to Improve Performance of Multiple Coarse-Grained Reconfigurable Arrays.

Exploring Data Prefetching Mechanisms for Last Level Cache in Chip Multi-Processors

Configuration Approaches to Enhance Computing Efficiency of Coarse-Grained Reconfigurable Array.

Data dependency aware prefetch scheduling for Dynamic Partial reconfigurable designs

Prefetching Techniques for STT-RAM Based Last-Level Cache in CMP Systems

PCG: Mitigating Conflict-based Cache Side-channel Attacks with Prefetching

An Approach to Data Prefetching Using 2-Dimensional Selection Criteria

On-chip cache prefetch mechanism which drives data memory access mode matching according to configuration information

Combining Memory Partitioning and Subtask Generation for Parallel Data Access on CGRAs

Re-Cache: Mitigating Cache Contention by Exploiting Locality Characteristics with Reconfigurable Memory Hierarchy for GPGPUs.

Accelerating Graph Analytics on a Reconfigurable Architecture with a Data-Indirect Prefetcher

Gaze into the Pattern: Characterizing Spatial Patterns with Internal Temporal Correlations for Hardware Prefetching

Helper Without Threads: Customized Prefetching for Delinquent Irregular Loads

RL-CoPref: a reinforcement learning-based coordinated prefetching controller for multiple prefetchers