Abstract:On-chip distributed memory has emerged as a promising memory organization for future many-core systems, since it efficiently exploits memory level parallelism and can lighten off the load on each memory module by providing a comparable number of memory interfaces with on-chip cores. The packet-based memory access model (PDMA) has provided a scalable and flexible solution for distributed memory management, but suffers from complicated and costly on-chip network protocol translation and massive interferences among packets, which leads to unpredictable performance. In this paper we propose a direct distributed memory access (DDMA) model, in which remote memory can be directly accessed by local cores via remote-to-local virtualization, without network protocol translation. From the perspective of local cores, remote memory controllers (MC) can be directly manipulated through accessing the local agent MC, which is responsible for accessing remote memory through high-performance inter-tile communication. We further discuss some detailed architecture supports for the DDMA model, including the memory interface design, work flow and the protocols involved. Simulation results of executing PARSEC benchmarks show that our DDMA architecture outperforms PDMA in terms of both average memory access latency and IPC by 17.8% and 16.6% respectively on average. Besides, DDMA can better manage congested memory traffic, since a reduction of bandwidth in running memory-intensive SPEC2006 workloads only incurs 18.9% performance penalty, compared with 38.3% for PDMA.

Affinity-aware DMA Buffer Management for Reducing Off-Chip Memory Access

DEAM：Decoupled, Expressive, Area-Efficient Metadata Cache

MCS-DMA:An Optimization Design of Memory Controller for DMA Transfers in SoC

MCS-DMA: An optimization design of memory controller for DMA transfers in SoC

Memory Affinity: Balancing Performance, Power, Thermal and Fairness for Multi-core Systems

Improving System Performance in Heterogeneous MPSoC Systems via Dynamic DRAM Bandwidth Allocation

Design and Implementation of an AHB-based High-Speed Memory Access Layer

Banshee: Bandwidth-Efficient DRAM Caching Via Software/Hardware Cooperation

DMA-assisted I/O for Persistent Memory

DPA: Demand-Based Partition and Data Allocation for Hybrid On-Chip Memory

Rethinking Programmed I/O for Fast Devices, Cheap Cores, and Coherent Interconnects

A High-performance, Energy-efficient Modular DMA Engine Architecture

TBuffer: Constructing a Tail Buffer in DRAM for Flash-Based Main Memory System

Direct Distributed Memory Access for CMPs

Efficient Utilization of Scratch-Pad Memory Banks

A Spatial and Temporal Locality-Aware Adaptive Cache Design with Network Optimization for Tiled Many-Core Architectures.

EMBA: Efficient Memory Bandwidth Allocation to Improve Performance on Intel Commodity Processor

Design and implementation of an advanced DMA controller on AMBA-based SoC

Low-Power Low-Latency Data Allocation for Hybrid Scratch-Pad Memory

LLC Buffer for Arbitrary Data Sharing in Heterogeneous Systems.