Abstract:Recent dual in-line memory modules (DIMMs) are starting to support processing-in-memory (PIM) by associating their memory banks with processing elements (PEs), allowing applications to overcome the data movement bottleneck by offloading memory-intensive operations to the PEs. Many highly parallel applications have been shown to benefit from these PIM-enabled DIMMs, but further speedup is often limited by the huge overhead of inter-PE communication. This mainly comes from the slow CPU-mediated inter-PE communication methods which incurs significant performance overheads, making it difficult for PIM-enabled DIMMs to accelerate a wider range of applications. Prior studies have tried to alleviate the communication bottleneck, but they lack enough flexibility and performance to be used for a wide range of applications. In this paper, we present PID-Comm, a fast and flexible collective inter-PE communication framework for commodity PIM-enabled DIMMs. The key idea of PID-Comm is to abstract the PEs as a multi-dimensional hypercube and allow multiple instances of collective inter-PE communication between the PEs belonging to certain dimensions of the hypercube. Leveraging this abstraction, PID-Comm first defines eight collective inter-PE communication patterns that allow applications to easily express their complex communication patterns. Then, PID-Comm provides high-performance implementations of the collective inter-PE communication patterns optimized for the DIMMs. Our evaluation using 16 UPMEM DIMMs and representative parallel algorithms shows that PID-Comm greatly improves the performance by up to 4.20x compared to the existing inter-PE communication implementations. The implementation of PID-Comm is available at

MOPED: Accelerating Data Communication on Future CMPs

Moped: Orchestrating Interprocess Message Data On Cmps

DEAM：Decoupled, Expressive, Area-Efficient Metadata Cache

Non-orthogonal Multiple Access Assisted Mobile Edge Computing Via Device-to-Device Communications

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

Accelerating Data Movement on Future Chip Multi-Processors

Rethinking Programmed I/O for Fast Devices, Cheap Cores, and Coherent Interconnects

Hardware Support for Message-Passing in Chip Multi-Processors.

Direct Distributed Memory Access for CMPs

D2D-Assisted Multi-User Cooperative Partial Offloading, Transmission Scheduling and Computation Allocating for MEC

D2D Communications Meet Mobile Edge Computing for Enhanced Computation Capacity in Cellular Networks

Test of the MPCore cache bandwidthand considerations for efficient software execution

A Digital-Optical System-on-package Module Architecture for High Performance Multiprocessors

PID-Comm: A Fast and Flexible Collective Communication Framework for Commodity Processing-in-DIMM Devices

Optimizing Offload Performance in Heterogeneous MPSoCs

Leveraging On-Chip Networks For Data Cache Migration In Chip Multiprocessors

A High-performance, Energy-efficient Modular DMA Engine Architecture

MeMPA: A Memory Mapped M-SIMD Co-Processor to Cope with the Memory Wall Issue

Compiler-directed scratchpad memory data transfer optimization for multithreaded applications on a heterogeneous many-core architecture

MPU: Towards Bandwidth-abundant SIMT Processor via Near-bank Computing