Abstract:Bit-serial Processing-In-Memory (PIM) is an attractive paradigm for accelerator architectures, for parallel workloads such as Deep Learning (DL), because of its capability to achieve massive data parallelism at a low area overhead and provide orders-of-magnitude data movement savings by moving computational resources closer to the data. While many PIM architectures have been proposed, improvements are needed in communicating intermediate results to consumer kernels, for communication between tiles at scale, for reduction operations, and for efficiently performing bit-serial operations with constants. We present PIMSAB, a scalable architecture that provides spatially aware communication network for efficient intra-tile and inter-tile data movement and provides efficient computation support for generally inefficient bit-serial compute patterns. Our architecture consists of a massive hierarchical array of compute-enabled SRAMs (CRAMs) and is codesigned with a compiler to achieve high utilization. The key novelties of our architecture are: (1) providing efficient support for spatially-aware communication by providing local H-tree network for reductions, by adding explicit hardware for shuffling operands, and by deploying systolic broadcasting, and (2) taking advantage of the divisible nature of bit-serial computations through adaptive precision, bit-slicing and efficient handling of constant operations. When compared against a similarly provisioned modern Tensor Core GPU (NVIDIA A100), across common DL kernels and an end-to-end DL network (Resnet18), PIMSAB outperforms the GPU by 3x, and reduces energy by 4.2x. We compare PIMSAB with similarly provisioned state-of-the-art SRAM PIM (Duality Cache) and DRAM PIM (SIMDRAM) and observe a speedup of 3.7x and 3.88x respectively.

Permitting Features in P Systems Generating Picture Arrays.

P Systems with 2D Picture Grammars.

Towards experimental P-systems using multivesicular liposomes

Label Languages of 8-directional Array P System

P Systems Based Multi-Objective Optimization Algorithm

On Sequential P Systems with Proteins

P Systems and Petri Nets

P Systems with Proteins Working in the Minimally Parallel Mode

One-dimensional Array Grammars and P Systems with Array Insertion and Deletion Rules

Homeostasis tissue-like P systems with cell separation

A P_Lingua Based Simulator for P Systems with Symport/Antiport Rules

Tissue-like P Systems with Evolutional Symport/antiport Rules

An Overview of Membrane Computing

On the number of useful objects in P systems with active membranes

Languages Generated by Numerical P Systems with Thresholds

Implementing Enzymatic Numerical P Systems for AI Applications by Means of Graphic Processing Units

An arithmetic operation P system based on symmetric ternary system

SyPSE: A Symbolic Computation Toolbox for Process Systems Engineering Part I-Architecture and Algorithm Development

Programming Heterogeneous Systems with Array Types

Neural-like P Systems with Plasmids.

PIMSAB: A Processing-In-Memory System with Spatially-Aware Communication and Bit-Serial-Aware Computation