Abstract:The purpose of this paper is to study the performance improvement of memory architectures for three-di-mensional chip multi-processors(3D CMPs).As CMPs integrate more and more cores,a great deal of data access pressure is placed on the memory subsystem.Designers face the challenges of feeding enough data to a massive number of on-die cores for CMPs.Three-dimensional integrated circuits(3D ICs)can stack memories of different process technologies into the same chip.The stacking memory bandwidth can be enlarged by using fine-pitch through-silicon vias(TSVs),which can mitigate the pressure on the I/O infrastructure for CMPs.In this paper,we start with studying the potential benefit of 3D integration and the recent advantages on the research of memory ar-chitectures for 3D CMPs.Bothe large caches and main memories can be stacked in 3D CMPs.Hence,we focus on the memory architectures for 3D CMPs in two aspects,stacking cache architecture and stacking main memory architecture.3D CMPs can integrate much larger L2 caches compared to their 2D counterparts in the same area footprint.Meanwhile,the L2 caches can be several layers.We firstly explore the performance improvements of stacking SRAM L2 cache layers atop processor layers for 3D CMPs.The experimental results show that the 3D CMPs with 2 L2 cache layers can improve the performance up to 55% and 34% on average compared to that of 3D CMPs with 1 L2 cache layer.3D CMPs provide opportunities for composing future systems by integrating disparate technologies memories.The off-chip DRAM main memories can be stacked on the processor layers.We secondly study the performance benefit of integrating DRAM main memories into 3D CMPs.The experiment results show that stacking DRAM main memories can provide up to 80% and on average 34.2% performance improvement for 3D CMPs compared to the 2D CMPs with off-chip DRAM main memory.Our analysis and experimental results give a guideline to design efficient 3D CMPs with stacking SRAM L2 caches and DRAM main memories.

A Spatial-Designed Computing-In-Memory Architecture Based on Monolithic 3D Integration for High-Performance Systems.

An Overview of Computing-in-Memory Interfaces

Modeling and Benchmarking Computing-in-Memory for Design Space Exploration.

A design framework for processing-in-memory accelerator

A Hybrid Computing-In-Memory Architecture by Monolithic 3D Integration of BEOL CNT/IGZO-based CFET Logic and Analog RRAM

TensorCIM: Digital Computing-in-Memory Tensor Processor with Multichip-Module-Based Architecture for Beyond-NN Acceleration

NicePIM: Design Space Exploration for Processing-In-Memory DNN Accelerators with 3D-Stacked-DRAM

Design of Computing-in-Memory (CIM) with Vertical Split-Gate Flash Memory for Deep Neural Network (DNN) Inference Accelerator

A Reconfigurable Computing-in-Memory Accelerator with Dynamic Group-Based Dataflow and Dual-Input Macro Designs

Voxel-CIM: An Efficient Compute-in-Memory Accelerator for Voxel-based Point Cloud Neural Networks

A Multi-Chiplet Computing-in-Memory Architecture Exploration Framework Based on Various CIM Devices

16.4 TensorCIM: A 28nm 3.7nj/gather and 8.3TFLOPS/W FP32 Digital-CIM Tensor Processor for MCM-CIM-Based Beyond-NN Acceleration

The study of memory architectures for 3D chip multi-processors

PIMSAB: A Processing-In-Memory System with Spatially-Aware Communication and Bit-Serial-Aware Computation

TensorCIM: A 28nm 3.7nJ/Gather and 8.3TFLOPS/W FP32 Digital-CIM Tensor Processor for MCM-CIM-Based Beyond-NN Acceleration.

A Customized NoC Architecture to Enable Highly Localized Computing-On-the-Move DNN Dataflow

Dataflow-Aware PIM-Enabled Manycore Architecture for Deep Learning Workloads

System-Technology Co-Optimization for 3D Monolithic Memory-Centric Computing

Computing In-Memory, Revisited

Benchmark of the Compute-in-Memory-Based DNN Accelerator With Area Constraint

Non-volatile Memory Based In-Memory Computing Technology