Abstract:In pursuit of higher inference accuracy, the complexity and parameter size of recent deep neural networks (DNNs) have increased significantly. Due to the increasing demand for computing power, the chiplet-based accelerator has been an important computing platform that can handle these DNN models more efficiently. In widely used DNN models, the feature sizes and the number of channels vary greatly among different convolutional layers. Existing chiplet-based accelerators typically adopt consistent optimization strategy for all of the convolutional layers regardless of their sizes, which would limit the inference performance. In this work, we carry out communication-aware customized optimization for convolutional layers with different sizes. First, we propose a reconfigurable high-performance photonic interconnect (HPPI) architecture to facilitate the communication in chiplet-based DNN accelerators. Second, we propose a customized dataflow as the mapping framework and provide four communication patterns of the photonic interconnect with different ways of spatial mapping. Third, we propose a lightweight back propagation neural network to efficiently select the optimal communication pattern for each convolutional layer. The proposed photonic interconnect can be switched between the four communication patterns to enable communication-aware customized optimization for each convolutional layer in the DNN model. As compared to Simba (a representative chiplet-based accelerator with electronic interconnect), HPPI reduces the execution time by 72.23% on average, while saving the energy consumption by 25.49% on average. As compared to ASCEND (a state-of-the-art chiplet-based accelerator with photonic interconnect), HPPI reduces the execution time by 34.04% on average, while saving the energy consumption by 10.34% on average.

Gemini: Mapping and Architecture Co-exploration for Large-scale DNN Chiplet Accelerators

DaDianNao: A Machine-Learning Supercomputer

NN-Baton: DNN Workload Orchestration and Chiplet Granularity Exploration for Multichip Accelerators

INDM: Chiplet-Based Interconnect Network and Dataflow Mapping for DNN Accelerators

M2M: A Fine-Grained Mapping Framework to Accelerate Multiple DNNs on a Multi-Chiplet Architecture

Challenges and Opportunities to Enable Large-Scale Computing via Heterogeneous Chiplets

On Task Mapping in Multi-chiplet Based Many-core Systems to Optimize Inter- and Intra-chiplet Communications

A Multi-Chiplet Computing-in-Memory Architecture Exploration Framework Based on Various CIM Devices

HPPI: A High-Performance Photonic Interconnect Design for Chiplet-Based DNN Accelerators

A Scalable Multi-Chiplet Deep Learning Accelerator with Hub-Side 2.5D Heterogeneous Integration.

Quartet: A 22nm 0.09mj/lnference Digital Compute-in-Memory Versatile AI Accelerator with Heterogeneous Tensor Engines and Off-Chip-Less Dataflow

Computing Utilization Enhancement for Chiplet-based Homogeneous Processing-in-Memory Deep Learning Processors

Memory and Computation Coordinated Mapping of DNNs Onto Complex Heterogeneous SoC.

HexaMesh: Scaling to Hundreds of Chiplets with an Optimized Chiplet Arrangement

Monad: Towards Cost-effective Specialization for Chiplet-based Spatial Accelerators

7.2 A 12nm Programmable Convolution-Efficient Neural-Processing-Unit Chip Achieving 825TOPS

Cocco: Hardware-Mapping Co-Exploration towards Memory Capacity-Communication Optimization

Evaluating Chiplet-based Large-Scale Interconnection Networks Via Cycle-Accurate Packet-Parallel Simulation.

Fine Grain 3D Integration for Microarchitecture Design Through Cube Packing Exploration.

An Efficient Design Framework for 2×2 CNN Accelerator Chiplet Cluster with SerDes Interconnects.

Automatic Mapping of Heterogeneous DNN Models on Adaptive Multi-Accelerator Systems