Abstract:The revolution of machine learning poses an unprecedented demand for computation resources, urging more transistors on a single monolithic chip, which is not sustainable in the Post-Moore era. The multichip integration with small functional dies, called chiplets, can reduce the manufacturing cost, improve the fabrication yield, and achieve die-level reuse for different system scales. DNN workload mapping and hardware design space exploration on such multichip systems are critical, but missing in the current stage.This work provides a hierarchical and analytical framework to describe the DNN mapping on a multichip accelerator and analyze the communication overhead. Based on this framework, we propose an automatic tool called NN-Baton with a pre-design flow and a post-design flow. The pre-design flow aims to guide the chiplet granularity exploration with given area and performance budgets for the target workload. The post-design flow focuses on the workload orchestration on different computation levels -package, chiplet, and core - in the hierarchy. Compared to Simba, NN-Baton generates mapping strategies that save 22.5%∼44% energy under the same computation and memory configurations.The architecture exploration demonstrates that area is a decisive factor for the chiplet granularity. For a 2048-MAC system under a 2 mm <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> chiplet area constraint, the 4-chiplet implementation with 4 cores and 16 lanes of 8-size vector-MAC is always the top-pick computation allocation across several benchmarks. In contrast, the optimal memory allocation policy in the hierarchy typically depends on the neural network models.

On-Chip Structures for Fmax Binning and Optimization

Design Time Body Bias Selection for Parametric Yield Improvement.

A Fast OPC Algorithm for IC Layout Based on 1-D Cells after Optimization of Gap Distribution

Statistical Framework and Built-In Self-Speed-Binning System for Speed Binning Using On-Chip Ring Oscillators.

A novel layout automation flow to facilitate test chip design for standard cell characterization

A unified architecture for speed-binning and circuit failure prediction and detection

Eliminating Timing Errors Through Collaborative Design to Maximize the Throughput

Binning Optimization Based on SSTA for Transparently-Latched Circuits.

A scan chain optimization method for diagnosis

A Power Efficient BIST TPG Method on Don't Care Bit Based 2-D Adjusting and Hamming Distance Based 2-D Reordering

An Input Crossbar Optimisation Method for And-inverter Cone Based FPGA

Optimizing pre-bond and post-bond test time for three dimension IP cores

Bit-Level Optimization For High-Level Synthesis And Fpga-Based Acceleration

Mixed Optimization Method In Design Of Fc-2

Transistor-Level Optimization Methodology for GRM FPGA Interconnect Circuits.

Dual-Speed TAM Optimization of 3D SoCs for Mid-bond and Post-bond Testing

A Timing-Aware 3D IC Bonding Optimization Method

Low-Cost IP Core Test Using Multiple-Mode Loading Scan Chain and Scan Chain Clusters

Statistical Methodology to Identify Optimal Placement of On-Chip Process Monitors for Predicting Fmax

NN-Baton: DNN Workload Orchestration and Chiplet Granularity Exploration for Multichip Accelerators

Scan Chain Configuration Based X-filling for Low Power and High Quality Testing.