Abstract:Neuromorphic chips with multi-core architecture are considered to be of great potential for the next generation of artificial intelligence (AI) chips because of the avoidance of the memory wall effect. Deploying deep neural networks (DNNs) to these chips requires two stages, namely, network partition and core placement. For the network partition, existing schemes are mostly manual or only focus on single-layer, small-scale network partitions. For the core placement, to the best of our knowledge, there is still no work that has completely solved the communication deadlock problem at the clock-level which commonly exists in the applications of neuromorphic multi-core and multi-chip (NMCMC) systems. To address these issues that affect the operating and deployment efficiency of NMCMC systems, we formulate the network group partition problem as an optimization problem for the first time and propose a search-based network group partition scheme to solve the problem. A clock-level multi-chip simulator is established to completely avoid the deadlock problem during the core placement optimization process. What's more, a region constrained simulated annealing (RCSA) algorithm is proposed to improve the efficiency of the core placement optimization. Finally, an automated toolchain for the efficient deployment of DNNs in the NMCMC systems is developed by integrating the proposed network group partition and core placement schemes together. Experiments show the proposed group partition scheme can achieve 22.25%, 17.77%, 14.80% less in core number, 9.44%, 7.96%, 5.16% improvements in memory utilization, and more balanced communication and computation loads compared with existing manual schemes in ResNet-18, ResNet-34, and ResNet-50, respectively. In addition, the proposed core placement optimization based on the RCSA algorithm shows higher efficiency with much fewer optimization steps and can realize 9.52%, 11.91%, and 27.52% higher in throughput compared with sequential core placement without deadlock in the ResNet-18, ResNet-34, and ResNet-50 networks. This work paves the way for applying NMCMC systems to real-world scenarios to reach more powerful machine intelligence.

Fast optimization of multichip modules using deep learning coupled with Bayesian method

MLCNN: Cross-Layer Cooperative Optimization and Accelerator Architecture for Speeding Up Deep Learning Applications

MOC: Multi-Objective Mobile CPU-GPU Co-Optimization for Power-Efficient DNN Inference

DaDianNao: A Machine-Learning Supercomputer

Estimation of steady-state temperature field in Multichip Modules using deep convolutional neural network

Multi-core Chip Dynamic Power Management Framework Based on Reinforcement Learning br

A Multi-Level-Optimization Framework for FPGA-Based Cellular Neural Network Implementation.

Machine Learning for 3D-IC Electric-Thermal Simulation and Management

An efficient Green's function-based Bayesian optimization method for the thermal optimization of multi-chips on a silicon interposer

Dynamic Thermal Management for 3-D ICs with Time-Dependent Power Map Using Microchannel Cooling and Machine Learning

Thermal Layout Optimization for 3D Stacked Multichip Modules.

Transfer learning of convolutional neural network model for thermal estimation of multichip modules

A Layout Optimization Method to Reduce Commutation Inductance of Multi-Chip Power Module Based on Genetic Algorithm

Layout-Dominated Electro-Thermal Optimization for Multichip Power Modules with Response Surface and Fourier Series Model

Thermal design optimization of electronic circuit board layout with transient heating chips by using Bayesian optimization and thermal network model

Machine learning thermal circuit network model for thermal design optimization of electronic circuit board layout with transient heating chips

Hybrid Neural Network Based Multi-Objective Optimal Design of Hybrid Pin-Fin Microchannel Heatsink for Integrated Microsystems

Multi-objective design optimization of pin-fin cold plates for electric vehicle battery packs using convolutional neural networks and genetic algorithms

DeepOHeat: Operator Learning-based Ultra-fast Thermal Simulation in 3D-IC Design

Core Placement Optimization for Multi-chip Many-core Neural Network Systems with Reinforcement Learning.

Network Group Partition and Core Placement Optimization for Neuromorphic Multi-Core and Multi-Chip Systems