Abstract:Neuromorphic chips with multi-core architecture are considered to be of great potential for the next generation of artificial intelligence (AI) chips because of the avoidance of the memory wall effect. Deploying deep neural networks (DNNs) to these chips requires two stages, namely, network partition and core placement. For the network partition, existing schemes are mostly manual or only focus on single-layer, small-scale network partitions. For the core placement, to the best of our knowledge, there is still no work that has completely solved the communication deadlock problem at the clock-level which commonly exists in the applications of neuromorphic multi-core and multi-chip (NMCMC) systems. To address these issues that affect the operating and deployment efficiency of NMCMC systems, we formulate the network group partition problem as an optimization problem for the first time and propose a search-based network group partition scheme to solve the problem. A clock-level multi-chip simulator is established to completely avoid the deadlock problem during the core placement optimization process. What's more, a region constrained simulated annealing (RCSA) algorithm is proposed to improve the efficiency of the core placement optimization. Finally, an automated toolchain for the efficient deployment of DNNs in the NMCMC systems is developed by integrating the proposed network group partition and core placement schemes together. Experiments show the proposed group partition scheme can achieve 22.25%, 17.77%, 14.80% less in core number, 9.44%, 7.96%, 5.16% improvements in memory utilization, and more balanced communication and computation loads compared with existing manual schemes in ResNet-18, ResNet-34, and ResNet-50, respectively. In addition, the proposed core placement optimization based on the RCSA algorithm shows higher efficiency with much fewer optimization steps and can realize 9.52%, 11.91%, and 27.52% higher in throughput compared with sequential core placement without deadlock in the ResNet-18, ResNet-34, and ResNet-50 networks. This work paves the way for applying NMCMC systems to real-world scenarios to reach more powerful machine intelligence.

A Novel Chaotic Neural Network For Solving Low Power Hardware-Software Partitioning Problems

Low power hardware/software partitioning for multiprocessor SoC design

Power-aware Mapping Based-on Genetic Algorithm for Network-on-Chip

Power-related Hardware/software Partitioning Based on Hopfield Neural Network and Tabu Search

System partitioning on MCM using a new neural network model

A Novel Discrete Hopfield Neural Network Approach for Hardware-Software Partitioning of RTOS in the SoC

Hardware–software Partitioning of Real-Time Operating Systems Using Hopfield Neural Networks

Temporal task partitioning algorithm for dynamically reconfigurable systems

Power Efficiency for Hardware/Software Partitioning with Time and Area Constraints on MPSoC

A Discrete Hopfield Neural Network Approach for Hardware-software Partitioning of Embedded Operating System in the SoC

Neurocomputing For Minimizing Energy Consumption Of Real-Time Operating System In The System-On-A-Chip

Controlling Chaos In A Neural Network Based On The Phase Space Constraint

A Hierarchical Neural Task Scheduling Algorithm in the Operating System of Neuromorphic Computers

An Effective Heuristic-Based Approach for Partitioning.

A Hopfield Neural Network Approach for Power Optimization of Real-Time Operating Systems

A SELF-ORGANIZING NEURAL NETWORK FOR PARTITIONING ON MCM

Uncertain Model and Algorithm for Hardware/Software Partitioning

A hardware/software partitioning method based on graph convolution network

Hardware-Software Partitioning of MPSoC Using Autowave Competition Neural Networks

Network Group Partition and Core Placement Optimization for Neuromorphic Multi-Core and Multi-Chip Systems

Tree-Based Partitioning Approach for Network-on-Chip Synthesis