Abstract:The hardware-software co-optimization of neural network architectures is a field of research that emerged with the advent of commercial neuromorphic chips, such as the IBM TrueNorth and Intel Loihi. Development of simulation and automated mapping software tools in tandem with the design of neuromorphic hardware, whilst taking into consideration the hardware constraints, will play an increasingly significant role in deployment of system-level applications. This paper illustrates the importance and benefits of co-design of convolutional neural networks (CNN) that are to be mapped onto neuromorphic hardware with a crossbar array of synapses. Toward this end, we first study which convolution techniques are more hardware friendly and propose different mapping techniques for different convolutions. We show that, for a seven-layered CNN, our proposed mapping technique can reduce the number of cores used by 4.9–13.8 times for crossbar sizes ranging from 128 × 256 to 1,024 × 1,024, and this can be compared to the toeplitz method of mapping. We next develop an iterative co-design process for the systematic design of more hardware-friendly CNNs whilst considering hardware constraints, such as core sizes. A python wrapper, developed for the mapping process, is also useful for validating hardware design and studies on traffic volume and energy consumption. Finally, a new neural network dubbed HFNet is proposed using the above co-design process; it achieves a classification accuracy of 71.3% on the IMAGENET dataset (comparable to the VGG-16) but uses 11 times less cores for neuromorphic hardware with core size of 1,024 × 1,024. We also modified the HFNet to fit onto different core sizes and report on the corresponding classification accuracies. Various aspects of the paper are patent pending.

Synergy Exploration in Deploying Convolutional Neural Networks Across Distributed Neuromorphic System

Mapping Very Large Scale Spiking Neuron Network to Neuromorphic Hardware.

A multiscale distributed neural computing model database (NCMD) for neuromorphic architecture

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

Towards Acceleration of Deep Convolutional Neural Networks Using Stochastic Computing

Single binding of data and model parallelisms to parallelize convolutional neural networks through multiple machines.

An End-to-End SoC for Brain-Inspired CNN-SNN Hybrid Applications

Model Parallelism Optimization for Distributed Inference Via Decoupled CNN Structure

Efficient GCN Deployment with Spiking Property on Spatial-Temporal Neuromorphic Chips.

Dataflow Aware Mapping of Convolutional Neural Networks Onto Many-Core Platforms With Network-on-Chip Interconnect

A Reliable Distributed Convolutional Neural Network for Biology Image Segmentation.

Synergy: A HW/SW Framework for High Throughput CNNs on Embedded Heterogeneous SoC

Neural Synaptic Plasticity-Inspired Computing: A High Computing Efficient Deep Convolutional Neural Network Accelerator

Automated Exploration and Implementation of Distributed CNN Inference at the Edge

Modular Building Blocks for Mapping Spiking Neural Networks Onto a Programmable Neuromorphic Processor

Enhancing Distributed In-Situ CNN Inference in the Internet of Things

HFNet: A CNN Architecture Co-designed for Neuromorphic Hardware With a Crossbar Array of Synapses

Towards Efficient Deployment of Hybrid SNNs on Neuromorphic and Edge AI Hardware

A High Energy-Efficiency Multi-core Neuromorphic Architecture for Deep SNN Training