Abstract:The hardware-software co-optimization of neural network architectures is a field of research that emerged with the advent of commercial neuromorphic chips, such as the IBM TrueNorth and Intel Loihi. Development of simulation and automated mapping software tools in tandem with the design of neuromorphic hardware, whilst taking into consideration the hardware constraints, will play an increasingly significant role in deployment of system-level applications. This paper illustrates the importance and benefits of co-design of convolutional neural networks (CNN) that are to be mapped onto neuromorphic hardware with a crossbar array of synapses. Toward this end, we first study which convolution techniques are more hardware friendly and propose different mapping techniques for different convolutions. We show that, for a seven-layered CNN, our proposed mapping technique can reduce the number of cores used by 4.9–13.8 times for crossbar sizes ranging from 128 × 256 to 1,024 × 1,024, and this can be compared to the toeplitz method of mapping. We next develop an iterative co-design process for the systematic design of more hardware-friendly CNNs whilst considering hardware constraints, such as core sizes. A python wrapper, developed for the mapping process, is also useful for validating hardware design and studies on traffic volume and energy consumption. Finally, a new neural network dubbed HFNet is proposed using the above co-design process; it achieves a classification accuracy of 71.3% on the IMAGENET dataset (comparable to the VGG-16) but uses 11 times less cores for neuromorphic hardware with core size of 1,024 × 1,024. We also modified the HFNet to fit onto different core sizes and report on the corresponding classification accuracies. Various aspects of the paper are patent pending.

Design Of Four-Wave Oscillating Cellular-Neural-Network

A Proposal for Energy-Efficient Cellular Neural Network based on Spintronic Devices

Multi-frequency Sinusoidal Wave Control in a Chaotic Neural Network

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

Design of Oscillatory Neural Networks by Machine Learning

Sinusoidal Modulation Control Method in a Chaotic Neural Network

Modeling and Analyzing Biological Oscillations in Molecular Networks

Optical-electronic Hybrid Fourier Convolutional Neural Network Based on Super-Pixel Complex-Valued Modulation

A novel OTA for implementing programmable CNN

The Synchronization Control Of Cellular Neural Network With Nonlinear Observer

Design and circuit implementation of a novel 5D memristive CNN hyperchaotic system

Application Analysis of Multiple Neurons Connected with Fast Inhibitory Synapses

Elimination of spiral waves in a locally connected chaotic neural network by a dynamic phase space constraint

Biphasic action potentials in an individual cellular neural network cell

Design and synchronization control application of a new five-dimensional memristor CNN conservative hyperchaotic system

HFNet: A CNN Architecture Co-designed for Neuromorphic Hardware With a Crossbar Array of Synapses

Convolution Inference via Synchronization of a Coupled CMOS Oscillator Array

Two-Dimensional Oscillatory Neural Network Based on Charge-Density-Wave Devices Operating at Room Temperature

Performance Analysis of CSSS Based on CNN

Bifurcation, chaos and fixed-time synchronization of memristor cellular neural networks