Abstract:With the recent reincarnations of neuromorphic computing comes the promise of a new computing paradigm, with a focus on the design and fabrication of neuromorphic chips. A key challenge in design, however, is that programming such chips is difficult. This paper proposes a systematic methodology with a set of tools to address this challenge. The proposed toolset is called NEUTRAMS (Neural network Transformation, Mapping and Simulation), and includes three key components: a neural network (NN) transformation algorithm, a configurable clock-driven simulator of neuromorphic chips and an optimized runtime tool that maps NNs onto the target hardware for better resource utilization. To address the challenges of hardware constraints on implementing NN models (such as the maximum fan-in/fan-out of a single neuron, limited precision, and various neuron models), the transformation algorithm divides an existing NN into a set of simple network units and retrains each unit iteratively, to transform the original one into its counterpart under such constraints. It can support both spiking neural networks (SNNs) and traditional artificial neural networks (ANNs), including convolutional neural networks (CNNs) and multilayer perceptrons (MLPs) and recurrent neural networks (RNNs). With the combination of these tools, we have explored the hardware/software co-design space of the correlation between network error-rates and hardware constraints and consumptions. Doing so provides insights which can support the design of future neuromorphic architectures. The usefulness of such a toolset has been demonstrated with two different designs: a real Complementary Metal-Oxide-Semiconductor (CMOS) neuromorphic chip for both SNNs and ANNs and a processing-in-memory architecture design for ANNs.

Rna: A Reconfigurable Architecture for Hardware Neural Acceleration

A Near Memory Computing FPGA Architecture for Neural Network Acceleration

Reconfigurable Architecture for Neural Approximation in Multimedia Computing.

Neural Approximating Architecture Targeting Multiple Application Domains

High-performance Reconfigurable DNN Accelerator on a Bandwidth-limited Embedded System

A Unified Framework for Training, Mapping and Simulation of ReRAM-Based Convolutional Neural Network Acceleration.

Heterogeneous Systems with Reconfigurable Neuromorphic Computing Accelerators

A Reduced Architecture for ReRAM-Based Neural Network Accelerator and Its Software Stack

Implementation and Optimization of the Accelerator Based on FPGA Hardware for LSTM Network

RENO: a high-efficient reconfigurable neuromorphic computing accelerator design

An Efficient Reconfigurable Framework for General Purpose CNN-RNN Models on FPGAs

A FPGA-Based, Granularity-Variable Neuromorphic Processor and Its Application in a MIMO Real-Time Control System.

A heterogeneous computing system with memristor-based neuromorphic accelerators

ONNX-to-Hardware Design Flow for the Generation of Adaptive Neural-Network Accelerators on FPGAs

FPSA: A Full System Stack Solution for Reconfigurable ReRAM-based NN Accelerator Architecture

Multi-clusters: an Efficient Design Paradigm of NN Accelerator Architecture Based on FPGA

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

NEUTRAMS: Neural Network Transformation and Co-Design under Neuromorphic Hardware Constraints

RANC: Reconfigurable Architecture for Neuromorphic Computing

ActiveN: A Scalable and Flexibly-Programmable Event-Driven Neuromorphic Processor

High-performance reconfigurable hardware architecture for restricted Boltzmann machines