Abstract:With the recent reincarnations of neuromorphic computing comes the promise of a new computing paradigm, with a focus on the design and fabrication of neuromorphic chips. A key challenge in design, however, is that programming such chips is difficult. This paper proposes a systematic methodology with a set of tools to address this challenge. The proposed toolset is called NEUTRAMS (Neural network Transformation, Mapping and Simulation), and includes three key components: a neural network (NN) transformation algorithm, a configurable clock-driven simulator of neuromorphic chips and an optimized runtime tool that maps NNs onto the target hardware for better resource utilization. To address the challenges of hardware constraints on implementing NN models (such as the maximum fan-in/fan-out of a single neuron, limited precision, and various neuron models), the transformation algorithm divides an existing NN into a set of simple network units and retrains each unit iteratively, to transform the original one into its counterpart under such constraints. It can support both spiking neural networks (SNNs) and traditional artificial neural networks (ANNs), including convolutional neural networks (CNNs) and multilayer perceptrons (MLPs) and recurrent neural networks (RNNs). With the combination of these tools, we have explored the hardware/software co-design space of the correlation between network error-rates and hardware constraints and consumptions. Doing so provides insights which can support the design of future neuromorphic architectures. The usefulness of such a toolset has been demonstrated with two different designs: a real Complementary Metal-Oxide-Semiconductor (CMOS) neuromorphic chip for both SNNs and ANNs and a processing-in-memory architecture design for ANNs.

MPUS: a scalable parallel simulator for RedNeurons parallel computer.

A Parallel Simulator for Massive Reservoir Models Utilizing Distributed-Memory Parallel Systems

New High Performance Computer Network MPU and the Parallel Simulation for MPU

Scalable Parallel Computers for Real-Time Signal Processing

ParaNSim: a Parallel Network-on-Chip Simulator

A 3D Parallel Monte Carlo Simulator for Semiconductor Devices

Mspr: A Retained-Mode Based Multi-Screen Parallel Rendering System

High Performance Simulation of Spiking Neural Network on GPGPUs

MNSIM: Simulation Platform for Memristor-Based Neuromorphic Computing System.

NEUTRAMS: Neural Network Transformation and Co-Design under Neuromorphic Hardware Constraints

PMSN: A Parallel Multi-compartment Spiking Neuron for Multi-scale Temporal Processing

Parallel Spiking Unit for Efficient Training of Spiking Neural Networks

SuperNeuro: A Fast and Scalable Simulator for Neuromorphic Computing

RENO: a high-efficient reconfigurable neuromorphic computing accelerator design

Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependencies

A Parallel SystemC Virtual Platform for Neuromorphic Architectures

Unison: A Parallel-Efficient and User-Transparent Network Simulation Kernel.

SimRPU: A Simulation Environment for Reconfigurable Architecture Exploration

Design and Implementation of a User-interactiveParallel Programming

GPU-RANC: A CUDA Accelerated Simulation Framework for Neuromorphic Architectures

Extensible neuromorphic computing simulator based on a programmable hardware