Abstract:Neuromorphic Computing, a concept pioneered in the late 1980s, is receiving a lot of attention lately due to its promise of reducing the computational energy, latency, as well as learning complexity in artificial neural networks. Taking inspiration from neuroscience, this interdisciplinary field performs a multi-stack optimization across devices, circuits, and algorithms by providing an end-to-end approach to achieving brain-like efficiency in machine intelligence. On one side, neuromorphic computing introduces a new algorithmic paradigm, known as Spiking Neural Networks (SNNs), which is a significant shift from standard deep learning and transmits information as spikes (“1” or “0”) rather than analog values. This has opened up novel algorithmic research directions to formulate methods to represent data in spike-trains, develop neuron models that can process information over time, design learning algorithms for event-driven dynamical systems, and engineer network architectures amenable to sparse, asynchronous, event-driven computing to achieve lower power consumption. On the other side, a parallel research thrust focuses on development of efficient computing platforms for new algorithms. Standard accelerators that are amenable to deep learning workloads are not particularly suitable to handle processing across multiple timesteps efficiently. To that effect, researchers have designed neuromorphic hardware that rely on event-driven sparse computations as well as efficient matrix operations. While most large-scale neuromorphic systems have been explored based on CMOS technology, recently, Non-Volatile Memory (NVM) technologies show promise toward implementing bio-mimetic functionalities on single devices. In this article, we outline several strides that neuromorphic computing based on spiking neural networks (SNNs) has taken over the recent past, and we present our outlook on the challenges that this field needs to overcome to make the bio-plausibility route a successful one.

Bridge the Gap Between Neural Networks and Neuromorphic Hardware with a Neural Network Compiler

Bridging the Gap Between Neural Networks and Neuromorphic Hardware with A Neural Network Compiler

NEUTRAMS: Neural Network Transformation and Co-Design under Neuromorphic Hardware Constraints

Darwin:a Neuromorphic Hardware Co-Processor Based on Spiking Neural Networks

Compiling Spiking Neural Networks to Neuromorphic Hardware

Neural Network Transformation Under Hardware Constraints

End-to-End Implementation of Various Hybrid Neural Networks on a Cross-Paradigm Neuromorphic Chip

Modular Building Blocks for Mapping Spiking Neural Networks Onto a Programmable Neuromorphic Processor

An In-depth Comparison of Compilers for Deep Neural Networks on Hardware

A 28-Nm 0.34-Pj/sop Spike-Based Neuromorphic Processor for Efficient Artificial Neural Network Implementations

Mapping Very Large Scale Spiking Neuron Network to Neuromorphic Hardware.

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

A Mapping Model of SNNs to Neuromorphic Hardware

Polyhedral-Based Compilation Framework for In-Memory Neural Network Accelerators

Converting High-Performance and Low-Latency SNNs through Explicit Modelling of Residual Error in ANNs

SPRCPl: an Efficient Tool for SNN Models Deployment on Multi-Core Neuromorphic Chips Via Pilot Running

Conversion of Artificial Recurrent Neural Networks to Spiking Neural Networks for Low-power Neuromorphic Hardware

Heterogeneous Systems with Reconfigurable Neuromorphic Computing Accelerators

Exploring Neuromorphic Computing Based on Spiking Neural Networks: Algorithms to Hardware

A Reconfigurable Approach to Implement Neural Networks for Engineering Application

UIC: A Unified and Scalable Chip Integrating Neuromorphic Computation and General Purpose Processor