Abstract:Neuromorphic Computing, a concept pioneered in the late 1980s, is receiving a lot of attention lately due to its promise of reducing the computational energy, latency, as well as learning complexity in artificial neural networks. Taking inspiration from neuroscience, this interdisciplinary field performs a multi-stack optimization across devices, circuits, and algorithms by providing an end-to-end approach to achieving brain-like efficiency in machine intelligence. On one side, neuromorphic computing introduces a new algorithmic paradigm, known as Spiking Neural Networks (SNNs), which is a significant shift from standard deep learning and transmits information as spikes (“1” or “0”) rather than analog values. This has opened up novel algorithmic research directions to formulate methods to represent data in spike-trains, develop neuron models that can process information over time, design learning algorithms for event-driven dynamical systems, and engineer network architectures amenable to sparse, asynchronous, event-driven computing to achieve lower power consumption. On the other side, a parallel research thrust focuses on development of efficient computing platforms for new algorithms. Standard accelerators that are amenable to deep learning workloads are not particularly suitable to handle processing across multiple timesteps efficiently. To that effect, researchers have designed neuromorphic hardware that rely on event-driven sparse computations as well as efficient matrix operations. While most large-scale neuromorphic systems have been explored based on CMOS technology, recently, Non-Volatile Memory (NVM) technologies show promise toward implementing bio-mimetic functionalities on single devices. In this article, we outline several strides that neuromorphic computing based on spiking neural networks (SNNs) has taken over the recent past, and we present our outlook on the challenges that this field needs to overcome to make the bio-plausibility route a successful one.

Conversion of Artificial Recurrent Neural Networks to Spiking Neural Networks for Low-power Neuromorphic Hardware

Improving classification accuracy of feedforward neural networks for spiking neuromorphic chips

Accurate Mapping of RNNs on Neuromorphic Hardware with Adaptive Spiking Neurons

Optimizing Power Efficiency: Converting Recurrent Neural Networks to Spiking Neural Networks for Time-Domain Analysis

Ultra-low-power Image Classification on Neuromorphic Hardware

Low-Power Neuromorphic Hardware for Signal Processing Applications

An error-propagation spiking neural network compatible with neuromorphic processors

The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware

Spiking neural networks trained with backpropagation for low power neuromorphic implementation of voice activity detection

A 28-Nm 0.34-Pj/sop Spike-Based Neuromorphic Processor for Efficient Artificial Neural Network Implementations

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors

Neuromorphic Processing and Sensing: Evolutionary Progression of AI to Spiking

In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor

Exploring Neuromorphic Computing Based on Spiking Neural Networks: Algorithms to Hardware

Spiking recurrent neural networks for neuromorphic computing in nonlinear structural mechanics

One Transistor One Electrolyte‐Gated Transistor Based Spiking Neural Network for Power‐Efficient Neuromorphic Computing System

Real-Time Target Tracking System with Spiking Neural Networks Implemented on Neuromorphic Chips

Direct Training of Hardware-Friendly Weight Binarized Spiking Neural Network with Surrogate Gradient Learning Towards Spatio-Temporal Event-Based Dynamic Data Recognition

SNNLP: Energy-Efficient Natural Language Processing Using Spiking Neural Networks

Advancing Spatio-Temporal Processing in Spiking Neural Networks through Adaptation