Abstract:Neuromorphic Computing, a concept pioneered in the late 1980s, is receiving a lot of attention lately due to its promise of reducing the computational energy, latency, as well as learning complexity in artificial neural networks. Taking inspiration from neuroscience, this interdisciplinary field performs a multi-stack optimization across devices, circuits, and algorithms by providing an end-to-end approach to achieving brain-like efficiency in machine intelligence. On one side, neuromorphic computing introduces a new algorithmic paradigm, known as Spiking Neural Networks (SNNs), which is a significant shift from standard deep learning and transmits information as spikes (“1” or “0”) rather than analog values. This has opened up novel algorithmic research directions to formulate methods to represent data in spike-trains, develop neuron models that can process information over time, design learning algorithms for event-driven dynamical systems, and engineer network architectures amenable to sparse, asynchronous, event-driven computing to achieve lower power consumption. On the other side, a parallel research thrust focuses on development of efficient computing platforms for new algorithms. Standard accelerators that are amenable to deep learning workloads are not particularly suitable to handle processing across multiple timesteps efficiently. To that effect, researchers have designed neuromorphic hardware that rely on event-driven sparse computations as well as efficient matrix operations. While most large-scale neuromorphic systems have been explored based on CMOS technology, recently, Non-Volatile Memory (NVM) technologies show promise toward implementing bio-mimetic functionalities on single devices. In this article, we outline several strides that neuromorphic computing based on spiking neural networks (SNNs) has taken over the recent past, and we present our outlook on the challenges that this field needs to overcome to make the bio-plausibility route a successful one.

Improving classification accuracy of feedforward neural networks for spiking neuromorphic chips

Improving energy efficiency and classification accuracy of neuromorphic chips by learning binary synaptic crossbars

Conversion of Artificial Recurrent Neural Networks to Spiking Neural Networks for Low-power Neuromorphic Hardware

The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware

Energy Efficient RRAM Spiking Neural Network for Real Time Classification

You Only Spike Once: Improving Energy-Efficient Neuromorphic Inference to ANN-Level Accuracy

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

An error-propagation spiking neural network compatible with neuromorphic processors

Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors

In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor

NBSSN: A Neuromorphic Binary Single-Spike Neural Network for Efficient Edge Intelligence.

Efficient Implementation of Spiking Neural Networks for Inference Using Ex-Situ Training

Sparsity-Aware In-Memory Neuromorphic Computing Unit With Configurable Topology of Hybrid Spiking and Artificial Neural Network

TripleBrain: An Edge Neuromorphic Architecture for High-accuracy Single-layer Spiking Neural Network with On-chip Self-organizing and Reinforcement Learning

An FPGA Implementation of Deep Spiking Neural Networks for Low-Power and Fast Classification

A A 22nm 0.43pJ/SOP Sparsity-Aware In-Memory Neuromorphic Computing System with Hybrid Spiking and Artificial Neural Network and Configurable Topology

A Spiking Neuromorphic Design with Resistive Crossbar

Improving Spiking Neural Network Accuracy Using Time-based Neurons

Exploring Neuromorphic Computing Based on Spiking Neural Networks: Algorithms to Hardware

A High Energy-Efficiency Multi-core Neuromorphic Architecture for Deep SNN Training

Exploring Optimized Spiking Neural Network Architectures for Classification Tasks on Embedded Platforms