Abstract:The two possible pathways toward artificial intelligence (AI)-(i) neuroscience-oriented neuromorphic computing [like spiking neural network (SNN)] and (ii) computer science driven machine learning (like deep learning) differ widely in their fundamental formalism and coding schemes (Pei et al., 2019). Deviating from traditional deep learning approach of relying on neuronal models with static nonlinearities, SNNs attempt to capture brain-like features like computation using spikes. This holds the promise of improving the energy efficiency of the computing platforms. In order to achieve a much higher areal and energy efficiency compared to today's hardware implementation of SNN, we need to go beyond the traditional route of relying on CMOS-based digital or mixed-signal neuronal circuits and segregation of computation and memory under the von Neumann architecture. Recently, ferroelectric field-effect transistors (FeFETs) are being explored as a promising alternative for building neuromorphic hardware by utilizing their non-volatile nature and rich polarization switching dynamics. In this work, we propose an all FeFET-based SNN hardware that allows low-power spike-based information processing and co-localized memory and computing (a.k.a. in-memory computing). We experimentally demonstrate the essential neuronal and synaptic dynamics in a 28 nm high-K metal gate FeFET technology. Furthermore, drawing inspiration from the traditional machine learning approach of optimizing a cost function to adjust the synaptic weights, we implement a surrogate gradient (SG) learning algorithm on our SNN platform that allows us to perform supervised learning on MNIST dataset. As such, we provide a pathway toward building energy-efficient neuromorphic hardware that can support traditional machine learning algorithms. Finally, we undertake synergistic device-algorithm co-design by accounting for the impacts of device-level variation (stochasticity) and limited bit precision of on-chip synaptic weights (available analog states) on the classification accuracy.

SuperSpike: Supervised learning in multi-layer spiking neural networks

SuperSpike: Supervised Learning in Multilayer Spiking Neural Networks

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

A Supervised Multi-Spike Learning Algorithm for Spiking Neural Networks

Fast and Accurate Classification with a Multi-Spike Learning Algorithm for Spiking Neurons.

Spike-driven Multi-Scale Learning with Hybrid Mechanisms of Spiking Dendrites.

Supervised Learning with First-to-Spike Decoding in Multilayer Spiking Neural Networks

Supervised Learning in Multilayer Spiking Neural Networks With Spike Temporal Error Backpropagation

Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting

Deep Spiking Neural Network with Spike Count based Learning Rule

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

Surrogate Gradient Learning in Spiking Neural Networks: Bringing the Power of Gradient-Based Optimization to Spiking Neural Networks

Supervised Learning of Logical Operations in Layered Spiking Neural Networks with Spike Train Encoding

Training Spiking Neural Networks for Cognitive Tasks: A Versatile Framework Compatible with Various Temporal Codes.

Supervised Learning in All FeFET-Based Spiking Neural Network: Opportunities and Challenges

Enabling Spike-Based Backpropagation for Training Deep Neural Network Architectures

A Supervised Multi-Spike Learning Algorithm For Recurrent Spiking Neural Networks

A Spiking Neuron Synaptic Plasticity Model Optimized for Unsupervised Learning

Learning Precise Spike Train to Spike Train Transformations in Multilayer Feedforward Neuronal Networks

Supervised Learning Strategy for Spiking Neurons Based on Their Segmental Running Characteristics

To Spike or Not to Spike, that is the Question