Abstract:Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal dynamics of spiking neural networks, even for sequential tasks. Motivated by this observation, we propose an \rev{optimized spiking long short-term memory networks (LSTM) training framework that involves a novel ANN-to-SNN conversion framework, followed by SNN training}. In particular, we propose novel activation functions in the source LSTM architecture and judiciously select a subset of them for conversion to integrate-and-fire (IF) activations with optimal bias shifts. Additionally, we derive the leaky-integrate-and-fire (LIF) activation functions converted from their non-spiking LSTM counterparts which justifies the need to jointly optimize the weights, threshold, and leak parameter. We also propose a pipelined parallel processing scheme which hides the SNN time steps, significantly improving system latency, especially for long sequences. The resulting SNNs have high activation sparsity and require only accumulate operations (AC), in contrast to expensive multiply-and-accumulates (MAC) needed for ANNs, except for the input layer when using direct encoding, yielding significant improvements in energy efficiency. We evaluate our framework on sequential learning tasks including temporal MNIST, Google Speech Commands (GSC), and UCI Smartphone datasets on different LSTM architectures. We obtain test accuracy of 94.75% with only 2 time steps with direct encoding on the GSC dataset with 4.1x lower energy than an iso-architecture standard LSTM.

LSTM-SNP: A long short-term memory model inspired from spiking neural P systems

Gated Spiking Neural P Systems for Time Series Forecasting

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Nonlinear Spiking Neural Systems With Autapses for Predicting Chaotic Time Series

An Attention-Aware Long Short-Term Memory-Like Spiking Neural Model for Sentiment Analysis

Power Load Prediction Model Based on Long Short Term Memory and Sparrow Search Algorithm

A Time Series Forecasting Approach Based on Nonlinear Spiking Neural Systems

CLSTM-SNP: Convolutional Neural Network to Enhance Spiking Neural P Systems for Named Entity Recognition Based on Long Short-Term Memory Network

Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance.

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding.

Short-Term Load Forecasting Based on Spiking Neural P Systems

A Reservoir Computing Model Based on Nonlinear Spiking Neural P Systems for Time Series Forecasting

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Unlocking the Power of LSTM for Long Term Time Series Forecasting

Towards Energy-Efficient, Low-Latency and Accurate Spiking LSTMs

An end-to-end functional spiking model for sequential feature learning

A Prediction Model Based on Gated Nonlinear Spiking Neural Systems

SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models

ConvSNP: a Deep Learning Model Embedded with SNP-like Neurons

Efficient and Effective Time-Series Forecasting with Spiking Neural Networks

A Hybrid Spiking Neurons Embedded LSTM Network for Multivariate Time Series Learning under Concept-Drift Environment