Abstract:A variety of advanced machine learning and deep learning algorithms achieve state-of-the-art performance on various temporal processing tasks. However, these methods are heavily energy inefficient-they run mainly on the power hungry CPUs and GPUs. Computing with Spiking Networks, on the other hand, has shown to be energy efficient on specialized neuromorphic hardware, e.g., Loihi, TrueNorth, SpiNNaker, etc. In this work, we present two architectures of spiking models, inspired from the theory of Reservoir Computing and Legendre Memory Units, for the Time Series Classification (TSC) task. Our first spiking architecture is closer to the general Reservoir Computing architecture and we successfully deploy it on Loihi; the second spiking architecture differs from the first by the inclusion of non-linearity in the readout layer. Our second model (trained with Surrogate Gradient Descent method) shows that non-linear decoding of the linearly extracted temporal features through spiking neurons not only achieves promising results, but also offers low computation-overhead by significantly reducing the number of neurons compared to the popular LSM based models-more than 40x reduction with respect to the recent spiking model we compare with. We experiment on five TSC datasets and achieve new SoTA spiking results (-as much as 28.607% accuracy improvement on one of the datasets), thereby showing the potential of our models to address the TSC tasks in a green energy-efficient manner. In addition, we also do energy profiling and comparison on Loihi and CPU to support our claims.

Reservoir computing models based on spiking neural P systems for time series classification

Time series classification models based on nonlinear spiking neural P systems

A Reservoir Computing Model Based on Nonlinear Spiking Neural P Systems for Time Series Forecasting

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Self-organizing Reservoir Computing Based on Spiking-Timing Dependent Plasticity and Intrinsic Plasticity Mechanisms

Reservoir based spiking models for univariate Time Series Classification

A Comparative Study of Reservoir Computing for Temporal Signal Processing

Efficient Neuromorphic Reservoir Computing Using Optoelectronic Memristors for Multivariate Time Series Classification.

Investigating Biologically Plausible Neural Networks for Reservoir Computing Solutions

A Survey on Reservoir Computing and its Interdisciplinary Applications Beyond Traditional Machine Learning

Novel efficient reservoir computing methodologies for regular and irregular time series classification

Analysis and Fully Memristor-based Reservoir Computing for Temporal Data Classification

Spiking Photonic Reservoir Computing System Based on Photonic Spiking Neuron

A Feature-Recombinant Asynchronous Deep Reservoir Computing for Modeling Time Series Data

An Intelligent Interconnected Network with Multiple Reservoir Computing

A Time Series Forecasting Approach Based on Nonlinear Spiking Neural Systems

A systematic exploration of reservoir computing for forecasting complex spatiotemporal dynamics

Dynamic Memristor-based Reservoir Computing for High-Efficiency Spatiotemporal Signal Processing

Reservoir Computing with Diverse Timescales for Prediction of Multiscale Dynamics

Time series change detection using reservoir computing networks for remote sensing data

Backpropagation algorithms and Reservoir Computing in Recurrent Neural Networks for the forecasting of complex spatiotemporal dynamics