Abstract:As neural interfaces become more advanced, there has been an increase in the volume and complexity of neural data recordings. These interfaces capture rich information about neural dynamics that call for efficient, real-time processing algorithms to spontaneously extract and interpret patterns of neural dynamics. Moreover, being able to do so in a fully unsupervised manner is critical as patterns in vast streams of neural data might not be easily identifiable by the human eye. Formal Deep Neural Networks (DNNs) have come a long way in performing pattern recognition tasks for various static and sequential pattern recognition applications. However, these networks usually require large labeled datasets for training and have high power consumption preventing their future embedding in active brain implants. An alternative aimed at addressing these issues are Spiking Neural Networks (SNNs) which are neuromorphic and use more biologically plausible neurons with evolving membrane potentials. In this context, we introduce here a frugal single-layer SNN designed for fully unsupervised identification and classification of multivariate temporal patterns in continuous data with a sequential approach. We show that, with only a handful number of neurons, this strategy is efficient to recognize highly overlapping multivariate temporal patterns, first on simulated data, and then on Mel Cepstral representations of speech sounds and finally on multichannel neural data. This approach relies on several biologically inspired plasticity rules, including Spike-timing-dependent plasticity (STDP), Short-term plasticity (STP) and intrinsic plasticity (IP). These results pave the way towards highly frugal SNNs for fully unsupervised and online-compatible learning of complex multivariate temporal patterns for future embedding in dedicated very-low power hardware.

Spiking Neural Networks for event-based action recognition: A new task to understand their advantage

Spiking Neural Networks for event-based action recognition: A new task to understand their advantage

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Event-based Action Recognition Using Motion Information and Spiking Neural Networks

Event-driven Spiking Neural Networks with Spike-Based Learning

Spiking Neural Network Recognition Method Based on Dynamic Visual Motion Features

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Sparser spiking activity can be better: Feature Refine-and-Mask spiking neural network for event-based visual recognition

A Spiking Neural Network System for Robust Sequence Recognition

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

Unsupervised Spiking Instance Segmentation on Event Data using STDP

ReSpike: Residual Frames-based Hybrid Spiking Neural Networks for Efficient Action Recognition

An Event-based Feature Representation Method for Event Stream Classification Using Deep Spiking Neural Networks

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

A Study On the Effects of Pre-processing On Spatio-temporal Action Recognition Using Spiking Neural Networks Trained with STDP

A New Spiking Convolutional Recurrent Neural Network (SCRNN) With Applications to Event-Based Hand Gesture Recognition

A Spike Learning System for Event-driven Object Recognition

Spiking Neural Networks -- Part II: Detecting Spatio-Temporal Patterns

Dynamic Spatiotemporal Pattern Recognition with Recurrent Spiking Neural Network

Convolutional Spiking Neural Networks for Spatio-Temporal Feature Extraction

A frugal Spiking Neural Network for unsupervised classification of continuous multivariate temporal data