Abstract:In this work, we propose a Spiking Neural Network (SNN) consisting of input neurons sparsely connected by plastic synapses to a randomly interlinked liquid, referred to as Liquid-SNN, for unsupervised speech and image recognition. We adapt the strength of the synapses interconnecting the input and liquid using Spike Timing Dependent Plasticity (STDP), which enables the neurons to self-learn a general representation of unique classes of input patterns. The presented unsupervised learning methodology makes it possible to infer the class of a test input directly using the liquid neuronal spiking activity. This is in contrast to standard Liquid State Machines (LSMs) that have fixed synaptic connections between the input and liquid followed by a readout layer (trained in a supervised manner) to extract the liquid states and infer the class of the input patterns. Moreover, the utility of LSMs has primarily been demonstrated for speech recognition. We find that training such LSMs is challenging for complex pattern recognition tasks because of the information loss incurred by using fixed input to liquid synaptic connections. We show that our Liquid-SNN is capable of efficiently recognizing both speech and image patterns by learning the rich temporal information contained in the respective input patterns. However, the need to enlarge the liquid for improving the accuracy introduces scalability challenges and training inefficiencies. We propose SpiLinC that is composed of an ensemble of multiple liquids operating in parallel. We use a "divide and learn" strategy for SpiLinC, where each liquid is trained on a unique segment of the input patterns that causes the neurons to self-learn distinctive input features. SpiLinC effectively recognizes a test pattern by combining the spiking activity of the constituent liquids, each of which identifies characteristic input features. As a result, SpiLinC offers competitive classification accuracy compared to the Liquid-SNN with added sparsity in synaptic connectivity and faster training convergence, both of which lead to improved energy efficiency in neuromorphic hardware implementations. We validate the efficacy of the proposed Liquid-SNN and SpiLinC on the entire digit subset of the TI46 speech corpus and handwritten digits from the MNIST dataset.

Exploring Liquid Neural Networks on Loihi-2

Transductive Spiking Graph Neural Networks for Loihi

Mapping and Validating a Point Neuron Model on Intel's Neuromorphic Hardware Loihi

Bio-realistic Neural Network Implementation on Loihi 2 with Izhikevich Neurons

Increasing Liquid State Machine Performance with Edge-of-Chaos Dynamics Organized by Astrocyte-modulated Plasticity

Implementing and Benchmarking the Locally Competitive Algorithm on the Loihi 2 Neuromorphic Processor

In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor

Neuromorphic on-chip reservoir computing with spiking neural network architectures

Natively neuromorphic LMU architecture for encoding-free SNN-based HAR on commercial edge devices

Accelerating Sensor Fusion in Neuromorphic Computing: A Case Study on Loihi-2

SpiLinC: Spiking Liquid-Ensemble Computing for Unsupervised Speech and Image Recognition

Accurate Mapping of RNNs on Neuromorphic Hardware with Adaptive Spiking Neurons

Simplified Klinokinesis using Spiking Neural Networks for Resource-Constrained Navigation on the Neuromorphic Processor Loihi

Resistive memory-based zero-shot liquid state machine for multimodal event data learning

Learning-to-learn enables rapid learning with phase-change memory-based in-memory computing

Evolutionary Optimization Of Liquid State Machines For Robust Learning

LaneSNNs: Spiking Neural Networks for Lane Detection on the Loihi Neuromorphic Processor

Adaptive structure evolution and biologically plausible synaptic plasticity for recurrent spiking neural networks

The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware

A Spiking Neural Network for Image Segmentation