Abstract:Speech recognition (SR) has been improved significantly by artificial neural networks (ANNs), but ANNs have the drawbacks of biologically implausibility and excessive power consumption because of the nonlocal transfer of real-valued errors and weights. While spiking neural networks (SNNs) have the potential to solve these drawbacks of ANNs due to their efficient spike communication and their natural way to utilize kinds of synaptic plasticity rules found in brain for weight modification. However, existing SNN models for SR either had bad performance, or were trained in biologically implausible ways. In this paper, we present a biologically inspired convolutional SNN model for SR. The network adopts the time-to-first-spike coding scheme for fast and efficient information processing. A biological learning rule, spike-timing-dependent plasticity (STDP), is used to adjust the synaptic weights of convolutional neurons to form receptive fields in an unsupervised way. In the convolutional structure, the strategy of local weight sharing is introduced and could lead to better feature extraction of speech signals than global weight sharing. We first evaluated the SNN model with a linear support vector machine (SVM) on the TIDIGITS dataset and it got the performance of 97.5%, comparable to the best results of ANNs. Deep analysis on network outputs showed that, not only are the output data more linearly separable, but they also have fewer dimensions and become sparse. To further confirm the validity of our model, we trained it on a more difficult recognition task based on the TIMIT dataset, and it got a high performance of 93.8%. Moreover, a linear spike-based classifier-tempotron-can also achieve high accuracies very close to that of SVM on both the two tasks. These demonstrate that an STDP-based convolutional SNN model equipped with local weight sharing and temporal coding is capable of solving the SR task accurately and efficiently.

Neuromorphic Speech Recognition with Photonic Convolutional Spiking Neural Networks

Hybrid Deep Photonic Spiking Neural Network for Automatic Modulation Recognition

Pattern Recognition in Multi-Synaptic Photonic Spiking Neural Networks Based on a DFB-SA Chip

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Supervised Learning and Pattern Recognition in Photonic Spiking Neural Networks Based on MRR and Phase-Change Materials

An Enhanced Photonic Spiking Neural Network Based on the VCSEL-SA for Recognition and Classification

Photonic Integrated Neuro-Synaptic Core for Convolutional Spiking Neural Network

Bipolar Population Threshold Encoding for Audio Recognition with Deep Spiking Neural Networks

Unsupervised speech recognition through spike-timing-dependent plasticity in a convolutional spiking neural network

Hybrid photonic deep convolutional residual spiking neural networks for text classification

A Hybrid-Integrated Photonic Spiking Neural Network Framework Based on an MZI Array and VCSELs-SA

On-chip Spiking Neural Networks Based on Add-Drop Ring Microresonators and Electrically Reconfigurable Phase-Change Material Photonic Switches

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Residual Spiking Neural Network on a Programmable Neuromorphic Hardware for Speech Keyword Spotting

Application Of Precise-Spike-Driven Rule In Spiking Neural Networks For Optical Character Recognition

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

An Enhanced Encoding Method for Photonic Spiking Neural Network Based on the VCSEL-SA

Photonic Neural Networks and Its Applications

The hybrid photonic convolutional neural networks based on SOA and FP-SA

A Neurally Inspired Pattern Recognition Approach with Latency-Phase Encoding and Precise-Spike-driven Rule in Spiking Neural Network.

Hardware-algorithm collaborative computing with photonic spiking neuron chip based on an integrated Fabry-Perot laser with a saturable absorber