Abstract:Speech recognition (SR) has been improved significantly by artificial neural networks (ANNs), but ANNs have the drawbacks of biologically implausibility and excessive power consumption because of the nonlocal transfer of real-valued errors and weights. While spiking neural networks (SNNs) have the potential to solve these drawbacks of ANNs due to their efficient spike communication and their natural way to utilize kinds of synaptic plasticity rules found in brain for weight modification. However, existing SNN models for SR either had bad performance, or were trained in biologically implausible ways. In this paper, we present a biologically inspired convolutional SNN model for SR. The network adopts the time-to-first-spike coding scheme for fast and efficient information processing. A biological learning rule, spike-timing-dependent plasticity (STDP), is used to adjust the synaptic weights of convolutional neurons to form receptive fields in an unsupervised way. In the convolutional structure, the strategy of local weight sharing is introduced and could lead to better feature extraction of speech signals than global weight sharing. We first evaluated the SNN model with a linear support vector machine (SVM) on the TIDIGITS dataset and it got the performance of 97.5%, comparable to the best results of ANNs. Deep analysis on network outputs showed that, not only are the output data more linearly separable, but they also have fewer dimensions and become sparse. To further confirm the validity of our model, we trained it on a more difficult recognition task based on the TIMIT dataset, and it got a high performance of 93.8%. Moreover, a linear spike-based classifier-tempotron-can also achieve high accuracies very close to that of SVM on both the two tasks. These demonstrate that an STDP-based convolutional SNN model equipped with local weight sharing and temporal coding is capable of solving the SR task accurately and efficiently.

Residual Spiking Neural Network on a Programmable Neuromorphic Hardware for Speech Keyword Spotting

Low-power Neuromorphic Speech Recognition Engine with Coarse-Grain Sparsity.

Towards Energy-Preserving Natural Language Understanding with Spiking Neural Networks

A Hybrid Spiking Recurrent Neural Network on Hardware for Efficient Emotion Recognition.

A Sparsity-Adapted Hardware Implementation of SNN for Cortical Spike Trains Decoding

Neuromorphic Keyword Spotting with Pulse Density Modulation MEMS Microphones

Towards Ultra-Low-Power Neuromorphic Speech Enhancement with Spiking-FullSubNet

Deep Spiking Neural Networks for Large Vocabulary Automatic Speech Recognition

Real-Time Target Tracking System with Spiking Neural Networks Implemented on Neuromorphic Chips

Efficient Speech Command Recognition Leveraging Spiking Neural Network and Curriculum Learning-based Knowledge Distillation

A Digital Neuromorphic Hardware for Spiking Neural Network

A A 22nm 0.43pJ/SOP Sparsity-Aware In-Memory Neuromorphic Computing System with Hybrid Spiking and Artificial Neural Network and Configurable Topology

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

NBSSN: A Neuromorphic Binary Single-Spike Neural Network for Efficient Edge Intelligence.

Auditory perception architecture with spiking neural network and implementation on FPGA

Unsupervised speech recognition through spike-timing-dependent plasticity in a convolutional spiking neural network

Modular Building Blocks for Mapping Spiking Neural Networks Onto a Programmable Neuromorphic Processor

Single Channel Speech Enhancement Using U-Net Spiking Neural Networks

Digital Implementation of the Spiking Neural Network and Its Digit Recognition

Efficient spike encoding algorithms for neuromorphic speech recognition

An FPGA Implementation of Deep Spiking Neural Networks for Low-Power and Fast Classification