Abstract:The intrinsic dynamics and event-driven nature of spiking neural networks (SNNs) make them excel in processing temporal information by naturally utilizing embedded time sequences as time steps. Recent studies adopting this approach have demonstrated SNNs' effectiveness in speech command recognition, achieving high performance by employing large time steps for long time sequences. However, the large time steps lead to increased deployment burdens for edge computing applications. Thus, it is important to balance high performance and low energy consumption when detecting temporal patterns in edge devices. Our solution comprises two key components. 1). We propose a high-performance fully spike-driven framework termed SpikeSCR, characterized by a global-local hybrid structure for efficient representation learning, which exhibits long-term learning capabilities with extended time steps. 2). To further fully embrace low energy consumption, we propose an effective knowledge distillation method based on curriculum learning (KDCL), where valuable representations learned from the easy curriculum are progressively transferred to the hard curriculum with minor loss, striking a trade-off between power efficiency and high performance. We evaluate our method on three benchmark datasets: the Spiking Heidelberg Dataset (SHD), the Spiking Speech Commands (SSC), and the Google Speech Commands (GSC) V2. Our experimental results demonstrate that SpikeSCR outperforms current state-of-the-art (SOTA) methods across these three datasets with the same time steps. Furthermore, by executing KDCL, we reduce the number of time steps by 60% and decrease energy consumption by 54.8% while maintaining comparable performance to recent SOTA results. Therefore, this work offers valuable insights for tackling temporal processing challenges with long time sequences in edge neuromorphic computing systems.

Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spotting

ED-sKWS: Early-Decision Spiking Neural Networks for Rapid,and Energy-Efficient Keyword Spotting

A Depthwise Separable Convolution Neural Network for Small-footprint Keyword Spotting Using Approximate MAC Unit and Streaming Convolution Reuse

Towards Energy-Preserving Natural Language Understanding with Spiking Neural Networks

Effective Combination of DenseNet and BiLSTM for Keyword Spotting.

Small-footprint Keyword Spotting with Graph Convolutional Network

Efficient Speech Command Recognition Leveraging Spiking Neural Network and Curriculum Learning-based Knowledge Distillation

NS-KWS: joint optimization of near-sensor processing architecture and low-precision GRU for always-on keyword spotting

End-to-end keyword search system based on attention mechanism and energy scorer for low resource languages

A Monaural Speech Enhancement Method for Robust Small-Footprint Keyword Spotting.

Energy-Friendly Keyword Spotting System Using Add-Based Convolution.

Separable Temporal Convolution plus Temporally Pooled Attention for Lightweight High-performance Keyword Spotting

SpikingMiniLM: Energy-Efficient Spiking Transformer for Natural Language Understanding

Hello Edge: Keyword Spotting on Microcontrollers

Residual Spiking Neural Network on a Programmable Neuromorphic Hardware for Speech Keyword Spotting

Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting

Towards Ultra-Low-Power Neuromorphic Speech Enhancement with Spiking-FullSubNet

Low-Latency Convolutional Recurrent Neural Network for Keyword Spotting

NS-FDN: Near-Sensor Processing Architecture of Feature-Configurable Distributed Network for Beyond-Real-Time Always-on Keyword Spotting

A Background-Noise and Process-Variation-Tolerant 109nW Acoustic Feature Extractor Based on Spike-Domain Divisive-Energy Normalization for an Always-On Keyword Spotting Device

End-to-End Speech Keyword Spotting System