Abstract:In this paper, we propose a novel Low-Power Feature-Attention Chinese Keyword Spotting Framework based on a depthwise separable convolution neural network (DSCNN) with distillation learning to recognize speech signals of Chinese wake-up words. The framework consists of a low-power feature-attention acoustic model and its learning methods. Different from the existing model, the proposed acoustic model based on connectionist temporal classification (CTC) focuses on the reduction of power consumption by reducing model network parameters and multiply-accumulate (MAC) operations through our designed feature-attention network and DSCNN. In particular, the feature-attention network is specially designed to extract effective syllable features from a large number of MFCC features. This could refine MFCC features by selectively focusing on important speech signal features and removing invalid speech signal features to reduce the number of speech signal features, which helps to significantly reduce the parameters and MAC operations of the whole acoustic model. Moreover, DSCNN with fewer parameters and MAC operations compared with traditional convolution neural networks is adopted to extract effective high-dimensional features from syllable features. Furthermore, we apply a distillation learning algorithm to efficiently train the proposed low-power acoustic model by utilizing the knowledge of the trained large acoustic model. Experimental results thoroughly verify the effectiveness of our model and show that the proposed acoustic model still has better accuracy than other acoustic models with the lowest power consumption and smallest latency measured by NVIDIA JETSON TX2. It has only 14.524 KB parameters and consumes only 0.141 J energy per query and 17.9 ms latency on the platform, which is hardware-friendly.

Low-Latency Convolutional Recurrent Neural Network for Keyword Spotting

Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting

A Depthwise Separable Convolution Neural Network for Small-footprint Keyword Spotting Using Approximate MAC Unit and Streaming Convolution Reuse

A Separable Temporal Convolution Neural Network with Attention for Small-Footprint Keyword Spotting

Small-footprint Keyword Spotting with Graph Convolutional Network

Effective Combination of DenseNet and BiLSTM for Keyword Spotting.

Frequency & Channel Attention Network for Small Footprint Noisy Spoken Keyword Spotting

Focal Loss And Double-Edge-Triggered Detector For Robust Small-Footprint Keyword Spotting

Small-Footprint Keyword Spotting with Multi-Scale Temporal Convolution

Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spotting

Low-complex and Highly-performed Binary Residual Neural Network for Small-footprint Keyword Spotting

Separable Temporal Convolution plus Temporally Pooled Attention for Lightweight High-performance Keyword Spotting

Hello Edge: Keyword Spotting on Microcontrollers

Low-Power Feature-Attention Chinese Keyword Spotting Framework with Distillation Learning.

Translational Bit-by-Bit Multi-bit Quantization for CRNN on Keyword Spotting.

Depthwise Separable Convolutional ResNet with Squeeze-and-Excitation Blocks for Small-footprint Keyword Spotting

Hierarchical Neural Network Architecture In Keyword Spotting

Robust Small-Footprint Keyword Spotting Using Sequence-To-Sequence Model With Connectionist Temporal Classifier

A Monaural Speech Enhancement Method for Robust Small-Footprint Keyword Spotting.

Unrestricted Vocabulary Keyword Spotting Using LSTM-CTC

A Time Delay Neural Network with Shared Weight Self-Attention for Small-Footprint Keyword Spotting