Abstract:In this paper, we propose a novel Low-Power Feature-Attention Chinese Keyword Spotting Framework based on a depthwise separable convolution neural network (DSCNN) with distillation learning to recognize speech signals of Chinese wake-up words. The framework consists of a low-power feature-attention acoustic model and its learning methods. Different from the existing model, the proposed acoustic model based on connectionist temporal classification (CTC) focuses on the reduction of power consumption by reducing model network parameters and multiply-accumulate (MAC) operations through our designed feature-attention network and DSCNN. In particular, the feature-attention network is specially designed to extract effective syllable features from a large number of MFCC features. This could refine MFCC features by selectively focusing on important speech signal features and removing invalid speech signal features to reduce the number of speech signal features, which helps to significantly reduce the parameters and MAC operations of the whole acoustic model. Moreover, DSCNN with fewer parameters and MAC operations compared with traditional convolution neural networks is adopted to extract effective high-dimensional features from syllable features. Furthermore, we apply a distillation learning algorithm to efficiently train the proposed low-power acoustic model by utilizing the knowledge of the trained large acoustic model. Experimental results thoroughly verify the effectiveness of our model and show that the proposed acoustic model still has better accuracy than other acoustic models with the lowest power consumption and smallest latency measured by NVIDIA JETSON TX2. It has only 14.524 KB parameters and consumes only 0.141 J energy per query and 17.9 ms latency on the platform, which is hardware-friendly.

End-to-End Speech Keyword Spotting System

Wake-up-word Spotting Using End-to-end Deep Neural Network System.

A Depthwise Separable Convolution Neural Network for Small-footprint Keyword Spotting Using Approximate MAC Unit and Streaming Convolution Reuse

A New Keyword Spotting Approach for Spontaneous Mandarin Speech

End-to-end keyword search system based on attention mechanism and energy scorer for low resource languages

Focal Loss And Double-Edge-Triggered Detector For Robust Small-Footprint Keyword Spotting

Keyword-specific normalization based keyword spotting for spontaneous speech

Wekws: A Production First Small-Footprint End-to-End Keyword Spotting Toolkit

Effective Combination of DenseNet and BiLSTM for Keyword Spotting.

Keyword spotting -- Detecting commands in speech using deep learning

End-to-End Multi-Look Keyword Spotting.

An Efficient Keywords Spotting System with Speaker Verification Based on Binary Neural Networks

TDT-KWS: Fast And Accurate Keyword Spotting Using Token-and-duration Transducer

A 510-nW Wake-Up Keyword-Spotting Chip Using Serial-FFT-Based MFCC and Binarized Depthwise Separable CNN in 28-nm CMOS

An Improved Point Process Models for Spotting Keywords in Continuous Speech

Text-Dependent Speech Enhancement for Small-Footprint Robust Keyword Detection

End-to-end keywords spotting based on connectionist temporal classification for Mandarin

A VOCABULARY-INDEPENDENT KEYWORD SPOTTER FOR SPONTANEOUS CHINESE SPEECH

Low-Power Feature-Attention Chinese Keyword Spotting Framework with Distillation Learning.

Keyword Spotting for Hearing Assistive Devices Robust to External Speakers

Text Adaptive Detection for Customizable Keyword Spotting.