Abstract:In this paper, we propose a novel Low-Power Feature-Attention Chinese Keyword Spotting Framework based on a depthwise separable convolution neural network (DSCNN) with distillation learning to recognize speech signals of Chinese wake-up words. The framework consists of a low-power feature-attention acoustic model and its learning methods. Different from the existing model, the proposed acoustic model based on connectionist temporal classification (CTC) focuses on the reduction of power consumption by reducing model network parameters and multiply-accumulate (MAC) operations through our designed feature-attention network and DSCNN. In particular, the feature-attention network is specially designed to extract effective syllable features from a large number of MFCC features. This could refine MFCC features by selectively focusing on important speech signal features and removing invalid speech signal features to reduce the number of speech signal features, which helps to significantly reduce the parameters and MAC operations of the whole acoustic model. Moreover, DSCNN with fewer parameters and MAC operations compared with traditional convolution neural networks is adopted to extract effective high-dimensional features from syllable features. Furthermore, we apply a distillation learning algorithm to efficiently train the proposed low-power acoustic model by utilizing the knowledge of the trained large acoustic model. Experimental results thoroughly verify the effectiveness of our model and show that the proposed acoustic model still has better accuracy than other acoustic models with the lowest power consumption and smallest latency measured by NVIDIA JETSON TX2. It has only 14.524 KB parameters and consumes only 0.141 J energy per query and 17.9 ms latency on the platform, which is hardware-friendly.

A Depthwise Separable Convolution Neural Network for Small-footprint Keyword Spotting Using Approximate MAC Unit and Streaming Convolution Reuse

Low-Power Feature-Attention Chinese Keyword Spotting Framework with Distillation Learning.

Depthwise Separable Convolutional ResNet with Squeeze-and-Excitation Blocks for Small-footprint Keyword Spotting

14.1 A 510nw 0.41V Low-Memory Low-Computation Keyword-Spotting Chip Using Serial FFT-Based MFCC and Binarized Depthwise Separable Convolutional Neural Network in 28nm CMOS

A 510-nW Wake-Up Keyword-Spotting Chip Using Serial-FFT-Based MFCC and Binarized Depthwise Separable CNN in 28-nm CMOS

Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting

Small-Footprint Keyword Spotting with Multi-Scale Temporal Convolution

Low-Latency Convolutional Recurrent Neural Network for Keyword Spotting

Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spotting

A Separable Temporal Convolution Neural Network with Attention for Small-Footprint Keyword Spotting

Low Power Keyword Recognition Accelerator based on Approximate Calculation of Deep-Shift Neural Network

Focal Loss And Double-Edge-Triggered Detector For Robust Small-Footprint Keyword Spotting

Separable Temporal Convolution plus Temporally Pooled Attention for Lightweight High-performance Keyword Spotting

Energy-Friendly Keyword Spotting System Using Add-Based Convolution.

Wake-up-word Spotting Using End-to-end Deep Neural Network System.

Small-footprint Keyword Spotting with Graph Convolutional Network

Robust Small-Footprint Keyword Spotting Using Sequence-To-Sequence Model With Connectionist Temporal Classifier

End-to-End Speech Keyword Spotting System

NS-KWS: joint optimization of near-sensor processing architecture and low-precision GRU for always-on keyword spotting

Hello Edge: Keyword Spotting on Microcontrollers

Frequency & Channel Attention Network for Small Footprint Noisy Spoken Keyword Spotting