Abstract:The keyword spotting (KWS) system is one of the most important interfaces between humans and machines since it is usually the start of automatic speech recognition and natural language processing techniques. However, for KWS hardware, it is still a problem to make one specified chip both low power and high performed under multiple scenarios, such as in meeting rooms, on different traffic or in parks and so on, for different scenarios own wide range signal-noise-ratios (SNRs). The problem leads to the requirements of balanced design between KWS system accuracy and the hardware cost under various noise types and levels. To overcome the balanced design and tradeoff problems, a complete KWS processor including an Mel-Frequency Cepstrum Coefficients (MFCC) feature extractor and a quantized Convolutional Neural Network (QCNN) accelerator is proposed for wide SNR range and low-power KWS in this paper. Firstly, the approach to quantize CNNs into QCNNs with high accuracy is proposed with considerations of hardware-software tradeoff. With the tradeoff of KWS system accuracy and hardware cost, the 4bit/8bit dual-working-mode strategy is proposed to keep low hardware cost and high accuracy under different scenarios. To be specific, the training, tuning and validating of the CNNs and QCNNs are taken with the dataset of 10 keywords chosen from the Google Command Speech Dataset (GCSD). Secondly, a serial FFT based MFCC extractor is implemented with low power and small footprint. Finally, with a novel hybrid reuse strategy of input data and network weight, a reconfigurable and approximate computing based QCNN accelerator is designed. Implemented and verified under TSMC 22nm ULL technology, with the area of 1.42mm2, the QCNN accelerator can achieve 5.26μW/9.08μW power consumption in 4bit/8bit work mode with accuracy of 88% and 93% respectively, which is superior to the state-of-the-art processors.

Robust Small-Footprint Keyword Spotting Using Sequence-To-Sequence Model With Connectionist Temporal Classifier

Small-Footprint Keyword Spotting with Multi-Scale Temporal Convolution

A Depthwise Separable Convolution Neural Network for Small-footprint Keyword Spotting Using Approximate MAC Unit and Streaming Convolution Reuse

Small-footprint Keyword Spotting with Graph Convolutional Network

Compact Feedforward Sequential Memory Networks For Small-Footprint Keyword Spotting

Effective Combination of DenseNet and BiLSTM for Keyword Spotting.

Focal Loss And Double-Edge-Triggered Detector For Robust Small-Footprint Keyword Spotting

A Monaural Speech Enhancement Method for Robust Small-Footprint Keyword Spotting.

Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting

A Separable Temporal Convolution Neural Network with Attention for Small-Footprint Keyword Spotting

Small-Footprint Open-Vocabulary Keyword Spotting with Quantized LSTM Networks

Low-Power Feature-Attention Chinese Keyword Spotting Framework with Distillation Learning.

NTC-KWS: Noise-aware CTC for Robust Keyword Spotting

Unrestricted Vocabulary Keyword Spotting Using LSTM-CTC

Separable Temporal Convolution plus Temporally Pooled Attention for Lightweight High-performance Keyword Spotting

Frequency & Channel Attention Network for Small Footprint Noisy Spoken Keyword Spotting

Streaming Keyword Spotting Boosted by Cross-layer Discrimination Consistency

Keyword Spotting Based on Syllable Confusion Network.

QCNN Inspired Reconfigurable Keyword Spotting Processor with Hybrid Data-Weight Reuse Methods

Low-Latency Convolutional Recurrent Neural Network for Keyword Spotting

Wake-up-word Spotting Using End-to-end Deep Neural Network System.