Abstract:Always-on keyword spotting (KWS) that detects wake-up words has been the indispensable module in the voice interaction system. However, the ultra-low-power embedded devices put forward strict requirements on energy consumption, latency, and recognition accuracy of KWS. In this work, we propose a near-sensor processing architecture of feature-configurable distributed network (NS-FDN) for always-on KWS applications. The proposed distributed network adapts to the flexible keywords demands in the actual scene by splitting the conventional single network into distributed sub-networks. We design a channel-independent training framework to improve the recognition accuracy of distributed networks. The speech features are evaluated and the redundancy is reduced in NS-FDN, which can also configure the speech features to further reduce the computing complexity and improve processing speed. For deeper optimization, we implement a 65nm-process prototype chip with near-sensor mixed-signal processing architecture avoiding energy-consuming analog-to-digital converter. By improving the system, algorithm, and hardware designs of the KWS, our co-optimized architecture eliminates the energy consumption bottleneck long-standing in conventional KWS systems and achieves state-of-the-art system performance. The experiment results show that NS-FDN achieves 31.6% energy consumption savings, 1.6 times memory savings, 57 times speedup, and 3.4% higher recognition accuracy compared with the state of the art.

A fixed-point neural network for keyword detection on resource constrained hardware

A Fixed-Point Neural Network Architecture for Speech Applications on Resource Constrained Hardware

9.1 μW keyword spotting processor based on optimized MFCC and small‐footprint TENet in 28‐nm CMOS

Hello Edge: Keyword Spotting on Microcontrollers

Residual Spiking Neural Network on a Programmable Neuromorphic Hardware for Speech Keyword Spotting

Low-complex and Highly-performed Binary Residual Neural Network for Small-footprint Keyword Spotting

Compact Feedforward Sequential Memory Networks For Small-Footprint Keyword Spotting

A 110nw Always-on Keyword Spotting Chip Using Spiking CNN in 40nm CMOS.

More is Less: Domain-Specific Speech Recognition Microprocessor Using One-Dimensional Convolutional Recurrent Neural Network

NS-KWS: joint optimization of near-sensor processing architecture and low-precision GRU for always-on keyword spotting

Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting

Model compression applied to small-footprint keyword spotting

NS-FDN: Near-Sensor Processing Architecture of Feature-Configurable Distributed Network for Beyond-Real-Time Always-on Keyword Spotting

A 510-nW Wake-Up Keyword-Spotting Chip Using Serial-FFT-Based MFCC and Binarized Depthwise Separable CNN in 28-nm CMOS

A 11.6μ W Computing-on-Memory-Boundary Keyword Spotting Processor with Joint MFCC-CNN Ternary Quantization

Hardware Aware Training for Efficient Keyword Spotting on General Purpose and Specialized Hardware

Benchmarking Keyword Spotting Efficiency on Neuromorphic Hardware

Sub-mW Keyword Spotting on an MCU: Analog Binary Feature Extraction and Binary Neural Networks

A Time Delay Neural Network with Shared Weight Self-Attention for Small-Footprint Keyword Spotting

Low-Power Audio Keyword Spotting using Tsetlin Machines

Model Shrinking for Embedded Keyword Spotting