Abstract:Keyword Spotting (KWS) is the task of recognizing spoken command words from a database. With recent application human-machine interactions, KWS systems require real-time performance, where edge computing is a preferable option. To allow KWS systems to work on fast and real-time implementation, a low-complexity yet high-accurate AI model is mandatory. In this paper, we propose a comprehensive voice command recognition system design and its hardware implementation. The proposed AI model considered in this system is SpectroNet-based and an efficient hybrid CNN-LSTM architecture with low complexity. Jetson Xavier NX is an edge device because of its strong computational power as an embedded device. The implementation result shows the proposed method offers quite good in terms of accuracy, indicated by no accuracy drop between the model implemented in PC and Jetson Xavier. However, the inference time is quite high, which is 180 ms/step. To improve the speed of the system, the TensorRT library is used to further optimize the model. Optimization of the model is found effective, reducing 59.35% of the total operation performed in SpectroNet when FP32 precision is used, and 59.63% when FP16 precision is used. The model is also sped up by 45% if FP32 precision mode is used and 62% if FP16 precision mode is used. However, there is a slight accuracy drop of 2.68% if FP32 precision mode is used and 4.84% if FP16 precision mode is used. This slight drop in accuracy is considered negligible compared to the performance boost that TensorRT gives. The work is useful for intelligent control systems such as smart vehicles, smartphones, computers, and smart communications.

Neural Networks for Keyword Spotting on IoT Devices

Hello Edge: Keyword Spotting on Microcontrollers

Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting

Sparse Binarization for Fast Keyword Spotting

A 110nw Always-on Keyword Spotting Chip Using Spiking CNN in 40nm CMOS.

Low-Power Audio Keyword Spotting using Tsetlin Machines

Efficient Real-Time Smart Keyword Spotting Using Spectrogram-Based Hybrid CNN-LSTM for Edge System

Hierarchical Neural Network Architecture In Keyword Spotting

Small-footprint Keyword Spotting with Graph Convolutional Network

FPGA Implementation of Keyword Spotting System Using Depthwise Separable Binarized and Ternarized Neural Networks

Residual Spiking Neural Network on a Programmable Neuromorphic Hardware for Speech Keyword Spotting

Low-complex and Highly-performed Binary Residual Neural Network for Small-footprint Keyword Spotting

Few-Shot Keyword Spotting With Prototypical Networks

A Time Delay Neural Network with Shared Weight Self-Attention for Small-Footprint Keyword Spotting

Encoder-Decoder Neural Architecture Optimization for Keyword Spotting

Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spotting

Speech Recognition: Keyword Spotting Through Image Recognition

Small-footprint slimmable networks for keyword spotting

Frequency & Channel Attention Network for Small Footprint Noisy Spoken Keyword Spotting

SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers

Sub-mW Keyword Spotting on an MCU: Analog Binary Feature Extraction and Binary Neural Networks