Abstract:As an important part of speech recognition technology, automatic speech keyword recognition has been intensively studied in recent years. Such technology becomes especially pivotal under situations with limited infrastructures and computational resources, such as voice command recognition in vehicles and robot interaction. At present, the mainstream methods in automatic speech keyword recognition are based on long short-term memory (LSTM) networks with attention mechanism. However, due to inevitable information losses for the LSTM layer caused during feature extraction, the calculated attention weights are biased. In this paper, a novel approach, namely Multi-layer Attention Mechanism, is proposed to handle the inaccurate attention weights problem. The key idea is that, in addition to the conventional attention mechanism, information of layers prior to feature extraction and LSTM are introduced into attention weights calculations. Therefore, the attention weights are more accurate because the overall model can have more precise and focused areas. We conduct a comprehensive comparison and analysis on the keyword spotting performances on convolution neural network, bi-directional LSTM cyclic neural network, and cyclic neural network with the proposed attention mechanism on Google Speech Command datasets V2 datasets. Experimental results indicate favorable results for the proposed method and demonstrate the validity of the proposed method. The proposed multi-layer attention methods can be useful for other researches related to object spotting.

A Time Delay Neural Network with Shared Weight Self-Attention for Small-Footprint Keyword Spotting

Depthwise Separable Convolutional ResNet with Squeeze-and-Excitation Blocks for Small-footprint Keyword Spotting

Small-footprint Keyword Spotting with Graph Convolutional Network

Compact Feedforward Sequential Memory Networks For Small-Footprint Keyword Spotting

Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting

Frequency & Channel Attention Network for Small Footprint Noisy Spoken Keyword Spotting

Broadcasted Residual Learning for Efficient Keyword Spotting

Small-footprint slimmable networks for keyword spotting

Low-complex and Highly-performed Binary Residual Neural Network for Small-footprint Keyword Spotting

Weight-importance sparse training in keyword spotting

Encoder-Decoder Neural Architecture Optimization for Keyword Spotting

Hello Edge: Keyword Spotting on Microcontrollers

Improved Keyword Spotting System by Optimizing Posterior Confidence Measure Vector Using Feed-Forward Neural Network.

Few-Shot Keyword Spotting With Prototypical Networks

Sparse Binarization for Fast Keyword Spotting

Hierarchical Neural Network Architecture In Keyword Spotting

Neural Networks for Keyword Spotting on IoT Devices

9.1 μW keyword spotting processor based on optimized MFCC and small‐footprint TENet in 28‐nm CMOS

Exploring Representation Learning for Small-Footprint Keyword Spotting

Multi-layer Attention Mechanism for Speech Keyword Recognition

Boosting Tail Neural Network for Realtime Custom Keyword Spotting