Abstract:We consider feature learning for efficient keyword spotting that can be applied in severely under-resourced settings. The objective is to support humanitarian relief programmes by the United Nations in parts of Africa in which almost no language resources are available. For rapid development in such languages, we rely on a small, easily-compiled set of isolated keywords. These keyword templates are applied to a large corpus of in-domain but untranscribed speech using dynamic time warping (DTW). The resulting DTW alignment scores are used to train a convolutional neural network (CNN) which is orders of magnitude more computationally efficient and suitable for real-time application. We optimise this neural network keyword spotter by identifying robust acoustic features in this almost zero-resource setting. First, we incorporate information from well-resourced but unrelated languages using a multilingual bottleneck feature (BNF) extractor. Next, we consider features extracted from an autoencoder (AE) trained on in-domain but untranscribed data. Finally, we consider correspondence autoencoder (CAE) features which are fine-tuned on the small set of in-domain labelled data. Experiments in South African English and Luganda, a low-resource language, show that BNF and CAE features achieve a 5% relative performance improvement over baseline MFCCs. However, using BNFs as input to the CAE results in a more than 27% relative improvement over MFCCs in ROC area-under-the-curve (AUC) and more than twice as many top-10 retrievals. We show that, using these features, the CNN-DTW keyword spotter performs almost as well as the DTW keyword spotter while outperforming a baseline CNN trained only on the keyword templates. The CNN-DTW keyword spotter using BNF-derived CAE features represents an efficient approach with competitive performance suited to rapid deployment in a severely under-resourced scenario.

AraSpot: Arabic Spoken Command Spotting

Keyword Spotting for Hearing Assistive Devices Robust to External Speakers

Seeing wake words: Audio-visual Keyword Spotting

Open-vocabulary Keyword-spotting with Adaptive Instance Normalization

Synth4Kws: Synthesized Speech for User Defined Keyword Spotting in Low Resource Environments

Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting

Audio-visual Keyword Spotting Based on Adaptive Decision Fusion under Noisy Conditions for Human-Robot Interaction.

Sparse Binarization for Fast Keyword Spotting

KFA: Keyword Feature Augmentation for Open Set Keyword Spotting

Feature learning for efficient ASR-free keyword spotting in low-resource languages

Data Augmentation for Robust Keyword Spotting under Playback Interference

Focal Loss And Double-Edge-Triggered Detector For Robust Small-Footprint Keyword Spotting

A New Keyword Spotting Approach for Spontaneous Mandarin Speech

HarkMan—A Vocabulary-Independent Keyword Spotter for Spontaneous Chinese Speech

SLiCK: Exploiting Subsequences for Length-Constrained Keyword Spotting

A VOCABULARY-INDEPENDENT KEYWORD SPOTTER FOR SPONTANEOUS CHINESE SPEECH

TDT-KWS: Fast And Accurate Keyword Spotting Using Token-and-duration Transducer

Small vocabulary isolated-word automatic speech recognition for single-word commands in Arabic spoken

Robust Dual-Modal Speech Keyword Spotting for XR Headsets

Neuromorphic Keyword Spotting with Pulse Density Modulation MEMS Microphones