Abstract:This paper addresses the persistent challenge in Keyword Spotting (KWS), a fundamental component in speech technology, regarding the acquisition of substantial labeled data for training. Given the difficulty in obtaining large quantities of positive samples and the laborious process of collecting new target samples when the keyword changes, we introduce a novel approach combining unsupervised contrastive learning and a unique augmentation-based technique. Our method allows the neural network to train on unlabeled data sets, potentially improving performance in downstream tasks with limited labeled data sets. We also propose that similar high-level feature representations should be employed for speech utterances with the same keyword despite variations in speed or volume. To achieve this, we present a speech augmentation-based unsupervised learning method that utilizes the similarity between the bottleneck layer feature and the audio reconstructing information for auxiliary training. Furthermore, we propose a compressed convolutional architecture to address potential redundancy and non-informative information in KWS tasks, enabling the model to simultaneously learn local features and focus on long-term information. This method achieves strong performance on the Google Speech Commands V2 Dataset. Inspired by recent advancements in sign spotting and spoken term detection, our method underlines the potential of our contrastive learning approach in KWS and the advantages of Query-by-Example Spoken Term Detection strategies. The presented CAB-KWS provide new perspectives in the field of KWS, demonstrating effective ways to reduce data collection efforts and increase the system's robustness.

Temporal Convolution Shrinkage Network for Keyword Spotting.

Frequency & Channel Attention Network for Small Footprint Noisy Spoken Keyword Spotting

TDT-KWS: Fast And Accurate Keyword Spotting Using Token-and-duration Transducer

Contrastive Augmentation: An Unsupervised Learning Approach for Keyword Spotting in Speech Technology

Speech Keyword Spotting Method Based on Swin-Transformer Model

Keyword-Specific Acoustic Model Pruning for Open-Vocabulary Keyword Spotting

DCCRN-KWS: an audio bias based model for noise robust small-footprint keyword spotting

Keyword-specific normalization based keyword spotting for spontaneous speech

Audio-visual Keyword Spotting for Mandarin Based on Discriminative Local Spatial-Temporal Descriptors.

A Study of Designing Compact Audio-Visual Wake Word Spotting System Based on Iterative Fine-Tuning in Neural Network Pruning

Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting

Supervised Attention Multi-Scale Temporal Convolutional Network for monaural speech enhancement

SpatialNet: Extensively Learning Spatial Information for Multichannel Joint Speech Separation, Denoising and Dereverberation

Understanding temporally weakly supervised training: A case study for keyword spotting

Audio–visual Keyword Transformer for Unconstrained Sentence‐level Keyword Spotting

Masking and Inpainting: A Two-Stage Speech Enhancement Approach for Low SNR and Non-Stationary Noise

A Novel Re-weighted CTC Loss for Data Imbalance in Speech Keyword Spotting

Keyword Spotting for Hearing Assistive Devices Robust to External Speakers

Speech preprocessing and enhancement based on joint time domain and time-frequency domain analysis

Audio-Visual Keyword Spotting Based on Multidimensional Convolutional Neural Network

Query-by-Example Keyword Spotting Using Spectral-Temporal Graph Attentive Pooling and Multi-Task Learning