Abstract:This paper addresses the persistent challenge in Keyword Spotting (KWS), a fundamental component in speech technology, regarding the acquisition of substantial labeled data for training. Given the difficulty in obtaining large quantities of positive samples and the laborious process of collecting new target samples when the keyword changes, we introduce a novel approach combining unsupervised contrastive learning and a unique augmentation-based technique. Our method allows the neural network to train on unlabeled data sets, potentially improving performance in downstream tasks with limited labeled data sets. We also propose that similar high-level feature representations should be employed for speech utterances with the same keyword despite variations in speed or volume. To achieve this, we present a speech augmentation-based unsupervised learning method that utilizes the similarity between the bottleneck layer feature and the audio reconstructing information for auxiliary training. Furthermore, we propose a compressed convolutional architecture to address potential redundancy and non-informative information in KWS tasks, enabling the model to simultaneously learn local features and focus on long-term information. This method achieves strong performance on the Google Speech Commands V2 Dataset. Inspired by recent advancements in sign spotting and spoken term detection, our method underlines the potential of our contrastive learning approach in KWS and the advantages of Query-by-Example Spoken Term Detection strategies. The presented CAB-KWS provide new perspectives in the field of KWS, demonstrating effective ways to reduce data collection efforts and increase the system's robustness.

Noise-Robust Keyword Spotting through Self-supervised Pretraining

Improving Label-Deficient Keyword Spotting Through Self-Supervised Pretraining

Understanding temporally weakly supervised training: A case study for keyword spotting

Self-Learning for Personalized Keyword Spotting on Ultra-Low-Power Audio Sensors

Noisy student-teacher training for robust keyword spotting

Weakly-Supervised Speech Pre-training: A Case Study on Target Speech Recognition

Keyword Spotting for Hearing Assistive Devices Robust to External Speakers

Contrastive Augmentation: An Unsupervised Learning Approach for Keyword Spotting in Speech Technology

Disentangled Training with Adversarial Examples For Robust Small-footprint Keyword Spotting

Semi-Supervised Federated Learning for Keyword Spotting

Speech Augmentation Based Unsupervised Learning for Keyword Spotting

Exploring Representation Learning for Small-Footprint Keyword Spotting

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

One-Step Knowledge Distillation and Fine-Tuning in Using Large Pre-Trained Self-Supervised Learning Models for Speaker Verification

Self-supervised Pretraining for Robust Personalized Voice Activity Detection in Adverse Conditions

Few-Shot Keyword Spotting from Mixed Speech

Conditional Online Learning for Keyword Spotting

Adversarial training of Keyword Spotting to Minimize TTS Data Overfitting

Pretraining End-to-End Keyword Search with Automatically Discovered Acoustic Units

A Pre-training Framework that Encodes Noise Information for Speech Quality Assessment

Joint Prediction and Denoising for Large-scale Multilingual Self-supervised Learning