Abstract:<p>Keyword search (KWS) means searching for keywords given by the user from continuous speech. Conventional KWS systems are based on Automatic Speech Recognition (ASR), where the input speech has to be first processed by the ASR system before keyword searching. In the recent decade, as deep learning and deep neural networks (DNN) become increasingly popular, KWS systems can also be trained in an end-to-end (E2E) manner. The main advantage of E2E KWS is that there is no need for speech recognition, which makes the training and searching procedure much more straightforward than the traditional ones. This article proposes an E2E KWS model, which consists of four parts: speech encoder-decoder, query encoder-decoder, attention mechanism, and energy scorer. Firstly, the proposed model outperforms the baseline model. Secondly, we find that under various supervision, character or phoneme sequences, speech or query encoders can extract the corresponding information, resulting in different performances. Moreover, we introduce an attention mechanism and invent a novel energy scorer, where the former can help locate keywords. The latter can make final decisions by considering speech embeddings, query embeddings, and attention weights in parallel. We evaluate our model on low resource conditions with about 10-hour training data for four different languages. The experiment results prove that the proposed model can work well on low resource conditions.</p>

The THUEE System for the Openkws14 Keyword Search Evaluation.

High-Performance Swahili Keyword Search with Very Limited Language Pack: the Thuee System for the Openkws15 Evaluation

THUEE Language Modeling Method for the OpenKWS 2015 Evaluation

THUEE system description for NIST 2020 SRE CTS challenge

THUEE System for NIST SRE19 CTS Challenge.

End-to-end keyword search system based on attention mechanism and energy scorer for low resource languages

THU-EE System Description for NIST LRE 2015

U2-KWS: Unified Two-pass Open-vocabulary Keyword Spotting with Keyword Bias

THUEE system description for NIST 2019 SRE CTS Challenge

TDT-KWS: Fast And Accurate Keyword Spotting Using Token-and-duration Transducer

Subword scheme for keyword search

Multilingual Query-by-Example Keyword Spotting with Metric Learning and Phoneme-to-Embedding Mapping

Thuee system description for mce 2018

The 14u System In Nist 2008 Speaker Recognition Evaluation

GE2E-KWS: Generalized End-to-End Training and Evaluation for Zero-shot Keyword Spotting

Focal Loss And Double-Edge-Triggered Detector For Robust Small-Footprint Keyword Spotting

Improving keyword search by query expansion in a probabilistic framework

THUEE system for the Albayzin 2012 language recognition evaluation

The NPU System for the 2020 Personalized Voice Trigger Challenge

THU-EE System Fusion for the NIST 2012 Speaker Recognition Evaluation.

Query-by-Example Keyword Spotting Using Spectral-Temporal Graph Attentive Pooling and Multi-Task Learning