Abstract:Information retrieval from spoken audio has attracted the attention of a number of research groups, in part driven by the recent NIST Spoken Term Detection (STD) evaluation. A common approach is to split the task into two stages. In the first, a large vocabulary continuous speech recognition (LVCSR) system is used to generate a word or phone lattice corresponding to the audio, and in the second, lattice search is used to determine likely occurrences of the search terms. Searching a word-based lattice works well for terms which occur in the LVCSR system's vocabulary. However, search terms naturally have a tendency toward proper nouns, which leads to higher out-of-vocabulary (OOV) rates than found in transcription tasks. A standard method for dealing with OOV terms is to generate a phone sequence corresponding to the terms, which may be then be searched for in a phone lattice. In this work, we propose using context-dependent graphemes (CDG) as sub-word units for spoken term detection, in particular for out-of-vocabulary search terms. In essence, this approach moves pronunciation modelling away from the letter-to-sound rules which are used to generate phone strings, and into the Gaus-sian mixture models which describe the observation space. This removes the need to make potentially error-prone hard decisions at an early stage of processing. In addition, words which have multiple pronunciations have a single grapheme representation which simplifies the subsequent search. Large text corpora can be used to train long-span grapheme-based language models for use in lattice generation. These language models have words implicit within them, though given suitable smoothing can be used to support previously unseen words. In this work, we first present the results of phone and grapheme recognition, in addition to word recognition based on phone and grapheme sub-word units. On the RT04s independent headset microphone (IHM) test condition, we find word error rate (WER) using phone sub-word units lower than that with graphemes, 44.5% compared to 54.5%. The phone error rate (PER) is 48.2%, slightly higher than the grapheme error rate (GER) of 46.3%, though these are not directly comparable as there are fewer graphemes than phones. We then present results on a spoken term detection (STD) task. Again using the RT04s test set, 78 in-vocabulary words and 64 out-of-vocabulary words were selected as search terms from the reference transcription. HTK was used to generate word or sub-word lattices, and a tool developed at Brno [1] used to …

Addressing the Out-of-vocabulary Problem for Large-Scale Chinese Spoken Term Detection

Out-of-Vocabulary Issue in Chinese Spoken Term Detection and A Two-Stage Chinese Speech Retrieval Method

Towards Vocabulary-Independent Speech Indexing for Large-Scale Repositories

Fusion of Multiple Features and Supervised Learning for Chinese OOV Term Detection and POS Guessing.

Term-Dependent Confidence For Out-Of-Vocabulary Term Detection

A Study of Lattice-Based Spoken Term Detection for Chinese Spontaneous Speech

Enhancing Out-of-Domain Detection for Speech Spoofing Countermeasure Via Supervised Contrastive Learning

Incorporate Web Search Technology to Solve Out-of-Vocabulary Words in Chinese Word Segmentation.

Chinese-English Oov Term Translation With Web Mining, Multiple Feature Fusion And Supervised Learning

Term-Dependent Confidence Normalisation for Out-of-Vocabulary Spoken Term Detection

Stochastic Pronunciation Modeling for Out-of-Vocabulary Spoken Term Detection

Lattice-based Indexing for Spontaneous Mandarin Speech

Fusing Multiple Systems into a Compact Lattice Index for Chinese Spoken Term Detection.

Combining Lattice-Based Language Dependent and Independent Approaches for Out-of-Language Detection in LVCSR.

Crf-Based Stochastic Pronunciation Modeling For Out-Of-Vocabulary Spoken Term Detection

Using Word Confidence Measure for OOV Words Detection in a Spontaneous Spoken Dialog System.

A Unified Model for Solving the OOV Problem of Chinese Word Segmentation

Grapheme-based Spoken Term Detection in the Meetings Domain Extended abstract submitted to MLMI-07

Emphasizing Unseen Words: New Vocabulary Acquisition for End-to-End Speech Recognition

Domain-Aware Word Segmentation for Chinese Language: A Document-Level Context-Aware Model

Open-Vocabulary Retrieval of Spoken Content with Shorter/Longer Queries Considering Word/Subword-based Acoustic Feature Similarity.