Abstract:Utterance verification based on on-line garbage (OLG) models is often adopted as the benchmark method. However, we find its performance can be remarkably improved by fine-tuning. In this study, OLG phoneme likelihood is proposed. It achieves much better performance and efficiency for task independent utterance verification to reject mis-recognition and OOV utterances than the OLG frame likelihood, which is usually employed. A keyword spotter and a voice confirmation system are adopted to evaluate the performance of verifiers on utterances of different natures. We find it is important to evaluate a verifier with OOV utterances of different natures. Instead of using the whole utterance for computing confidence measure, we only use the hypothesized part (i.e. the part recognized as a vocabulary word) of the utterance. Also, researches have been conducted to improve the verification performance and optimize the competing set in computing OLG likelihood. With 5.4% of the within-domain utterances rejected (FRR= 5.4%), the best verifier boosts accuracy of the keyword spotter for Private Branch Exchange from 90.3% to 94.9% and at the same time reject 99.5% of the irregular utterances and 97.4% of the irrelevant sentences (FAR below 2.6%).

Confidence Scoring Using Context Dependent Features for Word Verification

Using Word Confidence Measure for OOV Words Detection in a Spontaneous Spoken Dialog System.

Experimental Investigation into Alignment-based Acoustic Confidence Measures in Keyword Verification for Mandarin Speech

Enhancing Out-of-Domain Detection for Speech Spoofing Countermeasure Via Supervised Contrastive Learning

Utterance Verification Based on Support Vector Machine

Fintegrating Confidence Scores for Utterance Verification

Confidence Measures and Integrating Algorithm in Utterance Verification

An utterance verification algorithm in keyword spotting system

LEXICAL ACCESS-BASED CONFIDENCE MEASURE FOR A SPANISH KEYWORD SPOTTING SYSTEM

Using Confidence Scores to Improve Eyes-free Detection of Speech Recognition Errors

Improving task independent utterance verification based on on-line garbage phoneme likelihood

Utterance verification based on dynamic garbage evaluation approach

A Vocal Password System Based on Multi-Dimension Feature Classifier in Score Domain

An Evolutionary Confidence Measure for Spotting Words in Speech Recognition

Word Spotting Based on a Posterior Measure of Keyword Confidence

Confidence-features and Confidence-Scores for ASR Applications in Arbitration and DNN Speaker Adaptation.

A New Framework for Large Vocabulary Keyword Spotting Using Two-Pass Confidence Measure

Context Directed Speech Recognition in Dialogue Systems

A Dialogue System Based on Keyword Spotting Technology

Keyword Spotting Based on Hypothesis Boundary Realignment and State-Level Confidence Weighting

The Confidence Measures for Isolated Word Recognition System