Abstract:Semantic slot filling is one of the most challenging problems in spoken language understanding (SLU) because of automatic speech recognition (ASR) errors. To improve the performance of slot filling, a successful approach is to use a statistical model that is trained on ASR one-best hypotheses. The state of the art models for slot filling rely on using discriminative sequence modeling methods, such as conditional random fields (CRFs), recurrent neural networks (RNNs) and the recent recurrent CRF (R-CRF) model. In our previous work, we have also proposed the combination model of CRF and deep belief network (CRFDBN). However, they are mostly trained with the one-best hypotheses from the ASR system. In this paper, we propose to exploit word confusion networks (WCNs) by taking the word bins in a WCN as training or testing units instead of the independent words. The units are represented by vectors composed of multiple aligned ASR hypotheses and the corresponding posterior probabilities. Before training the model, we cluster similar units that may originate from the same word. We apply our proposed method to the CRF, CRF-DBN and R-CRF models. The experiments on ATIS corpus show consistent improvements of the performance by using WCNs.

Calibration of Word Posterior Estimation in Confusion Networks for Keyword Search

A Novel Discriminative Score Calibration Method for Keyword Search

Experimental Investigation into Alignment-based Acoustic Confidence Measures in Keyword Verification for Mandarin Speech

Word Spotting Based on a Posterior Measure of Keyword Confidence

Improved Keyword Spotting System by Optimizing Posterior Confidence Measure Vector Using Feed-Forward Neural Network.

Improving keyword search by query expansion in a probabilistic framework

Bayesian Estimation of Keyword Confidence in Chinese Continuous Speech Recognition

Keyword Spotting Based on Syllable Confusion Network.

LEXICAL ACCESS-BASED CONFIDENCE MEASURE FOR A SPANISH KEYWORD SPOTTING SYSTEM

Auc Optimization Based Confidence Measure for Keyword Spotting

Using Word Confusion Networks for Slot Filling in Spoken Language Understanding.

An lstm-ctc based verification system for proxy-word based oov keyword search

Keyword Spotting Based on Hypothesis Boundary Realignment and State-Level Confidence Weighting

A Rescoring Approach for Keyword Search Using Lattice Context Information.

Posterior-based confidence measures for spoken term detection

A Two-Step Keyword Spotting Method Based on Context-Dependent a Posteriori Probability

Keyword Spotting Based on Phoneme Confusion Matrix

Syllable Based Audio Search Using Confusion Network Arc As Indexing Unit

A NOVEL TWO-LEVEL ARCHITECTURE PLUS CONFIDENCE MEASURES FOR A KEYWORD SPOTTING SYSTEM

Posteriori Confidence Measure of Keyword in Internet Phone Speech Recognition

A Comparative Study on Confidence Measure in Mandarin Command Word Recognition