Abstract:Query expansion techniques were originally developed for text information retrieval in order to retrieve the documents not containing the query terms but semantically related to the query. This is achieved by assuming the terms frequently occurring in the top-ranked documents in the first-pass retrieval results to be query-related and using them to expand the query to do the second-pass retrieval. However, when this approach was used for spoken content retrieval, the inevitable recognition errors and the OOV problems in ASR make it difficult for many query-related terms to be included in the expanded query, and much of the information carried by the speech signal is lost during recognition and not recoverable. In this paper, we propose to use a second ASR engine based on acoustic patterns automatically discovered from the spoken archive used for retrieval. These acoustic patterns are discovered directly based on the signal characteristics, and therefore can compensate for the information lost during recognition to a good extent. When a text query is entered, the system generates the first-pass retrieval results based on the transcriptions of the spoken segments obtained via the conventional ASR. The acoustic patterns frequently occurring in the spoken segments ranked on top of the first-pass results are considered as query-related, and the spoken segments containing these query-related acoustic patterns are retrieved. In this way, even though some query-related terms are OOV or incorrectly recognized, the segments including these terms can still be retrieved by acoustic patterns corresponding to these terms. Preliminary experiments performed on Mandarin broadcast news offered very encouraging results.

Improving keyword search by query expansion in a probabilistic framework

Experimental Investigation into Alignment-based Acoustic Confidence Measures in Keyword Verification for Mandarin Speech

Keyword Spotting Based on Hypothesis Boundary Realignment and State-Level Confidence Weighting

Subword scheme for keyword search

A Two-Step Keyword Spotting Method Based on Context-Dependent a Posteriori Probability

Keyword-specific normalization based keyword spotting for spontaneous speech

Query Expansion Based on Clustered Results

Improved Semantic Retrieval of Spoken Content by Document/Query Expansion with Random Walk Over Acoustic Similarity Graphs

Augmented Keyword Search on Spatial Entity Databases

Calibration of Word Posterior Estimation in Confusion Networks for Keyword Search

AB/BA analysis: A framework for estimating keyword spotting recall improvement while maintaining audio privacy

Probabilistic Query Expansion Using Query Logs

Audio-visual Keyword Spotting for Mandarin Based on Discriminative Local Spatial-Temporal Descriptors.

Exploiting Noisy Web Data by OOV Ranking for Low-Resource Keyword Search.

U2-KWS: Unified Two-pass Open-vocabulary Keyword Spotting with Keyword Bias

A Novel Discriminative Score Calibration Method for Keyword Search

End-to-end keyword search system based on attention mechanism and energy scorer for low resource languages

A New Keyword Spotting Approach for Spontaneous Mandarin Speech

Enhancing Query Expansion for Semantic Retrieval of Spoken Content with Automatically Discovered Acoustic Patterns.

MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting

Concept Based Query Expansion Using Wordnet