Abstract:Query expansion techniques were originally developed for text information retrieval in order to retrieve the documents not containing the query terms but semantically related to the query. This is achieved by assuming the terms frequently occurring in the top-ranked documents in the first-pass retrieval results to be query-related and using them to expand the query to do the second-pass retrieval. However, when this approach was used for spoken content retrieval, the inevitable recognition errors and the OOV problems in ASR make it difficult for many query-related terms to be included in the expanded query, and much of the information carried by the speech signal is lost during recognition and not recoverable. In this paper, we propose to use a second ASR engine based on acoustic patterns automatically discovered from the spoken archive used for retrieval. These acoustic patterns are discovered directly based on the signal characteristics, and therefore can compensate for the information lost during recognition to a good extent. When a text query is entered, the system generates the first-pass retrieval results based on the transcriptions of the spoken segments obtained via the conventional ASR. The acoustic patterns frequently occurring in the spoken segments ranked on top of the first-pass results are considered as query-related, and the spoken segments containing these query-related acoustic patterns are retrieved. In this way, even though some query-related terms are OOV or incorrectly recognized, the segments including these terms can still be retrieved by acoustic patterns corresponding to these terms. Preliminary experiments performed on Mandarin broadcast news offered very encouraging results.

RESEARCH AND IMPLEMENTATION OF LUCENE-BASED RETRIEVAL SYSTEM OF AUDIO AND VIDEO RESOURCES

Research and Implementation of a Full-text Retrieval System

Speech Retrieval Engine Based on Relevance Feedback

The Research of Multimedia Cross Reference Retrieval System

INFORMA T ION RETRIEV A L BEYOND THE TEXT DOCUMENT

Semantic Retrieval of Video

Information Retrieval beyond the Text Document

A MULTI-CHANNEL RETRIEVAL SYSTEM FOR MULTIMEDIA DOCUMENTS

Leveraging Semantic and Lexical Matching to Improve the Recall of Document Retrieval Systems: A Hybrid Approach

Semantic-based Sound Retrieval by ERP in Rapid Serial Auditory Presentation Paradigm.

[Invited Paper] Strategies for Searching Video Content with Text Queries or Video Examples: Features, Semantic Detectors, Fusion, Efficient Search and Reranking

Audio retrieval based on perceptual similarity

Strategies for Searching Video Content with Text Queries or Video Examples.

Audio Retrieval: Based On Unsupervised Learning Approach

Design and Implementation of Cross-Search Retrieval System

Retrieval of Sports Video Clips Using Audio-Visual Features and Text Information

Semantic Retrieval of Video - Review of Research on Video Retrieval in Meetings, Movies and Broadcast News, and Sports

Videobase - A Prototype Of Video Database Managing System

Content Based Lecture Video Retrieval Using Speech and Video Text Information

Content-based Multi-media Retrieval Technology

Enhancing Query Expansion for Semantic Retrieval of Spoken Content with Automatically Discovered Acoustic Patterns.