Abstract:The focus of this thesis is to address a number of research issues in developing an effective large vocabulary continuous speech recognition (LVCSR) based on-line spoken document retrieval system. Within this framework, the primary thesis contributions include the following distinct yet related areas: The first thesis contribution addresses the problem of efficient audio stream parsing. Here, an extension to the previously proposed Bayesian Information Criterion (BIC) based algorithm is formulated as T 2-BIC, by integrating the Hotelling's T2-Statistic into BIC. Using the proposed algorithm, a significant computational speed improvement is demonstrated with superior parsing performance. Second, novel rapid model adaptation techniques, entitled Eigenspace Mapping, represent a primary contribution from this thesis. The idea of Eigenspace Mapping is to construct discriminative acoustic models for the test speaker by preserving the dominant discriminating power from the baseline model along the test speaker's first primary eigendirections. The adaptation process is accomplished through a linear transformation in the model space. Based on this key idea, a number of algorithms can be formulated such as EigMap, and extensions using different objective functions including the Structural Maximum Likelihood Eigenspace Mapping. Unsupervised adaptation experiments show that the proposed algorithms are effective using very limited amounts of adaptation data. Furthermore, the proposed algorithms are highly additive to other traditional methods such as MLLR by bringing additional discrimination information. Finally, the last contribution focuses on an experimental on-line spoken document retrieval system, SpeechFind, which is designed and implemented by incorporatitig state-of-the-art LVCSR and information retrieval (IR) technologies. In addition to system development efforts, contributions have been made to enhance the quality of automatic transcripts and several methods such as query and document expansions have been developed to overcome the issue of IR over corrupted transcripts. Collectively, the contributions made in these three related areas have resulted in an effective and integrated on-line spoken document retrieval system. Moreover, the proposed audio parsing and novel rapid speaker adaptation algorithms have helped advance the state of the art in robust speech recognition.

Speechfind: an experimental on-line spoken document retrieval system for historical audio archives.

SpeechFind: Advances in Spoken Document Retrieval for a National Gallery of the Spoken Word

Audio stream phrase recognition for a national gallery of the spoken word: "one small step"

Voice input/output interface for online searching: some design and human factor considerations

Audio parsing and rapid speaker adaptation in speech recognition for spoken document retrieval

The language of sound search: Examining User Queries in Audio Search Engines

Language Modeling Structures in Audio Transcription for Retrieval of Historical Speeches

Vocal Access to a Newspaper Archive: Design Issues and Preliminary Investigation

Detectability and Comprehensibility Study on Audio Hyperlinking Methods

Speech Technology Services for Oral History Research

Scalable Identity-Oriented Speech Retrieval

Building the National Radio Recordings Database: A Big Data Approach to Documenting Audio Heritage

A Scalable Video Search Engine Based on Audio Content Indexing and Topic Segmentation

Community-Supported Shared Infrastructure in Support of Speech Accessibility

Speech Retrieval Engine Based on Relevance Feedback

Simon Fraser University Speech Error Database (SFUSED) Cantonese: Methods, design, and usage

Query Expansion Based High Performance Chinese Voice Retrieval

Sound Search by Text Description or Vocal Imitation?

An undergraduate Mandarin speech database for speaker recognition research

Enhancing Query Expansion for Semantic Retrieval of Spoken Content with Automatically Discovered Acoustic Patterns.

A lexical database tool for quantitative phonological research