Abstract:(Part of the abstract) In this thesis, we investigate the use of unsupervised spoken term discovery in tackling this problem. Unsupervised spoken term discovery aims to discover topic-related terminologies in a speech without knowing the phonetic properties of the language and content. It can be further divided into two parts: Acoustic segment modelling (ASM) and unsupervised pattern discovery. ASM learns the phonetic structures of zero-resource language audio with no phonetic knowledge available, generating self-derived "phonemes". The audio are labelled with these "phonemes" to obtain "phoneme" sequences. Unsupervised pattern discovery searches for repetitive patterns in the "phoneme" sequences. The discovered patterns can be grouped to determine the keywords of the audio. Multilingual neural network with bottleneck layer is used for feature extraction. Experiments show that bottleneck features facilitate the training of ASM compared to conventional features such as MFCC. The unsupervised spoken term discovery system is experimented with online lectures covering different topics by different speakers. It is shown that the system learns the phonetic information of the language and can discover frequent spoken terms that align with text transcription. By using information retrieval technology such as word embedding and TFIDF, it is shown that the discovered keywords can be further used for topic comparison.

Unsupervised Spoken Term Discovery on Untranscribed Speech

Unsupervised Pattern Discovery from Thematic Speech Archives Based on Multilingual Bottleneck Features

Unsupervised Spoken Term Discovery Based on Re-clustering of Hypothesized Speech Segments with Siamese and Triplet Networks

Weakly supervised spoken term discovery using cross-lingual side information

Unsupervised Discovery of Structured Acoustic Tokens with Applications to Spoken Term Detection

Spoken-Term Discovery using Discrete Speech Units

Unsupervised two-stage keyword extraction from spoken documents by topic coherence and support vector machine

Exploiting Cross-Lingual Knowledge in Unsupervised Acoustic Modeling for Low-Resource Languages

Towards Unsupervised Semantic Retrieval Of Spoken Content With Query Expansion Based On Automatically Discovered Acoustic Patterns

Towards Unsupervised Speech Recognition Without Pronunciation Models

A Weakly Supervised Learning Approach for Spoken Language Understanding.

Word Discovery in Visually Grounded, Self-Supervised Speech Models

From Semi-supervised to Almost-unsupervised Speech Recognition with Very-low Resource by Jointly Learning Phonetic Structures from Audio and Text Embeddings.

Towards Unsupervised Automatic Speech Recognition Trained by Unaligned Speech and Text only

Unsupervised Discovery of Recurring Speech Patterns Using Probabilistic Adaptive Metrics

Unsupervised Transfer Learning for Spoken Language Understanding in Intelligent Agents

Segmental Audio Word2Vec: Representing Utterances as Sequences of Vectors with Applications in Spoken Term Detection

Unsupervised Training and Directed Manual Transcription for LVCSR

Unsupervised acoustic unit discovery for speech synthesis using discrete latent-variable neural networks

Spoken Term Detection from Bilingual Spontaneous Speech Using Code-Switched Lattice-Based Structures for Words and Subword Units.

On the Unsupervised Analysis of Domain-Specific Chinese Texts