Abstract:This thesis presents a computational theory of unsupervised language acquisition, precisely defining procedures for learning language from ordinary spoken or written utterances, with no explicit help from a teacher. The theory is based heavily on concepts borrowed from machine learning and statistical estimation. In particular, learning takes place by fitting a stochastic, generative model of language to the evidence. Much of the thesis is devoted to explaining conditions that must hold for this general learning strategy to arrive at linguistically desirable grammars. The thesis introduces a variety of technical innovations, among them a common representation for evidence and grammars, and a learning strategy that separates the ``content'' of linguistic parameters from their representation. Algorithms based on it suffer from few of the search problems that have plagued other computational approaches to language acquisition. The theory has been tested on problems of learning vocabularies and grammars from unsegmented text and continuous speech, and mappings between sound and representations of meaning. It performs extremely well on various objective criteria, acquiring knowledge that causes it to assign almost exactly the same structure to utterances as humans do. This work has application to data compression, language modeling, speech recognition, machine translation, information retrieval, and other tasks that rely on either structural or stochastic descriptions of language.

A procedure for unsupervised lexicon learning

The Unsupervised Acquisition of a Lexicon from Continuous Speech

Continuously Learning New Words in Automatic Speech Recognition

Grammar-Based Semi-Supervised Incremental Learning in Automatic Speech Recognition and Labeling

Bilingual Lexicon Induction from Non-Parallel Data with Minimal Supervision.

Sequential Editing for Lifelong Training of Speech Recognition Models

Unsupervised Training and Directed Manual Transcription for LVCSR

Self-consistent context aware conformer transducer for speech recognition

From Semi-supervised to Almost-unsupervised Speech Recognition with Very-low Resource by Jointly Learning Phonetic Structures from Audio and Text Embeddings.

Unsupervised Language Acquisition

Federated Self-Learning with Weak Supervision for Speech Recognition

Unsupervised End-to-End Learning of Discrete Linguistic Units for Voice Conversion

Revisiting speech segmentation and lexicon learning with better features

Semi-Supervised Learning for Bilingual Lexicon Induction

INCREMENTAL LEARNING FOR END-TO-END AUTOMATIC SPEECH RECOGNITION

Towards Unsupervised Speech Recognition Without Pronunciation Models

Unsupervised Online Continual Learning for Automatic Speech Recognition

The Acquisition of a Lexicon from Paired Phoneme Sequences and Semantic Representations

Study of Semi-supervised Approaches to Improving English-Mandarin Code-Switching Speech Recognition

Progressive Multi-scale Self-supervised Learning for Speech Recognition

Continual Learning for On-Device Speech Recognition using Disentangled Conformers