Abstract:For decades, context-dependent phonemes have been the dominant sub-word unit for conventional acoustic modeling systems. This status quo has begun to be challenged recently by end-to-end models which seek to combine acoustic, pronunciation, and language model components into a single neural network. Such systems, which typically predict graphemes or words, simplify the recognition process since they remove the need for a separate expert-curated pronunciation lexicon to map from phoneme-based units to words. However, there has been little previous work comparing phoneme-based versus grapheme-based sub-word units in the end-to-end modeling framework, to determine whether the gains from such approaches are primarily due to the new probabilistic model, or from the joint learning of the various components with grapheme-based units. In this work, we conduct detailed experiments which are aimed at quantifying the value of phoneme-based pronunciation lexica in the context of end-to-end models. We examine phoneme-based end-to-end models, which are contrasted against grapheme-based ones on a large vocabulary English Voice-search task, where we find that graphemes do indeed outperform phonemes. We also compare grapheme and phoneme-based approaches on a multi-dialect English task, which once again confirm the superiority of graphemes, greatly simplifying the system for recognizing multiple dialects.

Basis Identification for Automatic Creation of Pronunciation Lexicon for Proper Names

Exploring Generation of Pronunciation Lexicon for Low-Resource Language Automatic Speech Recognition Based on Generic Phone Recognizer

Non-native English lexicon creation for bilingual speech synthesis

Reducing pronunciation lexicon confusion and using more data without phonetic transcription for pronunciation modeling

Learning Alternative Name Spellings

Improving grapheme-to-phoneme conversion by learning pronunciations from speech recordings

A probabilistic approach to pronunciation by analogy

Multilingual context-based pronunciation learning for Text-to-Speech

English-Arabic Proper-Noun Transliteration-Pairs Creation

Multi-level Linguistic Knowledge Based Chinese Grapheme-to-Phoneme Conversion.

An investigation of heuristic, manual and statistical pronunciation derivation for Pashto.

Clustering of Spell Variations for Proper Nouns Transliterated from the other languages

Bootstrapping Transliteration with Constrained Discovery for Low-Resource Languages

Similarity-based model for transliteration

Data-driven grapheme-to-phoneme representations for a lexicon-free text-to-speech

Transliteration Pair Extraction from Classical Chinese Buddhist Literature Using Phonetic Similarity Measurement

No Need for a Lexicon? Evaluating the Value of the Pronunciation Lexica in End-to-End Models

Learning Similarity Functions for Pronunciation Variations

Sideways Transliteration: How to Transliterate Multicultural Person Names?

Sample-Based Automatic Dictionary Generation for Keyword Spotting System.

English-Arabic Transliteration