Abstract:In the construction of resources for Korean phonetic information processing, automatic phonetic transcription technology plays a crucial role. However, because Korean word formation is extremely powerful and new words emerge regularly, it is impossible to create a database that contains all of the words. As a result, in addition to the words in the database, how to solve the pronunciation annotation of those unregistered words outside the database, referred to as OOV (out of vocabulary) words, has turned into a problem that must be resolved in the process of Korean natural language processing. The current academic approaches to grapheme-to-phoneme (G2P) conversion techniques have been commonly knowledge-based or data-based. Previously, the methods which were only knowledge-driven based are difficult to adapt to the actual situation of a large amount of data information. The data-driven approach relies solely on high-quality data, makes it difficult to reasonably determine the input variables, and necessitates the use of adequate and precisely selected model features. To address these issues, the paper proposes a knowledge-driven and data-driven fusion based an automatic Korean language G2P method. Firstly, we extract eigenvalues based on the pronunciation rules and the phonetic changing rules between words in Korean, and feed them in to the model for training. And then, the model is trained to achieve the automatic phonetic transcription for Korean using the data-driven model, which can better fit the mapping relationship between input and output variables. The proposed model can reflect the phonological changes in the Korean continuous speech stream, and can accurately obtain the phonemes corresponding to the graphemes. The method has been cross-validated for validity and superiority to improve model performance, and the average accuracy on grapheme-to-phoneme conversion can reach 94.63%.

Phonology-Augmented Statistical Framework for Machine Transliteration Using Limited Linguistic Resources

A High Accuracy Approach for Word-Phoneme Translation Using Neural Networks

Integrating Pronunciation into Chinese-Vietnamese Statistical Machine Translation

Enhancing Cross-lingual Transfer via Phonemic Transcription Integration

A Joint Source-Channel Model for Machine Transliteration.

Multimodal neural pronunciation modeling for spoken languages with logographic origin

Diversity by Phonetics and its Application in Neural Machine Translation

Improving Chinese-Vietnamese Neural Machine Translation with Linguistic Differences

Statistically-based Model for Computer-Aided Transcription Application

Augmenting Part-of-speech Tagging with Syntactic Information for Vietnamese and Chinese

Reference-Based Post-OCR Processing with LLM for Diacritic Languages

Reducing pronunciation lexicon confusion and using more data without phonetic transcription for pronunciation modeling

AlloST: Low-resource Speech Translation without Source Transcription

Multilingual and Crosslingual Speech Recognition Using Phonological-Vector Based Phone Embeddings

Crossing Linguistic Horizons: Finetuning and Comprehensive Evaluation of Vietnamese Large Language Models

A Combination of BERT and Transformer for Vietnamese Spelling Correction

LEARNING CROSS-LINGUAL INFORMATION WITH MULTILINGUAL BLSTM FOR SPEECH SYNTHESIS OF LOW-RESOURCE LANGUAGES

Incorporating L2 Phonemes Using Articulatory Features for Robust Speech Recognition

Letter-to-Sound Pronunciation Prediction Using Conditional Random Fields

Mitigating the Linguistic Gap with Phonemic Representations for Robust Cross-lingual Transfer

Integration of Knowledge-Driven and Data-Driven Based Korean Phonetic Transcription