Abstract:Machine translation has gained much attention in recent years. It is a sub-field of computational linguistic which focus on translating text from one language to other language. Among different translation techniques, neural network currently leading the domain with its capabilities of providing a single large neural network with attention mechanism, sequence-to-sequence and long-short term modelling. Despite significant progress in domain of machine translation, translation of out-of-vocabulary words(OOV) which include technical terms, named-entities, foreign words are still a challenge for current state-of-art translation systems, and this situation becomes even worse while translating between low resource languages or languages having different structures. Due to morphological richness of a language, a word may have different meninges in different context. In such scenarios, translation of word is not only enough in order provide the correct/quality translation. Transliteration is a way to consider the context of word/sentence during translation. For low resource language like Urdu, it is very difficult to have/find parallel corpus for transliteration which is large enough to train the system. In this work, we presented transliteration technique based on Expectation Maximization (EM) which is un-supervised and language independent. Systems learns the pattern and out-of-vocabulary (OOV) words from parallel corpus and there is no need to train it on transliteration corpus explicitly. This approach is tested on three models of statistical machine translation (SMT) which include phrasebased, hierarchical phrase-based and factor based models and two models of neural machine translation which include LSTM and transformer model.

A High Accuracy Approach for Word-Phoneme Translation Using Neural Networks

Effective Phoneme Decoding With Hyperbolic Neural Networks for High-Performance Speech BCIs

Segmentation and Recognition of On-Line Pitman Shorthand Outlines Using Neural Networks

Achieving Open Vocabulary Neural Machine Translation with Hybrid Word-Character Models

Applying Log Linear Model Based Context Dependent Machine Translation Techniques to Grapheme-to-phoneme Conversion.

An Efficient Character-Level Neural Machine Translation.

No Need for a Lexicon? Evaluating the Value of the Pronunciation Lexica in End-to-End Models

English-to-Chinese Transliteration with Phonetic Back-transliteration

Multimodal neural pronunciation modeling for spoken languages with logographic origin

Neural Machine Translation for Multilingual Grapheme-to-Phoneme Conversion

Word Representation Models for Morphologically Rich Languages in Neural Machine Translation

Neural Network Transduction Models in Transliteration Generation

Reducing pronunciation lexicon confusion and using more data without phonetic transcription for pronunciation modeling

LSTM Acoustic Models Learn to Align and Pronounce with Graphemes

mammothwill be a jiang shi yixiang juda gongcheng job ( a )

Neural Network Translation Models for Grammatical Error Correction

Polyphone Disambiguation for Mandarin Chinese Using Conditional Neural Network with Multi-level Embedding Features

Adapting Word Embeddings to New Languages with Morphological and Phonological Subword Representations

Urdu-English Machine Transliteration using Neural Networks

Design of English Lexical Analysis System for Machine Translation Based on Multimodal Neural Network

Brain-to-Text Decoding with Context-Aware Neural Representations and Large Language Models