Abstract:The method of translation from one language to another without human intervention is known as Machine Translation (MT). Multilingual neural machine translation (MNMT) is a technique for MT that builds a single model for multiple languages. It is preferred over other approaches since it decreases training time and improves translation in low-resource contexts, i.e. for languages that have insufficient corpus. However, good-quality MT models are yet to be built for many scenarios such as for Indic-to-Indic Languages (IL-IL). Hence, this paper is an attempt to address and develop the baseline models for low-resource languages i.e. IL-IL (for 11 Indic Languages (ILs)) in a multilingual environment. The models are built on the Samanantar corpus and analyzed on the Flores-200 corpus. All the models are evaluated using standard evaluation metrics i.e. Bilingual Evaluation Understudy (BLEU) score (with the range of 0 to 100). This paper examines the effect of the grouping of related languages, namely East Indo-Aryan (EI), Dravidian (DR), and West Indo-Aryan (WI) on the MNMT model. From the experiments, the results reveal that related language grouping is beneficial for the WI group only while it is detrimental for the EI group and it shows an inconclusive effect on the DR group. The role of pivot-based MNMT models in enhancing translation quality is also investigated in this paper. Owing to the presence of large good-quality corpora from English (EN) to ILs, MNMT IL-IL models using EN as a pivot are built and examined. To achieve this, English-Indic Language (EN-IL) models are developed with and without the usage of related languages. Results show that the use of related language grouping is advantageous specifically for EN to ILs. Thus, related language groups are used for the development of pivot MNMT models. It is also observed that the usage of pivot models greatly improves MNMT baselines. Furthermore, the effect of transliteration on ILs is also analyzed in this paper. To explore transliteration, the best MNMT models from the previous approaches (in most of cases pivot model using related groups) are determined and built on corpus transliterated from the corresponding scripts to a modified Indian language Transliteration script (ITRANS). The outcome of the experiments indicates that transliteration helps the models built for lexically rich languages, with the best increment of BLEU scores observed in Malayalam (ML) and Tamil (TA), i.e. 6.74 and 4.72, respectively. The BLEU score using transliteration models ranges from 7.03 to 24.29. The best model obtained is the Punjabi (PA)-Hindi (HI) language pair trained on PA-WI transliterated corpus.

Improving neural machine translation for low-resource Indian languages using rule-based feature extraction

A Novel Neural Machine Translation Approach for low-resource Sanskrit-Hindi Language pair

Neural Machine Translation for Low-Resourced Indian Languages

Attention based Sequence to Sequence Learning for Machine Translation of Low Resourced Indic Languages -- A case of Sanskrit to Hindi

Improving Multilingual Neural Machine Translation System for Indic Languages

An Augmented Translation Technique for low Resource language pair: Sanskrit to Hindi translation

Machine Translation by Projecting Text into the Same Phonetic-Orthographic Space Using a Common Encoding

Neural Machine Translation System of Indic Languages -- An Attention based Approach

A Baseline Neural Machine Translation System for Indian Languages

Hindi to English: Transformer-Based Neural Machine Translation

Enhancing Low-Resource NMT with a Multilingual Encoder and Knowledge Distillation: A Case Study

Exploiting Language Relatedness in Machine Translation Through Domain Adaptation Techniques

Utilizing Language Relatedness to improve Machine Translation: A Case Study on Languages of the Indian Subcontinent

A Pragmatic Analysis of Machine Translation Techniques for Preserving the Authenticity of the Sanskrit Language

English text to Indian Sign Language Machine Translation: A Rule Based Method

Multilingual Neural Machine Translation for Indic to Indic Languages

Towards achieving a delicate blending between rule-based translator and neural machine translator

Aspects of Terminological and Named Entity Knowledge within Rule-Based Machine Translation Models for Under-Resourced Neural Machine Translation Scenarios

A Data Selection Approach for Enhancing Low Resource Machine Translation Using Cross-Lingual Sentence Representations

Adding Visual Information to Improve Multimodal Machine Translation for Low-Resource Language

BhashaVerse : Translation Ecosystem for Indian Subcontinent Languages