Rule-based Breton to French machine translation

Francis M. Tyers

Abstract:This paper describes a rule-based machine translation system from Breton to French intended for producing gisting translations. The paper presents a summary of the ongoing development of the system, along with an evaluation of two versions, and some reflection on the use of MT systems for lesser-resourced or minority languages.

What problem does this paper attempt to address?

Rule-Based Machine Translation from Tunisian Dialect to Modern Standard Arabic

Mohamed Ali Sghaier,Mounir Zrigui

DOI: https://doi.org/10.1016/j.procs.2020.08.033

2020-01-01

Procedia Computer Science

Abstract:This paper aims to present a machine translation system capable of translating Tunisian Dialect (TD) text to Modern Standard Arabic (MSA) using a rule-based approach. Having adopted such a classical approach can give us better translation mainly in terms of morphology and syntax. Moreover, it also allows us to automate the translation task to build a training dataset (parallel corpus), which can be exploited whether for hybridization with the statistical approach or even for the newly developed neural-network method. To do that, our work is based on a free open source platform, named Apertium, which provides a whole environment that includes all required tools to develop an RBMT system. Therefore, the translation process starts by given TD input text, where the data are passed through three big parts, which are respectively morphological analysis and disambiguation, lexical and structural transfer, and morphological generation and spelling corrections to get the translated text in MSA. In fact, each of these stages is a challenge. It should be noted that we have made a great effort to create the required resources from scratch starting by the two monolingual morphological dictionaries for TD and MSA, the bilingual lexical dictionary to map TD words to their equivalents in MSA, and finally setting up more than 500 rules for disambiguation and structural transfer. The proposed system is evaluated by three metrics: WER, TER and BLEU score. As a result, we respectively reach 23.28%, 23.85% and 55.22, which are promising scores.
Rule-Based and Example-Based Machine Translation from English to Arabic

Mouiad Fadiel Alawneh,Tengku Mohd Sembok

DOI: https://doi.org/10.1109/bic-ta.2011.76

2011-09-01

Abstract:Machine Translation has been defined as the process that utilizes computer software to translate text from one natural language to another. This definition involves accounting for the grammatical structure of each language and using rules, examples and grammars to transfer the grammatical structure of the source language (SL) into the target language (TL). This paper presents English to Arabic approach for translating well-structured English sentences into well-structured Arabic sentences, using a Grammar-based and example-translation techniques to handle the problems of ordering and agreement. The proposed methodology is flexible and scalable, the main advantages are: first, a hybrid-based approach combined advantages of rule-based (RBMT) with advantages example-based (EBMT), and second, it can be applied on some other languages with minor modifications. The OAK Parser is used to analyze the input English text to get the part of speech (POS) for each word in the text as a pre-translation process using the C# language, validation rules have been applied in both the database design and the programming code in order to ensure the integrity of data. A major design goal of this system is that it will be used as a stand-alone tool, and can be very well integrated with a general machine translation system for English sentences.
Towards a Dynamic Linkage of Example-based and Rule-based Machine Translation

Michael Carl,Cathrine Pease,Leonid L. Iomdin,Oliver Streiter

DOI: https://doi.org/10.1023/a:1011663225529

2000-01-01

Machine Translation

Abstract:This paper reports on a series of experiments which aim at integratingExample-based Machine Translation and Translation Memories with Rule-based Machine Translation. We start by examining the potentials of each MT paradigm in terms of system-internal and system-external parameters. Whereas the system-external parameters include the expected translation quality and translation coverage, system-internal parameters relate to adaptability and recall of translation units. We prefer a dynamic linkage of different MT paradigms where the sharing of labor amongst the modules involved, such as segmentation andsegment translation, is decided dynamically during runtime. We motivatethe communication of linguistically rich data structures between thedifferent components in a hybrid system and show that this linkage leadsto better translation results and improves the customization possibilitiesof the system.
Recent advances in Apertium, a free/open-source rule-based machine translation platform for low-resource languages

Tanmai Khanna,Jonathan N. Washington,Francis M. Tyers,Sevilay Bayatlı,Daniel G. Swanson,Tommi A. Pirinen,Irene Tang,Hèctor Alòs i Font

DOI: https://doi.org/10.1007/s10590-021-09260-6

2021-10-18

Machine Translation

Abstract:Abstract This paper presents an overview of Apertium, a free and open-source rule-based machine translation platform. Translation in Apertium happens through a pipeline of modular tools, and the platform continues to be improved as more language pairs are added. Several advances have been implemented since the last publication, including some new optional modules: a module that allows rules to process recursive structures at the structural transfer stage, a module that deals with contiguous and discontiguous multi-word expressions, and a module that resolves anaphora to aid translation. Also highlighted is the hybridisation of Apertium through statistical modules that augment the pipeline, and statistical methods that augment existing modules. This includes morphological disambiguation, weighted structural transfer, and lexical selection modules that learn from limited data. The paper also discusses how a platform like Apertium can be a critical part of access to language technology for so-called low-resource languages, which might be ignored or deemed unapproachable by popular corpus-based translation technologies. Finally, the paper presents some of the released and unreleased language pairs, concluding with a brief look at some supplementary Apertium tools that prove valuable to users as well as language developers. All Apertium-related code, including language data, is free/open-source and available at https://github.com/apertium .
A Challenge Set for French --> English Machine Translation

Pierre Isabelle,Roland Kuhn

DOI: https://doi.org/10.48550/arXiv.1806.02725

2018-06-15

Abstract:We present a challenge set for French --> English machine translation based on the approach introduced in Isabelle, Cherry and Foster (EMNLP 2017). Such challenge sets are made up of sentences that are expected to be relatively difficult for machines to translate correctly because their most straightforward translations tend to be linguistically divergent. We present here a set of 506 manually constructed French sentences, 307 of which are targeted to the same kinds of structural divergences as in the paper mentioned above. The remaining 199 sentences are designed to test the ability of the systems to correctly translate difficult grammatical words such as prepositions. We report on the results of using this challenge set for testing two different systems, namely Google Translate and DEEPL, each on two different dates (October 2017 and January 2018). All the resulting data are made publicly available.

Computation and Language
Aspects of Terminological and Named Entity Knowledge within Rule-Based Machine Translation Models for Under-Resourced Neural Machine Translation Scenarios

Daniel Torregrosa,Nivranshu Pasricha,Maraim Masoud,Bharathi Raja Chakravarthi,Juan Alonso,Noe Casas,Mihael Arcan

DOI: https://doi.org/10.48550/arXiv.2009.13398

2020-09-28

Computation and Language

Abstract:Rule-based machine translation is a machine translation paradigm where linguistic knowledge is encoded by an expert in the form of rules that translate text from source to target language. While this approach grants extensive control over the output of the system, the cost of formalising the needed linguistic knowledge is much higher than training a corpus-based system, where a machine learning approach is used to automatically learn to translate from examples. In this paper, we describe different approaches to leverage the information contained in rule-based machine translation systems to improve a corpus-based one, namely, a neural machine translation model, with a focus on a low-resource scenario. Three different kinds of information were used: morphological information, named entities and terminology. In addition to evaluating the general performance of the system, we systematically analysed the performance of the proposed approaches when dealing with the targeted phenomena. Our results suggest that the proposed models have limited ability to learn from external information, and most approaches do not significantly alter the results of the automatic evaluation, but our preliminary qualitative evaluation shows that in certain cases the hypothesis generated by our system exhibit favourable behaviour such as keeping the use of passive voice.
Machine Translation: Phrase-Based, Rule-Based and Neural Approaches with Linguistic Evaluation

Vivien Macketanz,Eleftherios Avramidis,Aljoscha Burchardt,Jindrich Helcl,Ankit Srivastava

DOI: https://doi.org/10.1515/cait-2017-0014

2017-06-01

Cybernetics and Information Technologies

Abstract:Abstract In this article we present a novel linguistically driven evaluation method and apply it to the main approaches of Machine Translation (Rule-based, Phrase-based, Neural) to gain insights into their strengths and weaknesses in much more detail than provided by current evaluation schemes. Translating between two languages requires substantial modelling of knowledge about the two languages, about translation, and about the world. Using English-German IT-domain translation as a case-study, we also enhance the Phrase-based system by exploiting parallel treebanks for syntax-aware phrase extraction and by interfacing with Linked Open Data (LOD) for extracting named entity translations in a post decoding framework.
Fine-grained evaluation of German-English Machine Translation based on a Test Suite

Vivien Macketanz,Eleftherios Avramidis,Aljoscha Burchardt,Hans Uszkoreit

DOI: https://doi.org/10.18653/v1/W18-6436

2019-10-17

Abstract:We present an analysis of 16 state-of-the-art MT systems on German-English based on a linguistically-motivated test suite. The test suite has been devised manually by a team of language professionals in order to cover a broad variety of linguistic phenomena that MT often fails to translate properly. It contains 5,000 test sentences covering 106 linguistic phenomena in 14 categories, with an increased focus on verb tenses, aspects and moods. The MT outputs are evaluated in a semi-automatic way through regular expressions that focus only on the part of the sentence that is relevant to each phenomenon. Through our analysis, we are able to compare systems based on their performance on these categories. Additionally, we reveal strengths and weaknesses of particular systems and we identify grammatical phenomena where the overall performance of MT is relatively low.

Computation and Language
English2Gbe: A multilingual machine translation model for {Fon/Ewe}Gbe

Gilles Hacheme

DOI: https://doi.org/10.48550/arXiv.2112.11482

2021-12-13

Abstract:Language is an essential factor of emancipation. Unfortunately, most of the more than 2,000 African languages are low-resourced. The community has recently used machine translation to revive and strengthen several African languages. However, the trained models are often bilingual, resulting in a potentially exponential number of models to train and maintain to cover all possible translation directions. Additionally, bilingual models do not leverage the similarity between some of the languages. Consequently, multilingual neural machine translation (NMT) is gaining considerable interest, especially for low-resourced languages. Nevertheless, its adoption by the community is still limited. This paper introduces English2Gbe, a multilingual NMT model capable of translating from English to Ewe or Fon. Using the BLEU, CHRF, and TER scores computed with the Sacrebleu (Post, 2018) package for reproducibility, we show that English2Gbe outperforms bilingual models (English to Ewe and English to Fon) and gives state-of-the-art results on the JW300 benchmark for Fon established by Nekoto et al. (2020). We hope this work will contribute to the massive adoption of Multilingual models inside the community. Our code is made accessible from Github.

Computation and Language
Multilingual Machine Translation system

Yajuan Lü,Yang Liu,Qun Liu

DOI: https://doi.org/10.1109/IUCS.2010.5666638

2010-01-01

Abstract:Abstract form only given. We present a Multilingual MachineTranslation(http://mtgroup.ict.ac.cn/transRoom.php), which can translation text between Chinese and English, Korean, Uyghur, Tibetan, Monogolian, and etc. The system is developed based the Maximum Entropy based Bracketing Transduction Grammar (ME-BTG) Model, which is a kind of formal syntax-based statistical translation model. All the translation engines are trained using sentenced aligned bilingual corpus.
Machine Translation of Low-Resource Spoken Dialects: Strategies for Normalizing Swiss German

Pierre-Edouard Honnet,Andrei Popescu-Belis,Claudiu Musat,Michael Baeriswyl

DOI: https://doi.org/10.48550/arXiv.1710.11035

2018-02-06

Abstract:The goal of this work is to design a machine translation (MT) system for a low-resource family of dialects, collectively known as Swiss German, which are widely spoken in Switzerland but seldom written. We collected a significant number of parallel written resources to start with, up to a total of about 60k words. Moreover, we identified several other promising data sources for Swiss German. Then, we designed and compared three strategies for normalizing Swiss German input in order to address the regional diversity. We found that character-based neural MT was the best solution for text normalization. In combination with phrase-based statistical MT, our solution reached 36% BLEU score when translating from the Bernese dialect. This value, however, decreases as the testing data becomes more remote from the training one, geographically and topically. These resources and normalization techniques are a first step towards full MT of Swiss German dialects.

Computation and Language
LLM-Assisted Rule Based Machine Translation for Low/No-Resource Languages

Jared Coleman,Bhaskar Krishnamachari,Khalil Iskarous,Ruben Rosales

2024-05-17

Abstract:We propose a new paradigm for machine translation that is particularly useful for no-resource languages (those without any publicly available bilingual or monolingual corpora): LLM-RBMT (LLM-Assisted Rule Based Machine Translation). Using the LLM-RBMT paradigm, we design the first language education/revitalization-oriented machine translator for Owens Valley Paiute (OVP), a critically endangered Indigenous American language for which there is virtually no publicly available data. We present a detailed evaluation of the translator's components: a rule-based sentence builder, an OVP to English translator, and an English to OVP translator. We also discuss the potential of the paradigm, its limitations, and the many avenues for future research that it opens up.

Computation and Language
What is Hidden among Translation Rules.

Libin Shen,Bowen Zhou

DOI: https://doi.org/10.18653/v1/d13-1081

2013-01-01

Abstract:Most of the machine translation systems rely on a large set of translation rules. These rules are treated as discrete and independent events. In this short paper, we propose a novel method to model rules as observed generation output of a compact hidden model, which leads to better generalization capability. We present a preliminary generative model to test this idea. Experimental results show about one point improvement on TER-BLEU over a strong baseline in Chinese-to-English translation.
Using RBMT Systems to Produce Bilingual Corpus for SMT

Xiaoguang Hu,Haifeng Wang,Hua Wu

2007-01-01

Abstract:This paper proposes a method using the existing Rule-based Machine Translation (RBMT) system as a black box to produce synthetic bilingual corpus, which will be used as training data for the Statistical Machine Translation (SMT) system. We use the existing RBMT system to translate the monolingual corpus into synthetic bilingual corpus. With the synthetic bilingual corpus, we can build an SMT system even if there is no real bilingual corpus. In our experiments using BLEU as a metric, the system achieves a relative improvement of 11.7% over the best RBMT system that is used to produce the synthetic bilingual corpora. We also interpolate the model trained on a real bilingual corpus and the models trained on the synthetic bilingual corpora. The interpolated model achieves an absolute improvement of 0.0245 BLEU score (13.1% relative) as compared with the individual model trained on the real bilingual corpus.
Statistical Vs Rule Based Machine Translation; A Case Study on Indian Language Perspective

Sreelekha S

DOI: https://doi.org/10.48550/arXiv.1708.04559

2017-08-12

Computation and Language

Abstract:In this paper we present our work on a case study between Statistical Machien Transaltion (SMT) and Rule-Based Machine Translation (RBMT) systems on English-Indian langugae and Indian to Indian langugae perspective. Main objective of our study is to make a five way performance compariosn; such as, a) SMT and RBMT b) SMT on English-Indian langugae c) RBMT on English-Indian langugae d) SMT on Indian to Indian langugae perspective e) RBMT on Indian to Indian langugae perspective. Through a detailed analysis we describe the Rule Based and the Statistical Machine Translation system developments and its evaluations. Through a detailed error analysis, we point out the relative strengths and weaknesses of both systems. The observations based on our study are: a) SMT systems outperforms RBMT b) In the case of SMT, English to Indian language MT systmes performs better than Indian to English langugae MT systems c) In the case of RBMT, English to Indian langugae MT systems perofrms better than Indian to Englsih Language MT systems d) SMT systems performs better for Indian to Indian language MT systems compared to RBMT. Effectively, we shall see that even with a small amount of training corpus a statistical machine translation system has many advantages for high quality domain specific machine translation over that of a rule-based counterpart.
Inflection rules for Marathi to English in rule based machine translation

Namrata G Kharate,Varsha H Patil

DOI: https://doi.org/10.11591/ijai.v10.i3.pp780-788

2021-09-01

Abstract:Machine translation is important application in natural language processing. Machine translation means translation from source language to target language to save the meaning of the sentence. A large amount of research is going on in the area of machine translation. However, research with machine translation remains highly localized to the particular source and target languages as they differ syntactically and morphologically. Appropriate inflections result correct translation. This paper elaborates the rules for inflecting the parts-of-speech and implements the inflection for Marathi to English translation. The inflection of nouns, pronouns, verbs, adjectives are carried out on the basis of semantics of the sentence. The results are discussed with examples.
Statistical Machine Translation Based on Translation Rules

LIU Ying,JIANG Wei

DOI: https://doi.org/10.3969/j.issn.1002-137X.2013.02.047

2013-01-01

Computer Science

Abstract:Improved hidden Markov model was used to align words and solve the inconsistency between word alignment and phrase structures.Translation rules were extracted based on aligned phrases and English phrase trees.An extended CYK-CYK+ algorithm was used as the decoder and a two-pass-decoding algorithm was proposed for intergrating the language model during decoding,which can decode non-Chomsky normal form.The experimental results show the BLEU score of improved HMM is higher than the score of HMM,and the translation quality of translation rules is better than phrase-based machine transtion.The BLEU score of two-pass-decoding algorithm is close to the score of cube prune algorithm and decoding time costs less.
Feriji: A French-Zarma Parallel Corpus, Glossary & Translator

Mamadou K. Keita,Elysabhete Amadou Ibrahim,Habibatou Abdoulaye Alfari,Christopher Homan

2024-06-18

Abstract:Machine translation (MT) is a rapidly expanding field that has experienced significant advancements in recent years with the development of models capable of translating multiple languages with remarkable accuracy. However, the representation of African languages in this field still needs to improve due to linguistic complexities and limited resources. This applies to the Zarma language, a dialect of Songhay (of the Nilo-Saharan language family) spoken by over 5 million people across Niger and neighboring countries \cite{lewis2016ethnologue}. This paper introduces Feriji, the first robust French-Zarma parallel corpus and glossary designed for MT. The corpus, containing 61,085 sentences in Zarma and 42,789 in French, and a glossary of 4,062 words represent a significant step in addressing the need for more resources for Zarma. We fine-tune three large language models on our dataset, obtaining a BLEU score of 30.06 on the best-performing model. We further evaluate the models on human judgments of fluency, comprehension, and readability and the importance and impact of the corpus and models. Our contributions help to bridge a significant language gap and promote an essential and overlooked indigenous African language.

Computation and Language
Linguistic evaluation of German-English Machine Translation using a Test Suite

Eleftherios Avramidis,Vivien Macketanz,Ursula Strohriegel,Hans Uszkoreit

DOI: https://doi.org/10.18653/v1/W19-5351

2019-10-17

Abstract:We present the results of the application of a grammatical test suite for German$\rightarrow$English MT on the systems submitted at WMT19, with a detailed analysis for 107 phenomena organized in 14 categories. The systems still translate wrong one out of four test items in average. Low performance is indicated for idioms, modals, pseudo-clefts, multi-word expressions and verb valency. When compared to last year, there has been a improvement of function words, non-verbal agreement and punctuation. More detailed conclusions about particular systems and phenomena are also presented.

Computation and Language
Letz Translate: Low-Resource Machine Translation for Luxembourgish

Yewei Song,Saad Ezzini,Jacques Klein,Tegawende Bissyande,Clément Lefebvre,Anne Goujon

2023-03-02

Abstract:Natural language processing of Low-Resource Languages (LRL) is often challenged by the lack of data. Therefore, achieving accurate machine translation (MT) in a low-resource environment is a real problem that requires practical solutions. Research in multilingual models have shown that some LRLs can be handled with such models. However, their large size and computational needs make their use in constrained environments (e.g., mobile/IoT devices or limited/old servers) impractical. In this paper, we address this problem by leveraging the power of large multilingual MT models using knowledge distillation. Knowledge distillation can transfer knowledge from a large and complex teacher model to a simpler and smaller student model without losing much in performance. We also make use of high-resource languages that are related or share the same linguistic root as the target LRL. For our evaluation, we consider Luxembourgish as the LRL that shares some roots and properties with German. We build multiple resource-efficient models based on German, knowledge distillation from the multilingual No Language Left Behind (NLLB) model, and pseudo-translation. We find that our efficient models are more than 30\% faster and perform only 4\% lower compared to the large state-of-the-art NLLB model.

Computation and Language,Software Engineering

Rule-based Breton to French machine translation

Rule-Based Machine Translation from Tunisian Dialect to Modern Standard Arabic

Rule-Based and Example-Based Machine Translation from English to Arabic

Towards a Dynamic Linkage of Example-based and Rule-based Machine Translation

Recent advances in Apertium, a free/open-source rule-based machine translation platform for low-resource languages

A Challenge Set for French --> English Machine Translation

Aspects of Terminological and Named Entity Knowledge within Rule-Based Machine Translation Models for Under-Resourced Neural Machine Translation Scenarios

Machine Translation: Phrase-Based, Rule-Based and Neural Approaches with Linguistic Evaluation

Fine-grained evaluation of German-English Machine Translation based on a Test Suite

English2Gbe: A multilingual machine translation model for {Fon/Ewe}Gbe

Multilingual Machine Translation system

Machine Translation of Low-Resource Spoken Dialects: Strategies for Normalizing Swiss German

LLM-Assisted Rule Based Machine Translation for Low/No-Resource Languages

What is Hidden among Translation Rules.

Using RBMT Systems to Produce Bilingual Corpus for SMT

Statistical Vs Rule Based Machine Translation; A Case Study on Indian Language Perspective

Inflection rules for Marathi to English in rule based machine translation

Statistical Machine Translation Based on Translation Rules

Feriji: A French-Zarma Parallel Corpus, Glossary & Translator

Linguistic evaluation of German-English Machine Translation using a Test Suite

Letz Translate: Low-Resource Machine Translation for Luxembourgish