Abstract:Although there are numerous and effective BERT models for question answering (QA) over plain texts in English, it is not the same for other languages, such as Greek. Since it can be time-consuming to train a new BERT model for a given language, we present a generic methodology for multilingual QA by combining at runtime existing machine translation (MT) models and BERT QA models pretrained in English, and we perform a comparative evaluation for Greek language. Particularly, we propose a pipeline that (a) exploits widely used MT libraries for translating a question and a context from a source language to the English language, (b) extracts the answer from the translated English context through popular BERT models (pretrained in English corpus), (c) translates the answer back to the source language, and (d) evaluates the answer through semantic similarity metrics based on sentence embeddings, such as Bi-Encoder and BERTScore. For evaluating our system, we use 21 models, whereas we have created a test set with 20 texts and 200 questions and we have manually labelled 4200 answers. These resources can be reused for several tasks including QA and sentence similarity. Moreover, we use the existing multilingual test set XQuAD, with 240 texts and 1190 questions in Greek language. We focus on both the effectiveness and efficiency, through manually and machine labelled results. The results of the evaluation show that the proposed approach can be an efficient and effective alternative option to multilingual BERT. In particular, although the multilingual BERT QA model provides the highest scores for both human and automatic evaluation, all the models combining MT and BERT QA models are faster and some of them achieve quite similar scores.

Graecia capta ferum victorem cepit. Detecting Latin Allusions to Ancient Greek Literature

Exploring Large Language Models for Classical Philology

Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillation

GREEK-BERT: The Greeks visiting Sesame Street

Automatic detection of reuses and citations in literary texts

A State-of-the-Art Morphosyntactic Parser and Lemmatizer for Ancient Greek

Latin BERT: A Contextual Language Model for Classical Philology

Logion: Machine Learning for Greek Philology

BERT in Plutarch's Shadows

The Large Language Model GreekLegalRoBERTa

Automated Attribution and Intertextual Analysis

A comparative evaluation for question answering over Greek texts by using machine translation and BERT

QuotationFinder - Searching for Quotations and Allusions in Greek and Latin Texts and Establishing the Degree to Which a Quotation or Allusion Matches Its Source

hmBERT: Historical Multilingual Language Models for Named Entity Recognition

Investigating Expert-in-the-Loop LLM Discourse Patterns for Ancient Intertextual Analysis

Opera Graeca Adnotata: Building a 34M+ Token Multilayer Corpus for Ancient Greek

Latin writing styles analysis with Machine Learning: New approach to old questions

Detecting Sexual Content at the Sentence Level in First Millennium Latin Texts

From Text Attribution to Data Extraction: Applications of Big Language Models in Historical Science

Translating scientific Latin texts with artificial intelligence: the works of Euler and contemporaries

Lexical semantic change for Ancient Greek and Latin