Abstract:We perform a study on the universal morphological analysis task: given a word form, generate the lemma (lemmatisation) and its corresponding morphosyntactic descriptions (MSD analysis). Experiments are carried out on the SIGMORPHON 2018 Shared Task: Morphological Reinflection Task dataset which consists of more than 100 different languages with various morphological richness under three different data size conditions: low, medium and high. We consider three main approaches: morpheme-based (eager learning), holistic (lazy learning), and neural (eager learning). Performance is evaluated on the two subtasks of lemmatisation and MSD analysis. For the lemmatisation subtask, under all three data sizes, experimental results show that the holistic approach predicted more accurate lemmata, while the morpheme-based approach produced lemmata closer to the answers when it produces the wrong answers. For the MSD analysis subtask, under all three data sizes, the holistic approach achieves higher recall, while the morpheme-based approach is more precise. However, the trade-off between precision and recall of the two systems leads to a very similar overall F1 score. On the whole, neural approaches suffer under low resource conditions, but they achieve the best performance in comparison to the other approaches when the size of the training data increases.

A Hybrid Model for Computational Morphology Application

A Hybrid Language Model Based on Statistics and Linguistic Rules

Joint Lemmatization and Morphological Tagging with LEMMING

A Joint Model for Word Embedding and Word Morphology

Incorporating Latent Meanings of Morphological Compositions to Enhance Word Embeddings

Inflected language oriented context-sensitive morphological analyzer

Morphological Processing of Low-Resource Languages: Where We Are and What's Next

Joint Semantic Synthesis and Morphological Analysis of the Derived Word

A morphology-based Chinese word segmentation method

CMRight: Chinese Morph Resolution Based on End-to-end Model Combined with Enhancement Algorithms

A Simple Joint Model for Improved Contextual Neural Lemmatization

Joint Learning Model for Low-Resource Agglutinative Language Morphological Tagging.

A study of universal morphological analysis using morpheme-based, holistic, and neural approaches under various data size conditions

A Hybrid Chinese Language Model based on a Combination of Ontology with Statistical Method

Morphological Inflection with Phonological Features

Parsing-based Chinese word segmentation integrating morphological and syntactic information

Morpholog-Processing in Chinese-Mongolian Statistical Machine Translation

Maam: A Morphology-Aware Alignment Model For Unsupervised Bilingual Lexicon Induction

A Hybrid Semantic and Word Based Language Model and Its Applications

Leveraging morphological information via employing word hashing for sequence labeling

HMM and CRF Based Hybrid Model for Chinese Lexical Analysis