Abstract:The use of Deep Neural Network architectures for Language Modeling has recently seen a tremendous increase in interest in the field of NLP with the advent of transfer learning and the shift in focus from rule-based and predictive models (supervised learning) to generative or unsupervised models to solve the long-standing problems in NLP like Information Extraction or Question Answering. While this shift has worked greatly for languages lacking in inflectional morphology, such as English, challenges still arise when trying to build similar systems for morphologically-rich languages, since their individual words shift forms in context more often. In this paper we investigate the extent to which these new unsupervised or generative techniques can serve to alleviate the type-token ratio disparity in morphologically rich languages. We apply an off-the-shelf neural language modeling library to the newly introduced task of unsupervised inflection generation in the nominal domain of three morphologically rich languages: Romanian, German, and Finnish. We show that this neural language model architecture can successfully generate the full inflection table of nouns without needing any pre-training on large, wikipedia-sized corpora, as long as the model is shown enough inflection examples. In fact, our experiments show that pre-training hinders the generation performance.

Unsupervised Learning of Morphology without Morphemes

A study of universal morphological analysis using morpheme-based, holistic, and neural approaches under various data size conditions

Unsupervised Morphological Paradigm Completion

Morpho-syntactic Lexicon Generation Using Graph-based Semi-supervised Learning

Unsupervised Morphological Tree Tokenizer

Morphological Processing of Low-Resource Languages: Where We Are and What's Next

Joint Semantic Synthesis and Morphological Analysis of the Derived Word

Morphonette: a morphological network of French

Unsupervised Inflection Generation Using Neural Language Modeling

The Greedy and Recursive Search for Morphological Productivity

Morphological Inflection: A Reality Check

Predicting semi-regular patterns in morphologically complex words

A Hybrid Model for Computational Morphology Application

Fixing the Infix: Unsupervised Discovery of Root-and-Pattern Morphology

Morphological Segmentation Inside-Out

The Unsupervised Acquisition of a Lexicon from Continuous Speech

A Joint Model for Word Embedding and Word Morphology

Linguistically inspired morphological inflection with a sequence to sequence model

An Atom Laser Based on Raman Transitions

Labeled Morphological Segmentation with Semi-Markov Models

Morph-fitting: Fine-Tuning Word Vector Spaces with Simple Language-Specific Rules