Abstract:This paper presents a method for massively parallel learning of part-of-speech disambiguation based on a minmax modular neural network model. The method has three main steps. Firstly, a large-scale tagging problem is decomposed into a number of relatively smaller and simpler subproblems according to the class relations among a given training corpus. Secondly, all of the subproblems are learned by small network modules in parallel. Finally, following two module combination principles, all of the trained network modules are integrated into a modular parallel tagging system that produces solutions to the original tagging problem. The proposed method has several advantages over the existing tagging systems based on multilayer perceptrons.(1) Training times can be drastically reduced and desired learning accuracy can be easily achieved;(2) the method can scale up to larger tagging problems; and (3) the tagging system has quick response and facilitates hardware implementation. In order to demonstrate the effectiveness of the proposed method, we perform simulations on two different language corpora: a Thai corpus and a Chinese corpus, which have 29,028 and 45,595 ambiguous words, respectively. We also compare our method with several existing tagging models such as hidden Markov models, multilayer perceptrons and neuro-taggers. The results show that both the learning accuracy and generalization performance of the proposed tagging model are better than statistical models and multilayer perceptrons, and they are comparable to the most successful tagging models.

On the Miura map between the dispersionless KP and dispersionless modified KP hierarchies

A lexicalized second-order-HMM for ambiguity resolution in Chinese segmentation and POS tagging

Chinese Text Chunking Using Lexicalized HMMs

Hidden Markov Model Based Part of Speech Tagger for Sinhala Language

Chinese Lexical Analysis Based On Hybrid Mmsm Model

Modelling the Lexicon in Unsupervised Part of Speech Induction

Lexicalized Token Subcategory And Complex Context Based Shallow Parsing

Experimental Study of Hidden Markov Model Based Part-of-speech Tagging for Chinese Texts

TAKTAG: Two-phase learning method for hybrid statistical/rule-based part-of-speech disambiguation

Efficient Part-of-Speech Tagging with a Min-Max Modular Neural-Network Model

Hidden Markov Chains, Entropic Forward-Backward, and Part-Of-Speech Tagging

Massively parallel learning of part of speech disambiguation

HMM-based Unit Selection Using F

SAM: Semantic Attribute Modulated Language Modeling.

An Adaptive Harmony Search Part-of-Speech tagger for Square Hmong Corpus

TWO-STAGE MODEL SELECTION WITH PARAMETERS WEIGHTED HIDDEN MARKOV MODELS AND LIKELIHOOD RATIO FOR PART-OF-SPEECH TAGGING

Chinese POS Tagging Based on Bilexical Co-Occurrences

HMM-based Unit Selection Using Frame Sized Speech Segments.

Twitter part-of-speech tagging using pre-classification Hidden Markov model

SpeciaLex: A Benchmark for In-Context Specialized Lexicon Learning

A Hybrid Method of Chinese Prosodic Word Tagging Based on Keyword Anchor and Hidden Markov Model