Abstract:From the perspective of structural linguistics, we explore paradigmatic and syntagmatic lexical relations for Chinese POS tagging, an important and challenging task for Chinese language processing. Paradigmatic lexical relations are explicitly captured by word clustering on large-scale unlabeled data and are used to design new features to enhance a discriminative tagger. Syntagmatic lexical relations are implicitly captured by syntactic parsing in the constituency formalism, and are utilized via system combination. Experiments on the Penn Chinese Treebank demonstrate the importance of both paradigmatic and syntagmatic relations. Our linguistically motivated, hybrid approaches yield a relative error reduction of 18% in total over state-of-the-art baselines. Despite the effectiveness to boost accuracy, computationally expensive parsers make hybrid systems inappropriate for many realistic NLP applications. In this article, we are also concerned with improving tagging efficiency at test time. In particular, we explore unlabeled data to transfer the predictive power of hybrid models to simple sequence models. Specifically, hybrid systems are utilized to create large-scale pseudo training data for cheap models. Experimental results illustrate that the re-compiled models not only achieve high accuracy with respect to per token classification, but also serve as a front-end to a parser well.

An Adaptive Harmony Search Part-of-Speech tagger for Square Hmong Corpus

Dynamic adaptive harmony search algorithm for optimization

Hymba: A Hybrid-head Architecture for Small Language Models

Quality Assurance Of Automatic Annotation Of Very Large Corpora: A Study Based On Heterogeneous Tagging Systems

Experimental Study of Hidden Markov Model Based Part-of-speech Tagging for Chinese Texts

Towards Accurate and Efficient Chinese Part-of-Speech Tagging.

TAKTAG: Two-phase learning method for hybrid statistical/rule-based part-of-speech disambiguation

A Self-Learning Part of Speech Tagging Integrated with Partial Syntactic Analysis

HAF-RM: A Hybrid Alignment Framework for Reward Model Training

Vietnamese Part of Speech Tagging Based on Multi-category Words Disambiguation Model.

A lexicalized second-order-HMM for ambiguity resolution in Chinese segmentation and POS tagging

Augmenting Part-of-speech Tagging with Syntactic Information for Vietnamese and Chinese

Dynamic Adaptive Optimization for Effective Sentiment Analysis Fine-Tuning on Large Language Models

A Hybrid Method of Chinese Prosodic Word Tagging Based on Keyword Anchor and Hidden Markov Model

Improving Rare Words Recognition through Homophone Extension and Unified Writing for Low-resource Cantonese Speech Recognition

Automatic Collecting of Text Data for Cantonese Language Modeling

Sentence alignment using hybrid model

The Effect of Part-Of-Speech on Mandarin Speech Recognition

A Separately Passive-Aggressive Training Algorithm for Joint POS Tagging and Dependency Parsing

A Hybrid Language Model Based on Statistics and Linguistic Rules

A Hybrid Post-Processing System For Offline Handwritten Chinese Character Recognition Based On A Statistical Language Model