Abstract:Chinese word segmentation and part-of-speech tagging are necessary tasks in terms of computational linguistics and application of natural language processing. Many re-searchers still debate the demand for Chinese word segmentation and part-of-speech tagging in the deep learning era. Nevertheless, resolving ambiguities and detecting unknown words are challenging problems in this field. Previous studies on joint Chinese word segmentation and part-of-speech tagging mainly follow the character-based tagging model focusing on modeling n-gram features. Unlike previous works, we propose a neural model named SpanSegTag for joint Chinese word segmentation and part-of-speech tagging following the span labeling in which the probability of each n-gram being the word and the part-of-speech tag is the main problem. We use the biaffine operation over the left and right boundary representations of consecutive characters to model the n-grams. Our experiments show that our BERT-based model SpanSegTag achieved competitive performances on the CTB5, CTB6, and UD, or significant improvements on CTB7 and CTB9 benchmark datasets compared with the current state-of-the-art method using BERT or ZEN encoders.

A Simple and Effective Neural Model for Joint Word Segmentation and POS Tagging.

A Feature-Enriched Neural Model for Joint Chinese Word Segmentation and Part-of-Speech Tagging

Joint Segmentation and Tagging with Coupled Sequences Labeling

A joint method for Chinese word segmentation and part-of-speech labeling based on deep neural network

A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing

A Unified Model for Joint Chinese Word Segmentation and Dependency Parsing

Joint POS Tagging and Dependency Parsing with Transition-based Neural Networks

Joint POS Tagging and Dependence Parsing With Transition-Based Neural Networks

A neural joint model for Vietnamese word segmentation, POS tagging and dependency parsing

A Joint Model for Unsupervised Chinese Word Segmentation.

Joint n-gram Chinese language modeling with an application to Chinese word segmentation

A Unified Model for Joint Chinese Word Segmentation and POS Tagging with Heterogeneous Annotation Corpora.

Joint Chinese Word Segmentation and Part-of-speech Tagging via Two-stage Span Labeling

Neural Word Segmentation Learning for Chinese

Deep Learning for Chinese Word Segmentation and POS Tagging.

Study on Japanese Word Segmentation and POS Tagging Based on Rules and Statistics

DAG-based Long Short-Term Memory for Neural Word Segmentation

A Stacked Sub-Word Model for Joint Chinese Word Segmentation and Part-of-Speech Tagging.

Joint Chinese Word Segmentation and Named Entity Recognition Based on Max-Margin Markov Networks

State-of-the-art Chinese Word Segmentation with Bi-LSTMs