Abstract:Semi-Markov conditional random fields (Semi-CRFs) have been successfully utilized in many segmentation problems, including Chinese word segmentation (CWS). The advantage of Semi-CRF lies in its inherent ability to exploit properties of segments instead of individual elements of sequences. Despite its theoretical advantage, Semi-CRF is still not the best choice for CWS because its computation complexity is quadratic to the sentence’s length. In this paper, we propose a simple yet effective framework to help Semi-CRF achieve comparable performance with CRF-based models under similar computation complexity. Specifically, we first adopt a bi-directional long short-term memory (BiLSTM) on character level to model the context information, and then use simple but effective fusion layer to represent the segment information. Besides, to model arbitrarily long segments within linear time complexity, we also propose a new model named Semi-CRF-Relay. The direct modeling of segments makes the combination with word features easy and the CWS performance can be enhanced merely by adding publicly available pre-trained word embeddings. Experiments on four popular CWS datasets show the effectiveness of our proposed methods. The source codes and pre-trained embeddings of this paper are available on https://github.com/fastnlp/fastNLP/.

Effective Neural Solution for Multi-criteria Word Segmentation

Toward Fast and Accurate Neural Chinese Word Segmentation with Multi-Criteria Learning

Adversarial Multi-Criteria Learning for Chinese Word Segmentation

Switch-LSTMs for Multi-Criteria Chinese Word Segmentation.

RethinkCWS: is Chinese Word Segmentation a Solved Task?

A Deep Convolutional Neural Model for Character-Based Chinese Word Segmentation

A Concise Model for Multi-Criteria Chinese Word Segmentation with Transformer Encoder.

Unified Multi-Criteria Chinese Word Segmentation with BERT

Neural Chinese Word Segmentation as Sequence to Sequence Translation

Chinese Word Segmentation with Heterogeneous Graph Neural Network

Segment, Mask, and Predict: Augmenting Chinese Word Segmentation with Self-Supervision

Neural Word Segmentation Learning for Chinese

Neural Chinese Word Segmentation with Dictionary Knowledge

Improving Cross-Domain Chinese Word Segmentation with Word Embeddings

Bidirectional LSTM-CRF Attention-based Model for Chinese Word Segmentation

Multiple Character Embeddings for Chinese Word Segmentation

A Joint Model for Unsupervised Chinese Word Segmentation.

Deep Learning for Chinese Word Segmentation and POS Tagging.

Unsupervised Neural Word Segmentation for Chinese Via Segmental Language Modeling

BERT Meets Chinese Word Segmentation

Chinese Word Segmentation Via BiLSTM+Semi-CRF with Relay Node