Abstract:Semi-Markov conditional random fields (Semi-CRFs) have been successfully utilized in many segmentation problems, including Chinese word segmentation (CWS). The advantage of Semi-CRF lies in its inherent ability to exploit properties of segments instead of individual elements of sequences. Despite its theoretical advantage, Semi-CRF is still not the best choice for CWS because its computation complexity is quadratic to the sentence’s length. In this paper, we propose a simple yet effective framework to help Semi-CRF achieve comparable performance with CRF-based models under similar computation complexity. Specifically, we first adopt a bi-directional long short-term memory (BiLSTM) on character level to model the context information, and then use simple but effective fusion layer to represent the segment information. Besides, to model arbitrarily long segments within linear time complexity, we also propose a new model named Semi-CRF-Relay. The direct modeling of segments makes the combination with word features easy and the CWS performance can be enhanced merely by adding publicly available pre-trained word embeddings. Experiments on four popular CWS datasets show the effectiveness of our proposed methods. The source codes and pre-trained embeddings of this paper are available on https://github.com/fastnlp/fastNLP/.

An Improved CRF Based Chinese Language Processing System for SIGHAN Bakeoff 2007.

CRF-based Hybrid Model for Word Segmentation, NER and Even POS Tagging

An Improved Chinese Word Segmentation System with Conditional Random Field

Leveraging Rich Linguistic Features for Cross-domain Chinese Segmentation.

BUPT Systems in the SIGHAN Bakeoff 2007.

A Study of Chinese Lexical Analysis Based on Discriminative Models

Chinese Named Entity Recognition and Word Segmentation Based on Character.

A Hybrid Approach to Chinese Word Segmentation around CRFs

A Pragmatic Chinese Word Segmentation System.

CRFs Based Chinese Word Segmentation

Chinese Word Segmentation and Named Entity Recognition Based on a Context-Dependent Mutual Information Independence Model.

LM Enhanced BiRNN-CRF for Joint Chinese Word Segmentation and POS Tagging.

The CIPS-SIGHAN CLP 2012 ChineseWord Segmentation Onmicroblog Corpora Bakeoff.

The CIPS-SIGHAN CLP 2014 Chinese Word Segmentation Bake-off.

A Chinese Named Entity Recognition System with Neural Networks

Chinese Word Segmentation with Multiple Postprocessors in HIT-IRLab

Chinese Word Segmentation Based on Mixing Model.

Chinese Word Segmentation Via BiLSTM+Semi-CRF with Relay Node

Micro Blogs Oriented Word Segmentation System.

Integrating ngram model and case-based learning for Chinese word segmentation

Adaptive Chinese Word Segmentation with Online Passive-Aggressive Algorithm.