Abstract:Semi-Markov conditional random fields (Semi-CRFs) have been successfully utilized in many segmentation problems, including Chinese word segmentation (CWS). The advantage of Semi-CRF lies in its inherent ability to exploit properties of segments instead of individual elements of sequences. Despite its theoretical advantage, Semi-CRF is still not the best choice for CWS because its computation complexity is quadratic to the sentence’s length. In this paper, we propose a simple yet effective framework to help Semi-CRF achieve comparable performance with CRF-based models under similar computation complexity. Specifically, we first adopt a bi-directional long short-term memory (BiLSTM) on character level to model the context information, and then use simple but effective fusion layer to represent the segment information. Besides, to model arbitrarily long segments within linear time complexity, we also propose a new model named Semi-CRF-Relay. The direct modeling of segments makes the combination with word features easy and the CWS performance can be enhanced merely by adding publicly available pre-trained word embeddings. Experiments on four popular CWS datasets show the effectiveness of our proposed methods. The source codes and pre-trained embeddings of this paper are available on https://github.com/fastnlp/fastNLP/.

CRF-based Hybrid Model for Word Segmentation, NER and Even POS Tagging

An Improved CRF Based Chinese Language Processing System for SIGHAN Bakeoff 2007.

A Hybrid Approach to Chinese Word Segmentation around CRFs

Chinese Named Entity Recognition and Word Segmentation Based on Character.

BUPT Systems in the SIGHAN Bakeoff 2007.

CRFs Based Chinese Word Segmentation

The CIPS-SIGHAN CLP 2012 ChineseWord Segmentation Onmicroblog Corpora Bakeoff.

Chinese Word Segmentation with Maximum Entropy and N-gram Language Model

Adapting Conventional Chinese Word Segmenter for Segmenting Micro-blog Text: Combining Rule-based and Statistic-based Approaches.

Chinese word segmentation as morpheme-based lexical chunking

A Chinese Part-of-speech Tagging Approach Using Conditional Random Fields

Chinese Word Segmentation Via BiLSTM+Semi-CRF with Relay Node

Word Segmentation of Micro Blogs with Bagging.

A morphology-based Chinese word segmentation method

Overview of the NLPCC 2015 Shared Task: Chinese Word Segmentation and POS Tagging for Micro-blog Texts

Combine CRF and MMSEG to Boost Chinese Word Segmentation in Social Media

Chinese Named Entity Recognition with a Multi-Phase Model

The CIPS-SIGHAN CLP 2014 Chinese Word Segmentation Bake-off.

Effective Neural Solution for Multi-criteria Word Segmentation

Improving Cross-Domain Chinese Word Segmentation with Word Embeddings

Parsing-based Chinese word segmentation integrating morphological and syntactic information