Abstract:Semi-Markov conditional random fields (Semi-CRFs) have been successfully utilized in many segmentation problems, including Chinese word segmentation (CWS). The advantage of Semi-CRF lies in its inherent ability to exploit properties of segments instead of individual elements of sequences. Despite its theoretical advantage, Semi-CRF is still not the best choice for CWS because its computation complexity is quadratic to the sentence’s length. In this paper, we propose a simple yet effective framework to help Semi-CRF achieve comparable performance with CRF-based models under similar computation complexity. Specifically, we first adopt a bi-directional long short-term memory (BiLSTM) on character level to model the context information, and then use simple but effective fusion layer to represent the segment information. Besides, to model arbitrarily long segments within linear time complexity, we also propose a new model named Semi-CRF-Relay. The direct modeling of segments makes the combination with word features easy and the CWS performance can be enhanced merely by adding publicly available pre-trained word embeddings. Experiments on four popular CWS datasets show the effectiveness of our proposed methods. The source codes and pre-trained embeddings of this paper are available on https://github.com/fastnlp/fastNLP/.

Neural architecture for tibetan word segmentation

Neural Word Segmentation Learning for Chinese

DAG-based Long Short-Term Memory for Neural Word Segmentation

Neural Chinese Word Segmentation as Sequence to Sequence Translation

Fast Neural Chinese Word Segmentation for Long Sentences

Neural Chinese Word Segmentation with Dictionary Knowledge

LM Enhanced BiRNN-CRF for Joint Chinese Word Segmentation and POS Tagging.

Bidirectional LSTM-CRF Attention-based Model for Chinese Word Segmentation

Long Short-Term Memory Neural Networks for Chinese Word Segmentation.

CASICT Tibetan Word Segmentation System for MLWS2017

Max-Margin Tensor Neural Network for Chinese Word Segmentation

The Design and Implementation of a Tibetan Word Segmentation System

Chinese Word Segmentation Via BiLSTM+Semi-CRF with Relay Node

A Deep Convolutional Neural Model for Character-Based Chinese Word Segmentation

A BiLSTM-CRF Based Approach to Word Segmentation in Chinese

A Hybrid Approach to Chinese Word Segmentation around CRFs

Deep Learning for Chinese Word Segmentation and POS Tagging.

Toward Fast and Accurate Neural Chinese Word Segmentation with Multi-Criteria Learning

BERT Meets Chinese Word Segmentation

A morphology-based Chinese word segmentation method

Feature-based Neural Language Model and Chinese Word Segmentation.