Abstract:Chinese chunking plays an important role in natural language processing. This paper presents a large margin method for Chinese chunking based on structural SVMs (support vector machines). First, a sequence labeling model and the formulation of the learning problem are introduced for Chinese chunking problem, and then the cutting plane algorithm is applied to efficiently approximate the optimal solution of the optimization problem. Finally, an improved F1 loss function is proposed to tackle Chinese chunking. The loss function can scale the F1 loss value to the length of the sentence to adjust the margin accordingly, leading to more effective constraint inequalities. Experiments are conducted on UPENN Chinese Treebank-4 (CTB4), and the hamming loss function is compared with the improved F1 loss function. The experimental results show that the training algorithm with the improved F1 loss function can achieve higher performance than the Hamming loss function. The overall F1 score of Chinese chunking obtained with this approach is 91.61%, which is higher than the performance produced by the state-of-the-art machine learning models, such as CRFs (conditional random fields) and SVMs models. © by Institute of Software, the Chinese Academy of Sciences.

Statistical Chinese Chunking Model Based on Word Clustering Features

Chinese Text Chunking Based on Improved K-means Clustering

Enhancing Chinese Word Segmentation With Character Clustering

Chinese Chunking Algorithm Based On Conditional Random Fields

A Clustering Chunking Method Based on Manifold Geodesic Distance

Chinese chunking method based on conditional random fields and semantic classes

Research on Chinese Word Clustering

A Maximum Entropy Markov Model for Chunking

Chinese word segmentation as morpheme-based lexical chunking

Chinese Text Chunking Using Lexicalized HMMs

Enhancing Web Text Clustering Accuracy and Efficiency With a Maximum Entropy Function Model: Overcoming High-Dimensional and Directional Challenges

Distributional Character Clustering For Chinese Text Categorization

A Comparative Study on Chinese Word Segmentation Using Statistical Models

Chinese Chunking and Its Application on Similarity Computation

A Multi-Agent Strategy for Both English and Chinese Text Chunking

A Multi-Agent Strategy for Chinese Text Chunking

A Divide-Conquer Strategy for Both English and Chinese Text Chunking

Clustering of Chinese Sentences Using the SMM Model

Analysis of Rapid Chinese Text Chunking Based on SVM

Chinese Chunking Based on Coarse-Grained Part-Of-Speech Features

Chinese chunking with large margin method