Abstract:In view of the particularity of Chinese word segmentation in the professional field of power grid regulation, the performance of Chinese word segmentation based on traditional statistical algorithm is frequently limited by the corpus training in the proprietary field, and the insufficient ability of Chinese word segmentation based on dictionary algorithm in identifying new words and disambiguation in the proprietary field. This paper proposes a Chinese word segmentation method based on the combination of dictionary and statistical method, and applies it to the application scenario of querying the operation status of power grid. This method constructs a professional dictionary in the field of power grid regulation by using the Double-Array Tree storage structure. Then using the CRF(Conditional Random Fields) train the text data to generate the model file, and the FMM(Forward Maximum Matching) method is used for Chinese word segmentation combined with the professional dictionary in the field of power grid regulation. A fast and accurate online word segmentation method in the field of power grid regulation is designed and implemented, it performs well in some main performance indexes. In the application scenario of querying the power grid operation status, the Chinese word segmentation results obtained by this method combined with the standard query sentence pattern realize the rapid classification of application scenario query and the accurate execution of operation commands, greatly improve the efficiency and accuracy of querying the power grid operation status, and improve the human-computer interaction experience.

Research of an improved algorithm for Chinese word segmentation dictionary based on double-array Trie-tree

Research of an Improved Double-Array Trie Tree Algorithm

An Improved PATRICIA-tree-based Dictionary Mechanism for Automatic Chinese Word Segmentation

Research of Chinese Word Segmentation Based on Double-Array Trie

VLSI Implementation of Lempel-Ziv Binary-Tree Search Algorithm

Chinese Word Segmentation Method Based on Dictionary and Frequency of the Words

A Fast Trie Tree Index Construction Algorithm Using Frequency Characteristic

Research of Optimization on Double-Array Trie and its Application

Research on double-array-trie tree-based lexicon and its application on micro-blog content analysing

A Study on Fast Algorithm for Chinese Dictionary Lookup

Improved Algorithm for Increasing Maximum Matching

A Pragmatic Approach to Increase Accuracy of Chinese Word-Segmentation

Word Chain-based Automatic Word Segmentation Method

Binary Tree based Chinese Word Segmentation

Increasing Accuracy of Chinese Segmentation with Strategy of Multi-step Processing

Effective Subsequence-Based Tagging for Chinese Word Segmentation

An Efficient Word Lookup System by using Improved Trie Algorithm

Research on Chinese Word Segmentation Algorithm based on Dictionary and Statistical Method and Its Application in the field of Power Grid Control

A Compression-based Algorithm for Chinese Word Segmentation

Method of Chinese Word Segmentation Based on Directed Graph

An Improved Chinese Word Segmentation System with Conditional Random Field