Abstract:Chinese word segmentation (CWS) is the foundational work of geological report text mining and has an important influence on various tasks, such as named entity recognition and relation extraction. In recent years, the accuracy of the domain‐general CWS model has been limited by the domain and large scale of the training corpus, especially data on Chinese geological texts. Training these CWS models also requires much manually annotated data, which takes a large amount of time and effort. When applying these existing models/methods directly to the geoscience domain, the segmentation accuracy and performance will drop dramatically. To address this problem, we pretrain the Bidirectional Encoder Representations from Transformer (BERT), which can leverage unlabeled domain‐specific knowledge, on unlabeled Chinese geological text and then input them into a Bidirectional long short‐term memory and Conditional random field (BiLSTM‐CRF) model for extracting text features. Finally, the predicted tags are decoded by the CRF. The experimental results show that the F1 score of the proposed model reaches 96.2% on the constructed test set of geological texts. Additionally, experiments illustrate that our proposed model achieves comparable performance to that of other state‐of‐the‐art models, and the proposed cyclic self‐learning strategy can be further extended to other domains. The supervised word segmentation model commonly lacks specialized knowledge in the training data set and has poor adaptability to the domain. This study proposes a sequential annotation model for geoscience text, which automatically construct domain training‐corpus and realize word segmentation taking into account the long‐distance dependence of sentences. We hope that our approach will serve as an alternative method that deserves further study. BERT is used to capture the abundant word level features, grammatical structure features and semantic features in sentences The self‐learning strategy assisted by domain knowledge can automatically construct the domain training corpus without manual intervention A set of experiments to verify the effectiveness of the proposed method on an available manually constructed hybrid data set BERT is used to capture the abundant word level features, grammatical structure features and semantic features in sentences The self‐learning strategy assisted by domain knowledge can automatically construct the domain training corpus without manual intervention A set of experiments to verify the effectiveness of the proposed method on an available manually constructed hybrid data set

Adaptive Multi-Task Transfer Learning for Chinese Word Segmentation in Medical Text.

A Joint Multiple Criteria Model in Transfer Learning for Cross-domain Chinese Word Segmentation

Addressing Domain Adaptation for Chinese Word Segmentation with Global Recurrent Structure.

Improving Cross-Domain Chinese Word Segmentation with Word Embeddings

Toward Fast and Accurate Neural Chinese Word Segmentation with Multi-Criteria Learning

Transfer Deep Learning for Low-Resource Chinese Word Segmentation with a Novel Neural Network

A New Error-driven Learning Approach for Chinese Word Segmentation

Segment, Mask, and Predict: Augmenting Chinese Word Segmentation with Self-Supervision

Domain Adaptive Chinese Word Segmentation Method for Power Data Security Classification

Chinese Word Segmentation Based on Self‐Learning Model and Geological Knowledge for the Geoscience Domain

Neural Chinese Word Segmentation with Dictionary Knowledge

Neural Chinese Word Segmentation as Sequence to Sequence Translation

Domain-Aware Word Segmentation for Chinese Language: A Document-Level Context-Aware Model

Mind the Gap: Alleviating Local Imbalance for Unsupervised Cross-Modality Medical Image Segmentation.

Deep Stacking Networks for Low-Resource Chinese Word Segmentation with Transfer Learning

A Fine-Grained Chinese Word Segmentation and Part-of-speech Tagging Corpus for Clinical Text

Tri-Directional Tasks Complementary Learning for Unsupervised Domain Adaptation of Cross-modality Medical Image Semantic Segmentation.

Effective Neural Solution for Multi-criteria Word Segmentation

Adversarial Multi-Criteria Learning for Chinese Word Segmentation

Automatic Corpus Expansion for Chinese Word Segmentation by Exploiting the Redundancy of Web Information.

Feature Abstraction for Lightweight and Accurate Chinese Word Segmentation