Abstract:Chinese word segmentation (CWS) is the foundational work of geological report text mining and has an important influence on various tasks, such as named entity recognition and relation extraction. In recent years, the accuracy of the domain‐general CWS model has been limited by the domain and large scale of the training corpus, especially data on Chinese geological texts. Training these CWS models also requires much manually annotated data, which takes a large amount of time and effort. When applying these existing models/methods directly to the geoscience domain, the segmentation accuracy and performance will drop dramatically. To address this problem, we pretrain the Bidirectional Encoder Representations from Transformer (BERT), which can leverage unlabeled domain‐specific knowledge, on unlabeled Chinese geological text and then input them into a Bidirectional long short‐term memory and Conditional random field (BiLSTM‐CRF) model for extracting text features. Finally, the predicted tags are decoded by the CRF. The experimental results show that the F1 score of the proposed model reaches 96.2% on the constructed test set of geological texts. Additionally, experiments illustrate that our proposed model achieves comparable performance to that of other state‐of‐the‐art models, and the proposed cyclic self‐learning strategy can be further extended to other domains. The supervised word segmentation model commonly lacks specialized knowledge in the training data set and has poor adaptability to the domain. This study proposes a sequential annotation model for geoscience text, which automatically construct domain training‐corpus and realize word segmentation taking into account the long‐distance dependence of sentences. We hope that our approach will serve as an alternative method that deserves further study. BERT is used to capture the abundant word level features, grammatical structure features and semantic features in sentences The self‐learning strategy assisted by domain knowledge can automatically construct the domain training corpus without manual intervention A set of experiments to verify the effectiveness of the proposed method on an available manually constructed hybrid data set BERT is used to capture the abundant word level features, grammatical structure features and semantic features in sentences The self‐learning strategy assisted by domain knowledge can automatically construct the domain training corpus without manual intervention A set of experiments to verify the effectiveness of the proposed method on an available manually constructed hybrid data set

Semi-supervised geological disasters named entity recognition using few labeled data

Deep Learning-Based Named Entity Recognition and Knowledge Graph Construction for Geological Hazards

Few-shot learning for name entity recognition in geological text based on GeoBERT

Textual Data Augmentation for NER in Geosciences with LLMs

Data-augmented Landslide Displacement Prediction Using Generative Adversarial Network

Unsupervised Domain Adaptation with Global and Local Graph Neural Networks in Limited Labeled Data Scenario: Application to Disaster Management

Geo-knowledge-guided GPT models improve the extraction of location descriptions from disaster-related social media messages

Semi-Supervised Bidirectional Long Short-Term Memory and Conditional Random Fields Model for Named-Entity Recognition Using Embeddings from Language Models Representations

A Model for Geographical Named Entity Recognition and Correction Based on Deep Neural Networks and the BERT Model

ATBBC: Named entity recognition in emergency domains based on joint BERT-BILSTM-CRF adversarial training

Distantly Supervised NER with Partial Annotation Learning and Reinforcement Learning.

GeoNER: Geological Named Entity Recognition with Enriched Domain Pre‐Training Model and Adversarial Training

DFPENet-geology: A Deep Learning Framework for High Precision Recognition and Segmentation of Co-seismic Landslides

Named entity recognition based on semi-supervised ensemble learning with the improved tri-training algorithm

GPT-NER: Named Entity Recognition via Large Language Models

An Unsupervised Learning Approach for NER Based on Online Encyclopedia.

Chinese Word Segmentation Based on Self‐Learning Model and Geological Knowledge for the Geoscience Domain

A New Deep-Learning-Based Approach for Earthquake-Triggered Landslide Detection From Single-Temporal RapidEye Satellite Imagery

DisasterNets: Embedding Machine Learning in Disaster Mapping

Research on Remote-Sensing Identification Method of Typical Disaster-Bearing Body Based on Deep Learning and Spatial Constraint Strategy