Abstract:PurposeThe majority of existing studies about named entity recognition (NER) concentrate on the prediction enhancement of deep neural network (DNN)-based models themselves, but the issues about the scarcity of training corpus and the difficulty of annotation quality control are not fully solved, especially for Chinese ancient corpora. Therefore, designing a new integrated solution for Chinese historical NER, including automatic entity extraction and man-machine cooperative annotation, is quite valuable for improving the effectiveness of Chinese historical NER and fostering the development of low-resource information extraction.Design/methodology/approachThe research provides a systematic approach for Chinese historical NER with a three-stage framework. In addition to the stage of basic preprocessing, the authors create, retrain and yield a high-performance NER model only using limited labeled resources during the stage of augmented deep active learning (ADAL), which entails three steps-DNN-based NER modeling, hybrid pool-based sampling (HPS) based on the active learning (AL), and NER-oriented data augmentation (DA). ADAL is thought to have the capacity to maintain the performance of DNN as high as possible under the few-shot constraint. Then, to realize machine-aided quality control in crowdsourcing settings, the authors design a stage of globally-optimized automatic label consolidation (GALC). The core of GALC is a newly-designed label consolidation model called simulated annealing-based automatic label aggregation ("SA-ALC"), which incorporates the factors of worker reliability and global label estimation. The model can assure the annotation quality of those data from a crowdsourcing annotation system.FindingsExtensive experiments on two types of Chinese classical historical datasets show that the authors' solution can effectively reduce the corpus dependency of a DNN-based NER model and alleviate the problem of label quality. Moreover, the results also show the superior performance of the authors' pipeline approaches (i.e. HPS + DA and SA-ALC) compared to equivalent baselines in each stage.Originality/valueThe study sheds new light on the automatic extraction of Chinese historical entities in an all-technological-process integration. The solution is helpful to effectively reducing the annotation cost and controlling the labeling quality for the NER task. It can be further applied to similar tasks of information extraction and other low-resource fields in theoretical and practical ways.

CHED: A Cross-Historical Dataset with a Logical Event Schema for Classical Chinese Event Detection

CHisIEC: An Information Extraction Corpus for Ancient Chinese History

OntoED: Low-resource Event Detection with Ontology Embedding

DocEE-zh: A Fine-grained Benchmark for Chinese Document-level Event Extraction

Improving Low-Resource Chinese Event Detection with Multi-task Learning.

Pre-trained Language Model Augmented Adversarial Training Network for Chinese Clinical Event Detection.

CERD: A Comprehensive Chinese Rhetoric Dataset for Rhetorical Understanding and Generation in Essays

A Multi-Task Dataset for Assessing Discourse Coherence in Chinese Essays: Structure, Theme, and Logic Analysis

EduNER: a Chinese Named Entity Recognition Dataset for Education Research

A Deep Active Learning-Based and Crowdsourcing-Assisted Solution for Named Entity Recognition in Chinese Historical Corpora.

A Semantic Framework for Chinese Historical Events Based on Linked Data and Knowledge Graph.

Harvesting Events from Multiple Sources: Towards a Cross-Document Event Extraction Paradigm

Multi-modal news event detection with external knowledge

SEN: A Subword-Based Ensemble Network for Chinese Historical Entity Extraction

MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction

CED: Catalog Extraction from Documents

CSED: A Chinese Semantic Error Diagnosis Corpus

Enhancing Cross-Document Event Coreference Resolution by Discourse Structure and Semantic Information

AC-EVAL: Evaluating Ancient Chinese Language Understanding in Large Language Models

Generating Harder Cross-document Event Coreference Resolution Datasets using Metaphoric Paraphrasing

RCFGED: Retrospective Coarse and Fine-Grained Event Detection from Online News