Abstract:Objective: Named entity recognition (NER) is a principal task in the biomedical field and deep learning-based algorithms have been widely applied to biomedical NER. However, all of these methods that are applied to biomedical corpora use only annotated samples to maximize their performances. Thus, (1) large numbers of unannotated samples are relinquished and their values are overlooked. (2) Compared with other types of active learning (AL) algorithms, generative adversarial learning (GAN)-based AL methods have developed slowly. Furthermore, current diversity-based AL methods only compute similarities between a pair of sentences and cannot evaluate distribution similarities between groups of sentences. Annotation inconsistency is one of the significant challenges in the biomedical annotation field. Most existing methods for addressing this challenge are statistics-based or rule-based methods. (3) They require sufficient expert knowledge and complex designs. To address challenges (1), (2), and (3) simultaneously, we propose innovative algorithms. Methods: GAN is introduced in this paper, and we propose the GAN-bidirectional long short-term memoryconditional random field (GAN-BiLSTM-CRF) and the GAN-bidirectional encoder representations from transformers-conditional random field (GAN-BERT-CRF) models, which can be considered an NER model, an AL model, and a model identifying error labels. BiLSTM-CRF or BERT-CRF is defined as the generator and a convolutional neural network (CNN)-based network is considered the discriminator. (1) The generator employs unannotated samples in addition to annotated samples to maximize NER performance. (2) The outputs of the CRF layer and the discriminator are used to select unlabeled samples for the AL task. (3) The discriminator discriminates the distribution of error labels from that of correct labels, identify error labels, and address the annotation inconsistency challenge. Results: The corpus from the 2010 i2b2/VA NLP challenge and the Chinese CCKS-2017 Task 2 dataset are adopted for experiments. Compared to the baseline BiLSTM-CRF and BERT-CRF, the GAN-BiLSTM-CRF and GAN-BERT-CRF models achieved significant improvements on the precision, recall, and Fl scores in terms of NER performance. Learning curves in AL experiments show the comparative results of the proposed models. Furthermore, the trained discriminator can identify samples with incorrect medical labels in both simulation and real-word experimental environments. Conclusion: The idea of introducing GAN contributes significant results in terms of NER, active learning, and the ability to identify incorrect annotated samples. The benefits of GAN will be further studied.

AL-Annotator: an Active Learning-based Cervical Cell Annotation System

A novel automation-assisted cervical cancer reading method based on convolutional neural network

SCAC: A Semi-Supervised Learning Approach for Cervical Abnormal Cell Detection.

Adversarial active learning for the identification of medical concepts and annotation inconsistency

CytoBrain: Cervical Cancer Screening System Based on Deep Learning Technology

Democratizing Pathological Image Segmentation with Lay Annotators via Molecular-empowered Learning

Fast Whole Slide Image Analysis of Cervical Cancer Using Weak Annotation.

DeepLNAnno: a Web-Based Lung Nodules Annotating System for CT Images

A novel attention-guided convolutional network for the detection of abnormal cervical cells in cervical cancer screening

Deep active learning for classifying cancer pathology reports

A systematic review of deep learning-based cervical cytology screening: from cell identification to whole slide image analysis

Cell comparative learning: A cervical cytopathology whole slide image classification method using normal and abnormal cells

Biological data annotation via a human-augmenting AI-based labeling system

Quick Annotator: an open-source digital pathology based rapid image annotation tool

Suggestive Annotation: A Deep Active Learning Framework for Biomedical Image Segmentation

Improving the Accuracy and Efficiency of Abnormal Cervical Squamous Cell Detection with Cytologist-in-the-Loop Artificial Intelligence

A blood cell classification method based on MAE and active learning

Artificial intelligence enables precision diagnosis of cervical cytology grades and cervical cancer

AI-assisted system improves the work efficiency of cytologists via excluding cytology-negative slides and accelerating the slide interpretation

Large-scale cervical precancerous screening via AI-assisted cytology whole slide image analysis

Active Learning Enabled Low-cost Cell Image Segmentation Using Bounding Box Annotation