Abstract:The prerequisite for establishing an effective prediction system for mammographic diagnosis is the annotation of each mammographic image. The manual annotation work is time-consuming and laborious, which becomes a great hindrance for researchers. In this article, we propose a novel active learning algorithm that can adequately address this problem, leading to the minimization of the labeling costs on the premise of guaranteed performance. Our proposed method is different from the existing active learning methods designed for the general problem as it is specifically designed for mammographic images. Through its modified discriminant functions and improved sample query criteria, the proposed method can fully utilize the pairing of mammographic images and select the most valuable images from both the mediolateral and craniocaudal views. Moreover, in order to extend active learning to the ordinal regression problem, which has no precedent in existing studies, but is essential for mammographic diagnosis (mammographic diagnosis is not only a classification task, but also an ordinal regression task for predicting an ordinal variable, viz. the malignancy risk of lesions), multiple sample query criteria need to be taken into consideration simultaneously. We formulate it as a criteria integration problem and further present an algorithm based on self-adaptive weighted rank aggregation to achieve a good solution. The efficacy of the proposed method was demonstrated on thousands of mammographic images from the digital database for screening mammography. The labeling costs of obtaining optimal performance in the classification and ordinal regression task respectively fell to 33.8 and 19.8 percent of their original costs. The proposed method also generated 1228 wins, 369 ties and 47 losses for the classification task, and 1933 wins, 258 ties and 185 losses for the ordinal regression task compared to the other state-of-the-art active learning algorithms. By taking the particularities of mammographic images, the proposed AL method can indeed reduce the manual annotation work to a great extent without sacrificing the performance of the prediction system for mammographic diagnosis.

Improving Active Learning by Data Balance to Reduce Annotation Efforts

Human-centred Design on Crowdsourcing Annotation Towards Improving Active Learning Model Performance

A comprehensive survey on deep active learning in medical image analysis

Deep active learning models for imbalanced image classification

Learning Image Labels On-the-fly for Training Robust Classification Models

Optimizing Active Learning for Low Annotation Budgets

An Adaptive Low-Rank Modeling-Based Active Learning Method for Medical Image Annotation

Minimization of Annotation Work: Diagnosis of Mammographic Masses Via Active Learning.

Active label cleaning for improved dataset quality under resource constraints

DSAL: Deeply Supervised Active Learning from Strong and Weak Labelers for Biomedical Image Segmentation.

HAL-IA: A Hybrid Active Learning framework using Interactive Annotation for medical image segmentation

An Efficient High-Quality Medical Lesion Image Data Labeling Method Based on Active Learning.

Cost-Effective Active Learning for Deep Image Classification

New Balanced Active Learning Model and Optimization Algorithm.

Active Learning with Label Quality Control

Deep Active Learning Based on Saliency-Guided Data Augmentation for Image Classification

Deep active learning for classifying cancer pathology reports

Active Learning with Noise Modeling for Medical Image Annotation

Suggestive Annotation: A Deep Active Learning Framework for Biomedical Image Segmentation

Label-Efficient Breast Cancer Histopathological Image Classification

Exploring Data Augmentation and Active Learning Benefits in Imbalanced Datasets