Abstract:Supervised deep learning has achieved prominent success in various diabetic macular edema (DME) recognition tasks from optical coherence tomography (OCT) volumetric images. A common problematic issue that frequently occurs in this field is the shortage of labeled data due to the expensive fine-grained annotations, which increases substantial difficulty in accurate analysis by supervised learning. The morphological changes in the retina caused by DME might be distributed sparsely in B-scan images of the OCT volume, and OCT data is often coarsely labeled at the volume level. Hence, the DME identification task can be formulated as a multiple instance classification problem that could be addressed by multiple instance learning (MIL) techniques. Nevertheless, none of previous studies utilize unlabeled data simultaneously to promote the classification accuracy, which is particularly significant for a high quality of analysis at the minimum annotation cost. To this end, we present a novel deep semi-supervised multiple instance learning framework to explore the feasibility of leveraging a small amount of coarsely labeled data and a large amount of unlabeled data to tackle this problem. Specifically, we come up with several modules to further improve the performance according to the availability and granularity of their labels. To warm up the training, we propagate the bag labels to the corresponding instances as the supervision of training, and propose a self-correction strategy to handle the label noise in the positive bags. This strategy is based on confidence-based pseudo-labeling with consistency regularization. The model uses its prediction to generate the pseudo-label for each weakly augmented input only if it is highly confident about the prediction, which is subsequently used to supervise the same input in a strongly augmented version. This learning scheme is also applicable to unlabeled data. To enhance the discrimination capability of the model, we introduce the Student-Teacher architecture and impose consistency constraints between two models. For demonstration, the proposed approach was evaluated on two large-scale DME OCT image datasets. Extensive results indicate that the proposed method improves DME classification with the incorporation of unlabeled data and outperforms competing MIL methods significantly, which confirm the feasibility of deep semi-supervised multiple instance learning at a low annotation cost.

Computer Aided Endoscope Diagnosis Via Weakly Labeled Data Mining.

Computer-Aided Endoscopic Diagnosis Without Human-Specific Labeling

Multi-Class Latent Concept Pooling for Computer-Aided Endoscopy Diagnosis

Multi-label Recognition of Cancer-Related Lesions with Clinical Priors on White-Light Endoscopy

Deep sparse feature selection for computer aided endoscopy diagnosis

Diabetic Retinopathy Detection Based on Weakly Supervised Object Localization and Knowledge Driven Attribute Mining.

Endoscopic Ultrasound Image Recognition Based on Data Mining and Deep Learning

IIB-MIL: Integrated Instance-Level and Bag-Level Multiple Instances Learning with Label Disambiguation for Pathological Image Analysis

Semi-Supervised Segmentation Framework for Gastrointestinal Lesion Diagnosis in Endoscopic Images

Computer-Assisted Diagnosis of Digestive Endoscopic Images Based on Bayesian Theory

Deep semi-supervised multiple instance learning with self-correction for DME classification from OCT images

Diagnosis of Multiple Fundus Disorders Amidst a Scarcity of Medical Experts Via Self-supervised Machine Learning

Multiple Instance Learning with Task-Specific Multi-Level Features for Weakly Annotated Histopathological Image Classification

Weakly-Supervised Cross-Domain Adaptation for Endoscopic Lesions Segmentation

Computerized breast cancer analysis system using three stage semi-supervised learning method

A Benchmark Dataset of Endoscopic Images and Novel Deep Learning Method to Detect Intestinal Metaplasia and Gastritis Atrophy.

Weakly supervised histopathology cancer image segmentation and classification

Weakly Supervised Lesion Detection from Fundus Images

Online Easy Example Mining for Weakly-supervised Gland Segmentation from Histology Images

An End-to-End Mammogram Diagnosis: A New Multi-Instance and Multiscale Method Based on Single-Image Feature

Image-based Dementia Disease Diagnosis Via Deep Low-Resource Pair-Wise Learning