Abstract:Deep learning has achieved remarkable success in the optical coherence tomography (OCT) image classification task with substantial labelled B-scan images available. However, obtaining such fine-grained expert annotations is usually quite difficult and expensive. How to leverage the volume-level labels to develop a robust classifier is very appealing. In this paper, we propose a weakly supervised deep learning framework with uncertainty estimation to address the macula-related disease classification problem from OCT images with the only volume-level label being available. First, a convolutional neural network (CNN) based instance-level classifier is iteratively refined by using the proposed uncertainty-driven deep multiple instance learning scheme. To our best knowledge, we are the first to incorporate the uncertainty evaluation mechanism into multiple instance learning (MIL) for training a robust instance classifier. The classifier is able to detect suspicious abnormal instances and abstract the corresponding deep embedding with high representation capability simultaneously. Second, a recurrent neural network (RNN) takes instance features from the same bag as input and generates the final bag-level prediction by considering the individually local instance information and globally aggregated bag-level representation. For more comprehensive validation, we built two large diabetic macular edema (DME) OCT datasets from different devices and imaging protocols to evaluate the efficacy of our method, which are composed of 30,151 B-scans in 1,396 volumes from 274 patients (Heidelberg-DME dataset) and 38,976 B-scans in 3,248 volumes from 490 patients (Triton-DME dataset), respectively. We compare the proposed method with the state-of-the-art approaches, and experimentally demonstrate that our method is superior to alternative methods, achieving volume-level accuracy, F1-score and area under the receiver operating characteristic curve (AUC) of 95.1%, 0.939-and 0.990 on Heidelberg-DME and those of 95.1%, 0.935 and 0.986 on Triton-DME, respectively. Furthermore, the proposed method also yields competitive results on another public age-related macular degeneration OCT dataset, indicating the high potential as an effective screening tool in the clinical practice.

Multiple Instance Differentiation Learning for Active Object Detection.

Multiple instance active learning for object detection

Uncertainty-Based Active Learning Via Sparse Modeling for Image Classification

Human Detection Method Based on Multi-Part Detector and Multi-Instance Learning

Classification Committee for Active Deep Object Detection

Negative Deterministic Information-Based Multiple Instance Learning for Weakly Supervised Object Detection and Segmentation

Consistency-based Active Learning for Object Detection

Entropy-based Active Learning for Object Detection with Progressive Diversity Constraint

Uncertainty-driven active developmental learning

Multiple Instance Detection Network with Online Instance Classifier Refinement

Employing Feature Mixture for Active Learning of Object Detection

Multiple Instance Curriculum Learning for Weakly Supervised Object Detection

Pyramidal Multiple Instance Detection Network With Mask Guided Self-Correction for Weakly Supervised Object Detection

Continuation Multiple Instance Learning for Weakly and Fully Supervised Object Detection

Multi-label learning by instance differentiation

UD-MIL: Uncertainty-Driven Deep Multiple Instance Learning for OCT Image Classification

C-MIL: Continuation Multiple Instance Learning for Weakly Supervised Object Detection

Multiple instance learning from similarity-confidence bags

MUS-CDB: Mixed Uncertainty Sampling with Class Distribution Balancing for Active Annotation in Aerial Object Detection

Implicit JointBoost for Multiclass Object Detection under High Intra-Class Variation

Multiple Instance Tracking Based on Hierarchical Maximizing Bag's Margin Boosting