Abstract:Supervised deep learning has achieved prominent success in various diabetic macular edema (DME) recognition tasks from optical coherence tomography (OCT) volumetric images. A common problematic issue that frequently occurs in this field is the shortage of labeled data due to the expensive fine-grained annotations, which increases substantial difficulty in accurate analysis by supervised learning. The morphological changes in the retina caused by DME might be distributed sparsely in B-scan images of the OCT volume, and OCT data is often coarsely labeled at the volume level. Hence, the DME identification task can be formulated as a multiple instance classification problem that could be addressed by multiple instance learning (MIL) techniques. Nevertheless, none of previous studies utilize unlabeled data simultaneously to promote the classification accuracy, which is particularly significant for a high quality of analysis at the minimum annotation cost. To this end, we present a novel deep semi-supervised multiple instance learning framework to explore the feasibility of leveraging a small amount of coarsely labeled data and a large amount of unlabeled data to tackle this problem. Specifically, we come up with several modules to further improve the performance according to the availability and granularity of their labels. To warm up the training, we propagate the bag labels to the corresponding instances as the supervision of training, and propose a self-correction strategy to handle the label noise in the positive bags. This strategy is based on confidence-based pseudo-labeling with consistency regularization. The model uses its prediction to generate the pseudo-label for each weakly augmented input only if it is highly confident about the prediction, which is subsequently used to supervise the same input in a strongly augmented version. This learning scheme is also applicable to unlabeled data. To enhance the discrimination capability of the model, we introduce the Student-Teacher architecture and impose consistency constraints between two models. For demonstration, the proposed approach was evaluated on two large-scale DME OCT image datasets. Extensive results indicate that the proposed method improves DME classification with the incorporation of unlabeled data and outperforms competing MIL methods significantly, which confirm the feasibility of deep semi-supervised multiple instance learning at a low annotation cost.

Self-supervised Deep Learning for Reading Activity Classification

Reading bots: The implication of deep learning on guided reading

A survey of deep learning techniques for machine reading comprehension

Self-supervised Learning for Label-Efficient Sleep Stage Classification: A Comprehensive Evaluation

Deep learning classification of reading disability with regional brain volume features

Deep learning-driven dyslexia detection model using multi-modality data

Learners' Autonomous Learning Behavior in Distance Reading Based on Big Data

Consequential Advancements of Self-Supervised Learning (SSL) in Deep Learning Contexts

A Deep-Learning Based Method for Analysis of Students’ Attention in Offline Class

Deep Learning for Sensor-based Activity Recognition: A Survey

Analysis of self-directed learning ability, reading outcomes, and personalized planning behavior for self-directed extensive reading

Deep Semi-Supervised and Self-Supervised Learning for Diabetic Retinopathy Detection

Self-supervision for medical image classification: state-of-the-art performance with ~100 labeled training samples per class

Improving predictive power through deep learning analysis of K-12 online student behaviors and discussion board content

A novel self-training semi-supervised deep learning approach for machinery fault diagnosis

DeepLens: Interactive Out-of-distribution Data Detection in NLP Models

Self-supervised learning-enhanced deep learning method for identifying myopic maculopathy in high myopia patients

Robust semi-supervised classification based on data augmented online ELMs with deep features

Deep semi-supervised multiple instance learning with self-correction for DME classification from OCT images

SelfAct: Personalized Activity Recognition based on Self-Supervised and Active Learning

Decoding Contextual Factors Differentiating Adolescents’ High, Average, and Low Digital Reading Performance Through Machine-Learning Methods