Abstract:Early diagnosis and screening of diabetic retinopathy are critical in reducing the risk of vision loss in patients. However, in a real clinical situation, manual annotation of lesion regions in fundus images is time-consuming. Contrastive learning(CL) has recently shown its strong ability for self-supervised representation learning due to its ability of learning the invariant representation without any extra labelled data. In this study, we aim to investigate how CL can be applied to extract lesion features in medical images. However, can the direct introduction of CL into the deep learning framework enhance the representation ability of lesion characteristics? We show that the answer is no. Due to the lesion-specific regions being insignificant in medical images, directly introducing CL would inevitably lead to the effects of false negatives, limiting the ability of the discriminative representation learning. Essentially, two key issues should be considered: (1) How to construct positives and negatives to avoid the problem of false negatives? (2) How to exploit the hard negatives for promoting the representation quality of lesions? In this work, we present a lesion-aware CL framework for DR grading. Specifically, we design a new generating positives and negatives strategy to overcome the false negatives problem in fundus images. Furthermore, a dynamic hard negatives mining method based on knowledge distillation is proposed in order to improve the quality of the learned embeddings. Extensive experimental results show that our method significantly advances state-of-the-art DR grading methods to a considerable 88.0%ACC/86.8% Kappa on the EyePACS benchmark dataset. Our code is available at https://github.com/IntelliDAL/Image.

Lesion Search with Self-supervised Learning

Learning Where to Learn in Cross-View Self-Supervised Learning

Multimodal self-supervised learning for lesion localization

Self-Supervised Multi-Modality Learning for Multi-Label Skin Lesion Classification

Self Supervised Lesion Recognition For Breast Ultrasound Diagnosis

Mixed-order self-paced curriculum learning for universal lesion detection

PCRLv2: A Unified Visual Information Preservation Framework for Self-supervised Pre-training in Medical Image Analysis

Self- and Semi-supervised Learning for Gastroscopic Lesion Detection

Dive into the Details of Self-Supervised Learning for Medical Image Analysis.

Self-Supervised Learning Featuring Small-Scale Image Dataset for Treatable Retinal Diseases Classification

A Unified Visual Information Preservation Framework for Self-supervised Pre-training in Medical Image Analysis

Benchmarking Self-Supervised Learning on Diverse Pathology Datasets

SGCL: Spatial guided contrastive learning on whole-slide pathological images

Lesion-Aware Contrastive Learning for Diabetic Retinopathy Diagnosis

Lesion Localization in OCT by Semi-Supervised Object Detection

SSLP: Spatial Guided Self-supervised Learning on Pathological Images

Embedding Task Knowledge into 3D Neural Networks via Self-supervised Learning

Lesion-based Contrastive Learning for Diabetic Retinopathy Grading from Fundus Images

Lesion-Aware Contrastive Representation Learning for Histopathology Whole Slide Images Analysis

Self-Supervised Learning for Endoscopic Video Analysis

Localized Content-Based Image Retrieval Using Semi-Supervised Multiple Instance Learning