Abstract:Timely detection and treatment of microaneurysms is a critical step to prevent the development of vision-threatening eye diseases such as diabetic retinopathy. However, detecting microaneurysms in fundus images is a highly challenging task due to the low image contrast, misleading cues of other red lesions, and the large variation of imaging conditions. Existing methods tend to fail in face of the large intra-class variation and small inter-class variations for microaneurysm detection in fundus images. Recently, hybrid text/image mining computer-aided diagnosis systems have emerged to offer a promise of bridging the semantic gap between images and diagnostic information. In this paper, we focus on developing an interleaved deep mining technique to cope intelligently with the unbalanced microaneurysm detection problem. Specifically, we present a clinical report guided multi-sieving convolutional neural network, which leverages a small amount of supervised information in clinical reports to identify the potential microaneurysm regions via the image-to-text mapping in the feature space. These potential microaneurysm regions are then interleaved with fundus image information for multi-sieving deep mining in a highly unbalanced classification problem. Critically, the clinical reports are employed to bridge the semantic gap between low-level image features and high-level diagnostic information. We build an efficient microaneurysm detection framework based on the hybrid text/image interleaving and validate its performance on challenging clinical data sets acquired from diabetic retinopathy patients. Extensive evaluations are carried out in terms of fundus detection and classification. Experimental results show that our framework achieves 99.7% precision and 87.8% recall, comparing favorably with the state-of-the-art algorithms. Integration of expert domain knowledge and image information demonstrates the feasibility of reducing the difficulty of training classifiers under extremely unbalanced data distributions.

Microaneurysms Detection in Fundus Image Based on Phase Congruency

Using Phase Congruency Model for Microaneurysms Detection in Fundus Image

Automatic Analysis of Microaneurysms Turnover to Diagnose the Progression of Diabetic Retinopathy.

Microaneurysms Detection in Retinal Fundus Images Based on Shape Constraint with Region-Context Features

Segmentation of retinal microaneurysms in fluorescein fundus angiography images by a novel three-step model

New hierarchical approach for microaneurysms detection with matched filter and machine learning

Retinopathy Online Challenge: Automatic Detection of Microaneurysms in Digital Color Fundus Photographs

Detection of Microaneurysms Using Multi-Scale Correlation Coefficients

Retinal Microaneurysms Detection using Local Convergence Index Features

Red Lesion Detection In Retinal Fundus Images Using Frangi-Based Filters

Retinal Microaneurysms Detection Using Gradient Vector Analysis and Class Imbalance Classification

A complementary method for automated detection of microaneurysms in fluorescein angiography fundus images to assess diabetic retinopathy

Detecting Retinal Microaneurysms and Hemorrhages with Robustness to the Presence of Blood Vessels

A Magnified Adaptive Feature Pyramid Network for automatic microaneurysms detection

Clinical Report Guided Retinal Microaneurysm Detection with Multi-Sieving Deep Learning.

Fundus Optic Disc Localization and Segmentation Method Based on Phase Congruency

A Deep Learning-Based Unified Framework for Red Lesions Detection on Retinal Fundus Images

Algorithm of automatic identification of diabetic retinopathy foci based on ultra-widefield scanning laser ophthalmoscopy

Local Connectedness Constraint and Contrast Normalization Based Microaneurysm Detection.

Diabetic Retinopathy Detection Using Prognosis of Microaneurysm and Early Diagnosis System for Non-Proliferative Diabetic Retinopathy Based on Deep Learning Algorithms

A Framework for Identifying Diabetic Retinopathy Based on Anti-noise Detection and Attention-Based Fusion.