Abstract:Timely detection and treatment of microaneurysms is a critical step to prevent the development of vision-threatening eye diseases such as diabetic retinopathy. However, detecting microaneurysms in fundus images is a highly challenging task due to the low image contrast, misleading cues of other red lesions, and the large variation of imaging conditions. Existing methods tend to fail in face of the large intra-class variation and small inter-class variations for microaneurysm detection in fundus images. Recently, hybrid text/image mining computer-aided diagnosis systems have emerged to offer a promise of bridging the semantic gap between images and diagnostic information. In this paper, we focus on developing an interleaved deep mining technique to cope intelligently with the unbalanced microaneurysm detection problem. Specifically, we present a clinical report guided multi-sieving convolutional neural network, which leverages a small amount of supervised information in clinical reports to identify the potential microaneurysm regions via the image-to-text mapping in the feature space. These potential microaneurysm regions are then interleaved with fundus image information for multi-sieving deep mining in a highly unbalanced classification problem. Critically, the clinical reports are employed to bridge the semantic gap between low-level image features and high-level diagnostic information. We build an efficient microaneurysm detection framework based on the hybrid text/image interleaving and validate its performance on challenging clinical data sets acquired from diabetic retinopathy patients. Extensive evaluations are carried out in terms of fundus detection and classification. Experimental results show that our framework achieves 99.7% precision and 87.8% recall, comparing favorably with the state-of-the-art algorithms. Integration of expert domain knowledge and image information demonstrates the feasibility of reducing the difficulty of training classifiers under extremely unbalanced data distributions.

Using Phase Congruency Model for Microaneurysms Detection in Fundus Image

Microaneurysms Detection in Fundus Image Based on Phase Congruency

Automatic Analysis of Microaneurysms Turnover to Diagnose the Progression of Diabetic Retinopathy.

Segmentation of retinal microaneurysms in fluorescein fundus angiography images by a novel three-step model

New hierarchical approach for microaneurysms detection with matched filter and machine learning

Automatic Microaneurysm Detection in Fundus Image Based on Local Cross-Section Transformation and Multi-Feature Fusion

Microaneurysms Detection in Retinal Fundus Images Based on Shape Constraint with Region-Context Features

Local Connectedness Constraint and Contrast Normalization Based Microaneurysm Detection.

Automatic Detection of Microaneurysms in Fundus Images

Automatic detection of microaneurysms in retinal fundus images.

Detection of Microaneurysms Using Multi-Scale Correlation Coefficients

Retinal Microaneurysms Detection using Local Convergence Index Features

An Automatic Detection Model of Microaneurysms Based on Improved FC-Densenet

Microaneurysm detection based on background estimation and finer vessel extraction in retinal image

Detection of Microaneurysms in Fundus Images Based on an Attention Mechanism

Clinical Report Guided Retinal Microaneurysm Detection with Multi-Sieving Deep Learning.

Automated Detection of Microaneurysms in Color Fundus Images using Deep Learning with Different Preprocessing Approaches

Retinal Microaneurysms Detection Using Gradient Vector Analysis and Class Imbalance Classification

Retinopathy Online Challenge: Automatic Detection of Microaneurysms in Digital Color Fundus Photographs

Fundus Optic Disc Localization and Segmentation Method Based on Phase Congruency

APNet: Adaptive Patch-based Network for Microaneurysm Detection in Fundus Images