Abstract:Early detection and treatment of visual impairment diseases are critical and integral to combating avoidable blindness. To enable this, artificial intelligence–based disease identification approaches are vital for visual impairment diseases, especially for people living in areas with a few ophthalmologists. In this study, we demonstrated the identification of a large variety of visual impairment diseases using a coarse-to-fine approach. We designed a hierarchical deep learning network, which is composed of a family of multi-task & multi-label learning classifiers representing different levels of eye diseases derived from a predefined hierarchical eye disease taxonomy. A multi-level disease–guided loss function was proposed to learn the fine-grained variability of eye disease features. The proposed framework was trained for both ocular surface and retinal images, independently. The training dataset comprised 7,100 clinical images from 1,600 patients with 100 diseases. To show the feasibility of the proposed framework, we demonstrated eye disease identification on the first two levels of the eye disease taxonomy, namely 7 ocular diseases with 4 ocular surface diseases and 3 retinal fundus diseases in level 1 and 17 subclasses with 9 ocular surface diseases and 8 retinal fundus diseases in level 2. The proposed framework is flexible and extensible, which can be inherently trained on more levels with sufficient training data for each subtype diseases (e.g., the 17 classes of level 2 include 100 subtype diseases defined as level 3 diseases). The performance of the proposed framework was evaluated against 40 board-certified ophthalmologists on clinical cases with various visual impairment diseases and showed that the proposed framework had high sensitivity and specificity with the area under the receiver operating characteristic curve ranging from 0.743 to 0.989 in identifying all identified major causes of blindness. Further assessment of 4,670 cases in a tertiary eye center also demonstrated that the proposed framework achieved a high identification accuracy rate for different visual impairment diseases compared with that of human graders in a clinical setting. The proposed hierarchical deep learning framework would improve clinical practice in ophthalmology and broaden the scope of service available, especially for people living in areas with a few ophthalmologists.

Hierarchical deep learning models using transfer learning for disease detection and classification based on small number of medical images

Federated Ophthalmic Disease Diagnosis Based on Weighted Averaging and Local Optimization

A hierarchical deep learning approach with transparency and interpretability based on small samples for glaucoma diagnosis

A Novel Hierarchical Deep Learning Framework for Diagnosing Multiple Visual Impairment Diseases in the Clinical Environment

Comparative Study of Transfer Learning Models for Retinal Disease Diagnosis from Fundus Images

Self-Adaptive Transfer Learning for Multicenter Glaucoma Classification in Fundus Retina Images

Deep learning for identifying corneal diseases from ocular surface slit-lamp photographs

Prediction of Different Eye Diseases Based on Fundus Photography via Deep Transfer Learning

Deep Learning Through Two-Branch Convolutional Neuron Network for Glaucoma Diagnosis.

A Deep Learning Analysis Framework for Ophthalmic Diseases and Physical Health from Binocular Fundus Image Pairs

Hierarchical Knowledge Guided Learning for Real-world Retinal Disease Recognition

Hierarchical Knowledge Guided Learning for Real-world Retinal Diseases Recognition

Deep-Ocular: Improved Transfer Learning Architecture Using Self-Attention and Dense Layers for Recognition of Ocular Diseases

Deep Learning-Based System for Disease Screening and Pathologic Region Detection from Optical Coherence Tomography Images.

Large Data of Medical Images Driven Repeatable Diseases Intelligent Diagnosis Model using Deep Learning Technology

Ophthalmic Disease Detection via Deep Learning With a Novel Mixture Loss Function

A Health Diagnosis System based on Transfer Learning and Multi-scale Dilated Convolution from Binocular Fundus Image Pairs

A Comprehensive Study on Deep Learning Models for the Detection of Ovarian Cancer and Glomerular Kidney Disease using Histopathological Images

Transfer Learning based Detection of Diabetic Retinopathy from Small Dataset

Deep Learning Based Data Augmentation and Classification for Limited Medical Data Learning

Deep Learning for Optic Disc Segmentation and Glaucoma Diagnosis on Retinal Images