Abstract:Early detection and treatment of visual impairment diseases are critical and integral to combating avoidable blindness. To enable this, artificial intelligence–based disease identification approaches are vital for visual impairment diseases, especially for people living in areas with a few ophthalmologists. In this study, we demonstrated the identification of a large variety of visual impairment diseases using a coarse-to-fine approach. We designed a hierarchical deep learning network, which is composed of a family of multi-task & multi-label learning classifiers representing different levels of eye diseases derived from a predefined hierarchical eye disease taxonomy. A multi-level disease–guided loss function was proposed to learn the fine-grained variability of eye disease features. The proposed framework was trained for both ocular surface and retinal images, independently. The training dataset comprised 7,100 clinical images from 1,600 patients with 100 diseases. To show the feasibility of the proposed framework, we demonstrated eye disease identification on the first two levels of the eye disease taxonomy, namely 7 ocular diseases with 4 ocular surface diseases and 3 retinal fundus diseases in level 1 and 17 subclasses with 9 ocular surface diseases and 8 retinal fundus diseases in level 2. The proposed framework is flexible and extensible, which can be inherently trained on more levels with sufficient training data for each subtype diseases (e.g., the 17 classes of level 2 include 100 subtype diseases defined as level 3 diseases). The performance of the proposed framework was evaluated against 40 board-certified ophthalmologists on clinical cases with various visual impairment diseases and showed that the proposed framework had high sensitivity and specificity with the area under the receiver operating characteristic curve ranging from 0.743 to 0.989 in identifying all identified major causes of blindness. Further assessment of 4,670 cases in a tertiary eye center also demonstrated that the proposed framework achieved a high identification accuracy rate for different visual impairment diseases compared with that of human graders in a clinical setting. The proposed hierarchical deep learning framework would improve clinical practice in ophthalmology and broaden the scope of service available, especially for people living in areas with a few ophthalmologists.

A Health Diagnosis System based on Transfer Learning and Multi-scale Dilated Convolution from Binocular Fundus Image Pairs

A Deep Learning Analysis Framework for Ophthalmic Diseases and Physical Health from Binocular Fundus Image Pairs

Comparative Study of Transfer Learning Models for Retinal Disease Diagnosis from Fundus Images

Federated Ophthalmic Disease Diagnosis Based on Weighted Averaging and Local Optimization

A Benchmark of Ocular Disease Intelligent Recognition: One Shot for Multi-disease Detection

Self-Adaptive Transfer Learning for Multicenter Glaucoma Classification in Fundus Retina Images

A multi-class fundus disease classification system based on an adaptive scale discriminator and hybrid loss

Multi-classification of fundus diseases based on DSRA-CNN

Prediction of Different Eye Diseases Based on Fundus Photography via Deep Transfer Learning

A Novel Hierarchical Deep Learning Framework for Diagnosing Multiple Visual Impairment Diseases in the Clinical Environment

Deep-Ocular: Improved Transfer Learning Architecture Using Self-Attention and Dense Layers for Recognition of Ocular Diseases

Adaptive Multiscale Retinal Diagnosis: A Hybrid Trio-Model Approach for Comprehensive Fundus Multi-Disease Detection Leveraging Transfer Learning and Siamese Networks

Simultaneous Diagnosis of Severity and Features of Diabetic Retinopathy in Fundus Photography Using Deep Learning.

A LLM-Based Hybrid-Transformer Diagnosis System in Healthcare

Multi-label classification of retinal diseases based on fundus images using Resnet and Transformer

Parallel Multi-Path Network for Ocular Disease Detection Inspired by Visual Cognition Mechanism

Multi-Scale Clinical-Guided Binocular Fusion Framework for Predicting New-Onset Hypertension over a Four-Year Period

Combining convolutional neural networks and self-attention for fundus diseases identification

Convolutional Network With Twofold Feature Augmentation for Diabetic Retinopathy Recognition From Multi-Modal Images

A deep learning framework for the early detection of multi-retinal diseases

Automatic Diagnosis of Imbalanced Ophthalmic Images Using a Cost-Sensitive Deep Convolutional Neural Network