Abstract:Early detection and treatment of visual impairment diseases are critical and integral to combating avoidable blindness. To enable this, artificial intelligence–based disease identification approaches are vital for visual impairment diseases, especially for people living in areas with a few ophthalmologists. In this study, we demonstrated the identification of a large variety of visual impairment diseases using a coarse-to-fine approach. We designed a hierarchical deep learning network, which is composed of a family of multi-task & multi-label learning classifiers representing different levels of eye diseases derived from a predefined hierarchical eye disease taxonomy. A multi-level disease–guided loss function was proposed to learn the fine-grained variability of eye disease features. The proposed framework was trained for both ocular surface and retinal images, independently. The training dataset comprised 7,100 clinical images from 1,600 patients with 100 diseases. To show the feasibility of the proposed framework, we demonstrated eye disease identification on the first two levels of the eye disease taxonomy, namely 7 ocular diseases with 4 ocular surface diseases and 3 retinal fundus diseases in level 1 and 17 subclasses with 9 ocular surface diseases and 8 retinal fundus diseases in level 2. The proposed framework is flexible and extensible, which can be inherently trained on more levels with sufficient training data for each subtype diseases (e.g., the 17 classes of level 2 include 100 subtype diseases defined as level 3 diseases). The performance of the proposed framework was evaluated against 40 board-certified ophthalmologists on clinical cases with various visual impairment diseases and showed that the proposed framework had high sensitivity and specificity with the area under the receiver operating characteristic curve ranging from 0.743 to 0.989 in identifying all identified major causes of blindness. Further assessment of 4,670 cases in a tertiary eye center also demonstrated that the proposed framework achieved a high identification accuracy rate for different visual impairment diseases compared with that of human graders in a clinical setting. The proposed hierarchical deep learning framework would improve clinical practice in ophthalmology and broaden the scope of service available, especially for people living in areas with a few ophthalmologists.

Automated detection of nine infantile fundus diseases and conditions in retinal images using a deep learning system

The application and value evaluation of assisted diagnosis system for five fundus lesion based on artificial intelligence combined with optical coherence tomography

Automatic retinal image diagnosis system for mass health screenings

A fundus image dataset for intelligent retinopathy of prematurity system

A deep learning system for detecting diabetic retinopathy across the disease spectrum

Analyzing fundus images to detect diabetic retinopathy (DR) using deep learning system in the Yangtze River delta region of China

Development and Application of an Intelligent Diagnosis System for Retinal Vein Occlusion Based on Deep Learning

Deep Learning for the Detection of Multiple Fundus Diseases Using Ultra-widefield Images

Intelligent Diagnosis of Multiple Peripheral Retinal Lesions in Ultra-widefield Fundus Images Based on Deep Learning

Automatic Non-Proliferative Diabetic Retinopathy Screening System Based on Color Fundus Image

Deep Learning Based Retinal Layer Segmentation in Optical Coherence Tomography Scans of Patients with Inherited Retinal Diseases

Common and Rare Fundus Diseases Identification Using Vision-Language Foundation Model with Knowledge of Over 400 Diseases

Deep learning-based analysis of infrared fundus photography for automated diagnosis of diabetic retinopathy with cataracts

The performance of a deep learning system in assisting junior ophthalmologists in diagnosing 13 major fundus diseases: a prospective multi-center clinical trial

An Intelligent Optical Coherence Tomography-based System for Pathological Retinal Cases Identification and Urgent Referrals

Fundus image classification using Inception V3 and ResNet-50 for the early diagnostics of fundus diseases

Early detection of visual impairment in young children using a smartphone-based deep learning system

Retinal Disease Diagnosis Using Deep Learning on Ultra-Wide-Field Fundus Images

A Novel Hierarchical Deep Learning Framework for Diagnosing Multiple Visual Impairment Diseases in the Clinical Environment

An Interpretable System for Screening the Severity Level of Retinopathy in Premature Infants Using Deep Learning

Deep learning for detecting visually impaired cataracts using fundus images